Beginning Onnx file parsing TRT - INFO ---------------------------------------------------------------- TRT - INFO Input filename: C:/projects/ASLtorch_lior/model_folded.onnx TRT - INFO ONNX IR version: 0.0.7 TRT - INFO Opset version: 13 TRT - INFO Producer name: TRT - INFO Producer version: TRT - INFO Domain: TRT - INFO Model version: 0 TRT - INFO Doc string: TRT - INFO ---------------------------------------------------------------- TRT - VERBOSE Plugin creator already registered - ::GridAnchor_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::GridAnchorRect_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::NMS_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::Reorg_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::Region_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::Clip_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::LReLU_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::PriorBox_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::Normalize_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::ScatterND version 1 TRT - VERBOSE Plugin creator already registered - ::RPROI_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::BatchedNMS_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::BatchTilePlugin_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::FlattenConcat_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::CropAndResize version 1 TRT - VERBOSE Plugin creator already registered - ::CropAndResizeDynamic version 1 TRT - VERBOSE Plugin creator already registered - ::DetectionLayer_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::EfficientNMS_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::ProposalDynamic version 1 TRT - VERBOSE Plugin creator already registered - ::Proposal version 1 TRT - VERBOSE Plugin creator already registered - ::ProposalLayer_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::PyramidROIAlign_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::ResizeNearest_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::Split version 1 TRT - VERBOSE Plugin creator already registered - ::SpecialSlice_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::InstanceNormalization_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::InstanceNormalization_TRT version 2 TRT - VERBOSE Plugin creator already registered - ::CoordConvAC version 1 TRT - VERBOSE Plugin creator already registered - ::DecodeBbox3DPlugin version 1 TRT - VERBOSE Plugin creator already registered - ::GenerateDetection_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::MultilevelProposeROI_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::NMSDynamic_TRT version 1 TRT - VERBOSE Plugin creator already registered - ::PillarScatterPlugin version 1 TRT - VERBOSE Plugin creator already registered - ::VoxelGeneratorPlugin version 1 TRT - VERBOSE Plugin creator already registered - ::MultiscaleDeformableAttnPlugin_TRT version 1 TRT - VERBOSE Adding network input: input with dtype: float32, dimensions: (-1, -1, -1, -1) TRT - VERBOSE Registering tensor: input for ONNX tensor: input TRT - VERBOSE Importing initializer: 35 TRT - VERBOSE Importing initializer: 38 TRT - VERBOSE Importing initializer: 1171 TRT - VERBOSE Importing initializer: 1172 TRT - VERBOSE Importing initializer: descriptor_map.layer_01.3.weight TRT - VERBOSE Importing initializer: 46 TRT - VERBOSE Importing initializer: 47 TRT - VERBOSE Importing initializer: descriptor_map.layer_23.0.running_mean TRT - VERBOSE Importing initializer: descriptor_map.layer_23.0.running_var TRT - VERBOSE Importing initializer: 1174 TRT - VERBOSE Importing initializer: 1175 TRT - VERBOSE Importing initializer: descriptor_map.layer_23.5.weight TRT - VERBOSE Importing initializer: 56 TRT - VERBOSE Importing initializer: 57 TRT - VERBOSE Importing initializer: descriptor_map.layer_45.0.running_mean TRT - VERBOSE Importing initializer: descriptor_map.layer_45.0.running_var TRT - VERBOSE Importing initializer: 1177 TRT - VERBOSE Importing initializer: 1178 TRT - VERBOSE Importing initializer: 1180 TRT - VERBOSE Importing initializer: 1181 TRT - VERBOSE Importing initializer: 1183 TRT - VERBOSE Importing initializer: 1184 TRT - VERBOSE Importing initializer: 1186 TRT - VERBOSE Importing initializer: 1187 TRT - VERBOSE Importing initializer: descriptor_map.layer_678.6.weight TRT - VERBOSE Importing initializer: 82 TRT - VERBOSE Importing initializer: 85 TRT - VERBOSE Importing initializer: 89 TRT - VERBOSE Importing initializer: 91 TRT - VERBOSE Importing initializer: 1188 TRT - VERBOSE Importing initializer: 95 TRT - VERBOSE Importing initializer: 98 TRT - VERBOSE Importing initializer: 104 TRT - VERBOSE Importing initializer: 107 TRT - VERBOSE Importing initializer: 102 TRT - VERBOSE Importing initializer: 111 TRT - VERBOSE Importing initializer: 115 TRT - VERBOSE Importing initializer: 117 TRT - VERBOSE Importing initializer: 1189 TRT - VERBOSE Importing initializer: 142 TRT - VERBOSE Importing initializer: 144 TRT - VERBOSE Importing initializer: 146 TRT - VERBOSE Importing initializer: 150 TRT - VERBOSE Importing initializer: 152 TRT - VERBOSE Importing initializer: 149 TRT - VERBOSE Importing initializer: 163 TRT - VERBOSE Importing initializer: 165 TRT - VERBOSE Importing initializer: 170 TRT - VERBOSE Importing initializer: 171 TRT - VERBOSE Importing initializer: 169 TRT - VERBOSE Importing initializer: 178 TRT - VERBOSE Importing initializer: 181 TRT - VERBOSE Importing initializer: 184 TRT - VERBOSE Importing initializer: 190 TRT - VERBOSE Importing initializer: 193 TRT - VERBOSE Importing initializer: 188 TRT - VERBOSE Importing initializer: 197 TRT - VERBOSE Importing initializer: 201 TRT - VERBOSE Importing initializer: 203 TRT - VERBOSE Importing initializer: 1195 TRT - VERBOSE Importing initializer: 228 TRT - VERBOSE Importing initializer: 231 TRT - VERBOSE Importing initializer: 235 TRT - VERBOSE Importing initializer: 237 TRT - VERBOSE Importing initializer: 234 TRT - VERBOSE Importing initializer: 248 TRT - VERBOSE Importing initializer: 250 TRT - VERBOSE Importing initializer: 255 TRT - VERBOSE Importing initializer: 256 TRT - VERBOSE Importing initializer: 254 TRT - VERBOSE Importing initializer: 263 TRT - VERBOSE Importing initializer: 266 TRT - VERBOSE Importing initializer: 269 TRT - VERBOSE Importing initializer: 275 TRT - VERBOSE Importing initializer: 278 TRT - VERBOSE Importing initializer: 273 TRT - VERBOSE Importing initializer: 282 TRT - VERBOSE Importing initializer: 286 TRT - VERBOSE Importing initializer: 288 TRT - VERBOSE Importing initializer: 1201 TRT - VERBOSE Importing initializer: 313 TRT - VERBOSE Importing initializer: 316 TRT - VERBOSE Importing initializer: 320 TRT - VERBOSE Importing initializer: 322 TRT - VERBOSE Importing initializer: 319 TRT - VERBOSE Importing initializer: 333 TRT - VERBOSE Importing initializer: 335 TRT - VERBOSE Importing initializer: 340 TRT - VERBOSE Importing initializer: 341 TRT - VERBOSE Importing initializer: 339 TRT - VERBOSE Importing initializer: 348 TRT - VERBOSE Importing initializer: 352 TRT - VERBOSE Importing initializer: 355 TRT - VERBOSE Importing initializer: 357 TRT - VERBOSE Importing initializer: 365 TRT - VERBOSE Importing initializer: 367 TRT - VERBOSE Importing initializer: 375 TRT - VERBOSE Importing initializer: 377 TRT - VERBOSE Importing initializer: 1207 TRT - VERBOSE Importing initializer: 1208 TRT - VERBOSE Importing initializer: 403 TRT - VERBOSE Importing initializer: 404 TRT - VERBOSE Importing initializer: 432 TRT - VERBOSE Importing initializer: 433 TRT - VERBOSE Importing initializer: 435 TRT - VERBOSE Importing initializer: 437 TRT - VERBOSE Importing initializer: 439 TRT - VERBOSE Importing initializer: 445 TRT - VERBOSE Importing initializer: 448 TRT - VERBOSE Importing initializer: 450 TRT - VERBOSE Importing initializer: 461 TRT - VERBOSE Importing initializer: 464 TRT - VERBOSE Importing initializer: 467 TRT - VERBOSE Importing initializer: 470 TRT - VERBOSE Importing initializer: 473 TRT - VERBOSE Importing initializer: 1219 TRT - VERBOSE Importing initializer: 483 TRT - VERBOSE Importing initializer: 486 TRT - VERBOSE Importing initializer: 1220 TRT - VERBOSE Importing initializer: 495 TRT - VERBOSE Importing initializer: 500 TRT - VERBOSE Importing initializer: 505 TRT - VERBOSE Importing initializer: 508 TRT - VERBOSE Importing initializer: 509 TRT - VERBOSE Importing initializer: 512 TRT - VERBOSE Importing initializer: 514 TRT - VERBOSE Importing initializer: 520 TRT - VERBOSE Importing initializer: 518 TRT - VERBOSE Importing initializer: 524 TRT - VERBOSE Importing initializer: 529 TRT - VERBOSE Importing initializer: 527 TRT - VERBOSE Importing initializer: 511 TRT - VERBOSE Importing initializer: 533 TRT - VERBOSE Importing initializer: 540 TRT - VERBOSE Importing initializer: 546 TRT - VERBOSE Importing initializer: 551 TRT - VERBOSE Importing initializer: 556 TRT - VERBOSE Importing initializer: 559 TRT - VERBOSE Importing initializer: 560 TRT - VERBOSE Importing initializer: 563 TRT - VERBOSE Importing initializer: 565 TRT - VERBOSE Importing initializer: 571 TRT - VERBOSE Importing initializer: 569 TRT - VERBOSE Importing initializer: 575 TRT - VERBOSE Importing initializer: 580 TRT - VERBOSE Importing initializer: 578 TRT - VERBOSE Importing initializer: 562 TRT - VERBOSE Importing initializer: 584 TRT - VERBOSE Importing initializer: 591 TRT - VERBOSE Importing initializer: 598 TRT - VERBOSE Importing initializer: 602 TRT - VERBOSE Importing initializer: 603 TRT - VERBOSE Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 TRT - WARNING onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped TRT - VERBOSE Importing initializer: 601 TRT - VERBOSE Importing initializer: 608 TRT - VERBOSE Importing initializer: 596 TRT - VERBOSE Importing initializer: 1221 TRT - VERBOSE Importing initializer: 621 TRT - VERBOSE Importing initializer: 624 TRT - VERBOSE Importing initializer: 1222 TRT - VERBOSE Importing initializer: 633 TRT - VERBOSE Importing initializer: 638 TRT - VERBOSE Importing initializer: 643 TRT - VERBOSE Importing initializer: 646 TRT - VERBOSE Importing initializer: 647 TRT - VERBOSE Importing initializer: 650 TRT - VERBOSE Importing initializer: 652 TRT - VERBOSE Importing initializer: 658 TRT - VERBOSE Importing initializer: 656 TRT - VERBOSE Importing initializer: 662 TRT - VERBOSE Importing initializer: 667 TRT - VERBOSE Importing initializer: 665 TRT - VERBOSE Importing initializer: 649 TRT - VERBOSE Importing initializer: 671 TRT - VERBOSE Importing initializer: 678 TRT - VERBOSE Importing initializer: 684 TRT - VERBOSE Importing initializer: 689 TRT - VERBOSE Importing initializer: 694 TRT - VERBOSE Importing initializer: 697 TRT - VERBOSE Importing initializer: 698 TRT - VERBOSE Importing initializer: 701 TRT - VERBOSE Importing initializer: 703 TRT - VERBOSE Importing initializer: 709 TRT - VERBOSE Importing initializer: 707 TRT - VERBOSE Importing initializer: 713 TRT - VERBOSE Importing initializer: 718 TRT - VERBOSE Importing initializer: 716 TRT - VERBOSE Importing initializer: 700 TRT - VERBOSE Importing initializer: 722 TRT - VERBOSE Importing initializer: 729 TRT - VERBOSE Importing initializer: 736 TRT - VERBOSE Importing initializer: 740 TRT - VERBOSE Importing initializer: 741 TRT - VERBOSE Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 TRT - WARNING onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped TRT - VERBOSE Importing initializer: 739 TRT - VERBOSE Importing initializer: 746 TRT - VERBOSE Importing initializer: 734 TRT - VERBOSE Importing initializer: 1223 TRT - VERBOSE Importing initializer: 761 TRT - VERBOSE Importing initializer: 764 TRT - VERBOSE Importing initializer: 1224 TRT - VERBOSE Importing initializer: 773 TRT - VERBOSE Importing initializer: 778 TRT - VERBOSE Importing initializer: 783 TRT - VERBOSE Importing initializer: 786 TRT - VERBOSE Importing initializer: 787 TRT - VERBOSE Importing initializer: 790 TRT - VERBOSE Importing initializer: 792 TRT - VERBOSE Importing initializer: 798 TRT - VERBOSE Importing initializer: 796 TRT - VERBOSE Importing initializer: 802 TRT - VERBOSE Importing initializer: 807 TRT - VERBOSE Importing initializer: 805 TRT - VERBOSE Importing initializer: 789 TRT - VERBOSE Importing initializer: 811 TRT - VERBOSE Importing initializer: 818 TRT - VERBOSE Importing initializer: 824 TRT - VERBOSE Importing initializer: 829 TRT - VERBOSE Importing initializer: 834 TRT - VERBOSE Importing initializer: 837 TRT - VERBOSE Importing initializer: 838 TRT - VERBOSE Importing initializer: 841 TRT - VERBOSE Importing initializer: 843 TRT - VERBOSE Importing initializer: 849 TRT - VERBOSE Importing initializer: 847 TRT - VERBOSE Importing initializer: 853 TRT - VERBOSE Importing initializer: 858 TRT - VERBOSE Importing initializer: 856 TRT - VERBOSE Importing initializer: 840 TRT - VERBOSE Importing initializer: 862 TRT - VERBOSE Importing initializer: 869 TRT - VERBOSE Importing initializer: 877 TRT - VERBOSE Importing initializer: 878 TRT - VERBOSE Importing initializer: 876 TRT - VERBOSE Importing initializer: 879 TRT - VERBOSE Importing initializer: 882 TRT - VERBOSE Importing initializer: 883 TRT - VERBOSE Importing initializer: 881 TRT - VERBOSE Importing initializer: 884 TRT - VERBOSE Importing initializer: 886 TRT - VERBOSE Importing initializer: 889 TRT - VERBOSE Importing initializer: 896 TRT - VERBOSE Importing initializer: 898 TRT - VERBOSE Importing initializer: 904 TRT - VERBOSE Importing initializer: 907 TRT - VERBOSE Importing initializer: 911 TRT - VERBOSE Importing initializer: 914 TRT - VERBOSE Importing initializer: 917 TRT - VERBOSE Importing initializer: 920 TRT - VERBOSE Importing initializer: 930 TRT - VERBOSE Importing initializer: 932 TRT - VERBOSE Importing initializer: 1225 TRT - VERBOSE Importing initializer: 1226 TRT - VERBOSE Importing initializer: 940 TRT - VERBOSE Importing initializer: 942 TRT - VERBOSE Importing initializer: 945 TRT - VERBOSE Importing initializer: 947 TRT - VERBOSE Importing initializer: 949 TRT - VERBOSE Importing initializer: 951 TRT - VERBOSE Importing initializer: 959 TRT - VERBOSE Importing initializer: 966 TRT - VERBOSE Importing initializer: 969 TRT - VERBOSE Importing initializer: 972 TRT - VERBOSE Importing initializer: 974 TRT - VERBOSE Importing initializer: 976 TRT - VERBOSE Importing initializer: 978 TRT - VERBOSE Importing initializer: 1227 TRT - VERBOSE Importing initializer: 989 TRT - VERBOSE Importing initializer: 992 TRT - VERBOSE Importing initializer: 994 TRT - VERBOSE Importing initializer: 997 TRT - VERBOSE Importing initializer: 999 TRT - VERBOSE Importing initializer: 1003 TRT - VERBOSE Importing initializer: 1006 TRT - VERBOSE Importing initializer: 1008 TRT - VERBOSE Importing initializer: 1014 TRT - VERBOSE Importing initializer: 1228 TRT - VERBOSE Importing initializer: 1022 TRT - VERBOSE Importing initializer: 1229 TRT - VERBOSE Importing initializer: 1030 TRT - VERBOSE Importing initializer: 1230 TRT - VERBOSE Importing initializer: 1038 TRT - VERBOSE Importing initializer: 1231 TRT - VERBOSE Importing initializer: 1048 TRT - VERBOSE Importing initializer: 1050 TRT - VERBOSE Importing initializer: 1053 TRT - VERBOSE Importing initializer: 1056 TRT - VERBOSE Importing initializer: 1060 TRT - VERBOSE Importing initializer: 1062 TRT - VERBOSE Importing initializer: 1064 TRT - VERBOSE Importing initializer: 1066 TRT - VERBOSE Importing initializer: 1068 TRT - VERBOSE Importing initializer: 1070 TRT - VERBOSE Importing initializer: 1072 TRT - VERBOSE Importing initializer: 1074 TRT - VERBOSE Importing initializer: 1077 TRT - VERBOSE Importing initializer: 1081 TRT - VERBOSE Importing initializer: 1089 TRT - VERBOSE Importing initializer: 1080 TRT - VERBOSE Importing initializer: 1097 TRT - VERBOSE Importing initializer: 1101 TRT - VERBOSE Importing initializer: 1109 TRT - VERBOSE Importing initializer: 1100 TRT - VERBOSE Importing initializer: 1118 TRT - VERBOSE Importing initializer: 1122 TRT - VERBOSE Importing initializer: 1130 TRT - VERBOSE Importing initializer: 1121 TRT - VERBOSE Importing initializer: 1139 TRT - VERBOSE Importing initializer: 1143 TRT - VERBOSE Importing initializer: 1151 TRT - VERBOSE Importing initializer: 1142 TRT - VERBOSE Importing initializer: 1232 TRT - VERBOSE Importing initializer: 1168 TRT - VERBOSE Parsing node: Shape_0 [Shape] TRT - VERBOSE Searching for input: input TRT - VERBOSE Shape_0 [Shape] inputs: [input -> (-1, -1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_0 for ONNX node: Shape_0 TRT - VERBOSE Registering tensor: 34 for ONNX tensor: 34 TRT - VERBOSE Shape_0 [Shape] outputs: [34 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_2 [Gather] TRT - VERBOSE Searching for input: 34 TRT - VERBOSE Searching for input: 35 TRT - VERBOSE Gather_2 [Gather] inputs: [34 -> (4)[INT32]], [35 -> ()[INT32]], TRT - VERBOSE Registering layer: 35 for ONNX node: 35 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_2 for ONNX node: Gather_2 TRT - VERBOSE Registering tensor: 36 for ONNX tensor: 36 TRT - VERBOSE Gather_2 [Gather] outputs: [36 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_3 [Shape] TRT - VERBOSE Searching for input: input TRT - VERBOSE Shape_3 [Shape] inputs: [input -> (-1, -1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_3 for ONNX node: Shape_3 TRT - VERBOSE Registering tensor: 37 for ONNX tensor: 37 TRT - VERBOSE Shape_3 [Shape] outputs: [37 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_5 [Gather] TRT - VERBOSE Searching for input: 37 TRT - VERBOSE Searching for input: 38 TRT - VERBOSE Gather_5 [Gather] inputs: [37 -> (4)[INT32]], [38 -> ()[INT32]], TRT - VERBOSE Registering layer: 38 for ONNX node: 38 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_5 for ONNX node: Gather_5 TRT - VERBOSE Registering tensor: 39 for ONNX tensor: 39 TRT - VERBOSE Gather_5 [Gather] outputs: [39 -> ()[INT32]], TRT - VERBOSE Parsing node: Conv_6 [Conv] TRT - VERBOSE Searching for input: input TRT - VERBOSE Searching for input: 1171 TRT - VERBOSE Searching for input: 1172 TRT - VERBOSE Conv_6 [Conv] inputs: [input -> (-1, -1, -1, -1)[FLOAT]], [1171 -> (32, 3, 3, 3)[FLOAT]], [1172 -> (32)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, -1, -1, -1) TRT - VERBOSE Registering layer: Conv_6 for ONNX node: Conv_6 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 TRT - VERBOSE Convolution output dimensions: (-1, 32, -1, -1) TRT - VERBOSE Registering tensor: 1170 for ONNX tensor: 1170 TRT - VERBOSE Conv_6 [Conv] outputs: [1170 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Relu_7 [Relu] TRT - VERBOSE Searching for input: 1170 TRT - VERBOSE Relu_7 [Relu] inputs: [1170 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Relu_7 for ONNX node: Relu_7 TRT - VERBOSE Registering tensor: 44 for ONNX tensor: 44 TRT - VERBOSE Relu_7 [Relu] outputs: [44 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_8 [Conv] TRT - VERBOSE Searching for input: 44 TRT - VERBOSE Searching for input: descriptor_map.layer_01.3.weight TRT - VERBOSE Conv_8 [Conv] inputs: [44 -> (-1, 32, -1, -1)[FLOAT]], [descriptor_map.layer_01.3.weight -> (32, 32, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 32, -1, -1) TRT - VERBOSE Registering layer: Conv_8 for ONNX node: Conv_8 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 TRT - VERBOSE Convolution output dimensions: (-1, 32, -1, -1) TRT - VERBOSE Registering tensor: 45 for ONNX tensor: 45 TRT - VERBOSE Conv_8 [Conv] outputs: [45 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: BatchNormalization_11 [BatchNormalization] TRT - VERBOSE Searching for input: 45 TRT - VERBOSE Searching for input: 46 TRT - VERBOSE Searching for input: 47 TRT - VERBOSE Searching for input: descriptor_map.layer_23.0.running_mean TRT - VERBOSE Searching for input: descriptor_map.layer_23.0.running_var TRT - VERBOSE BatchNormalization_11 [BatchNormalization] inputs: [45 -> (-1, 32, -1, -1)[FLOAT]], [46 -> (32)[FLOAT]], [47 -> (32)[FLOAT]], [descriptor_map.layer_23.0.running_mean -> (32)[FLOAT]], [descriptor_map.layer_23.0.running_var -> (32)[FLOAT]], TRT - VERBOSE Registering layer: BatchNormalization_11 for ONNX node: BatchNormalization_11 TRT - VERBOSE Registering tensor: 48 for ONNX tensor: 48 TRT - VERBOSE BatchNormalization_11 [BatchNormalization] outputs: [48 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Relu_12 [Relu] TRT - VERBOSE Searching for input: 48 TRT - VERBOSE Relu_12 [Relu] inputs: [48 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Relu_12 for ONNX node: Relu_12 TRT - VERBOSE Registering tensor: 49 for ONNX tensor: 49 TRT - VERBOSE Relu_12 [Relu] outputs: [49 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_13 [Conv] TRT - VERBOSE Searching for input: 49 TRT - VERBOSE Searching for input: 1174 TRT - VERBOSE Searching for input: 1175 TRT - VERBOSE Conv_13 [Conv] inputs: [49 -> (-1, 32, -1, -1)[FLOAT]], [1174 -> (64, 32, 3, 3)[FLOAT]], [1175 -> (64)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 32, -1, -1) TRT - VERBOSE Registering layer: Conv_13 for ONNX node: Conv_13 TRT - VERBOSE Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 TRT - VERBOSE Convolution output dimensions: (-1, 64, -1, -1) TRT - VERBOSE Registering tensor: 1173 for ONNX tensor: 1173 TRT - VERBOSE Conv_13 [Conv] outputs: [1173 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Relu_14 [Relu] TRT - VERBOSE Searching for input: 1173 TRT - VERBOSE Relu_14 [Relu] inputs: [1173 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Relu_14 for ONNX node: Relu_14 TRT - VERBOSE Registering tensor: 54 for ONNX tensor: 54 TRT - VERBOSE Relu_14 [Relu] outputs: [54 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_15 [Conv] TRT - VERBOSE Searching for input: 54 TRT - VERBOSE Searching for input: descriptor_map.layer_23.5.weight TRT - VERBOSE Conv_15 [Conv] inputs: [54 -> (-1, 64, -1, -1)[FLOAT]], [descriptor_map.layer_23.5.weight -> (64, 64, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 64, -1, -1) TRT - VERBOSE Registering layer: Conv_15 for ONNX node: Conv_15 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 TRT - VERBOSE Convolution output dimensions: (-1, 64, -1, -1) TRT - VERBOSE Registering tensor: 55 for ONNX tensor: 55 TRT - VERBOSE Conv_15 [Conv] outputs: [55 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: BatchNormalization_18 [BatchNormalization] TRT - VERBOSE Searching for input: 55 TRT - VERBOSE Searching for input: 56 TRT - VERBOSE Searching for input: 57 TRT - VERBOSE Searching for input: descriptor_map.layer_45.0.running_mean TRT - VERBOSE Searching for input: descriptor_map.layer_45.0.running_var TRT - VERBOSE BatchNormalization_18 [BatchNormalization] inputs: [55 -> (-1, 64, -1, -1)[FLOAT]], [56 -> (64)[FLOAT]], [57 -> (64)[FLOAT]], [descriptor_map.layer_45.0.running_mean -> (64)[FLOAT]], [descriptor_map.layer_45.0.running_var -> (64)[FLOAT]], TRT - VERBOSE Registering layer: BatchNormalization_18 for ONNX node: BatchNormalization_18 TRT - VERBOSE Registering tensor: 58 for ONNX tensor: 58 TRT - VERBOSE BatchNormalization_18 [BatchNormalization] outputs: [58 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Relu_19 [Relu] TRT - VERBOSE Searching for input: 58 TRT - VERBOSE Relu_19 [Relu] inputs: [58 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Relu_19 for ONNX node: Relu_19 TRT - VERBOSE Registering tensor: 59 for ONNX tensor: 59 TRT - VERBOSE Relu_19 [Relu] outputs: [59 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_20 [Conv] TRT - VERBOSE Searching for input: 59 TRT - VERBOSE Searching for input: 1177 TRT - VERBOSE Searching for input: 1178 TRT - VERBOSE Conv_20 [Conv] inputs: [59 -> (-1, 64, -1, -1)[FLOAT]], [1177 -> (128, 64, 3, 3)[FLOAT]], [1178 -> (128)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 64, -1, -1) TRT - VERBOSE Registering layer: Conv_20 for ONNX node: Conv_20 TRT - VERBOSE Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 TRT - VERBOSE Convolution output dimensions: (-1, 128, -1, -1) TRT - VERBOSE Registering tensor: 1176 for ONNX tensor: 1176 TRT - VERBOSE Conv_20 [Conv] outputs: [1176 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Relu_21 [Relu] TRT - VERBOSE Searching for input: 1176 TRT - VERBOSE Relu_21 [Relu] inputs: [1176 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Relu_21 for ONNX node: Relu_21 TRT - VERBOSE Registering tensor: 64 for ONNX tensor: 64 TRT - VERBOSE Relu_21 [Relu] outputs: [64 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_22 [Conv] TRT - VERBOSE Searching for input: 64 TRT - VERBOSE Searching for input: 1180 TRT - VERBOSE Searching for input: 1181 TRT - VERBOSE Conv_22 [Conv] inputs: [64 -> (-1, 128, -1, -1)[FLOAT]], [1180 -> (128, 128, 3, 3)[FLOAT]], [1181 -> (128)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 128, -1, -1) TRT - VERBOSE Registering layer: Conv_22 for ONNX node: Conv_22 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 TRT - VERBOSE Convolution output dimensions: (-1, 128, -1, -1) TRT - VERBOSE Registering tensor: 1179 for ONNX tensor: 1179 TRT - VERBOSE Conv_22 [Conv] outputs: [1179 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Relu_23 [Relu] TRT - VERBOSE Searching for input: 1179 TRT - VERBOSE Relu_23 [Relu] inputs: [1179 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Relu_23 for ONNX node: Relu_23 TRT - VERBOSE Registering tensor: 69 for ONNX tensor: 69 TRT - VERBOSE Relu_23 [Relu] outputs: [69 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_24 [Conv] TRT - VERBOSE Searching for input: 69 TRT - VERBOSE Searching for input: 1183 TRT - VERBOSE Searching for input: 1184 TRT - VERBOSE Conv_24 [Conv] inputs: [69 -> (-1, 128, -1, -1)[FLOAT]], [1183 -> (128, 128, 3, 3)[FLOAT]], [1184 -> (128)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 128, -1, -1) TRT - VERBOSE Registering layer: Conv_24 for ONNX node: Conv_24 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 TRT - VERBOSE Convolution output dimensions: (-1, 128, -1, -1) TRT - VERBOSE Registering tensor: 1182 for ONNX tensor: 1182 TRT - VERBOSE Conv_24 [Conv] outputs: [1182 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Relu_25 [Relu] TRT - VERBOSE Searching for input: 1182 TRT - VERBOSE Relu_25 [Relu] inputs: [1182 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Relu_25 for ONNX node: Relu_25 TRT - VERBOSE Registering tensor: 74 for ONNX tensor: 74 TRT - VERBOSE Relu_25 [Relu] outputs: [74 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_26 [Conv] TRT - VERBOSE Searching for input: 74 TRT - VERBOSE Searching for input: 1186 TRT - VERBOSE Searching for input: 1187 TRT - VERBOSE Conv_26 [Conv] inputs: [74 -> (-1, 128, -1, -1)[FLOAT]], [1186 -> (128, 128, 3, 3)[FLOAT]], [1187 -> (128)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 128, -1, -1) TRT - VERBOSE Registering layer: Conv_26 for ONNX node: Conv_26 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 TRT - VERBOSE Convolution output dimensions: (-1, 128, -1, -1) TRT - VERBOSE Registering tensor: 1185 for ONNX tensor: 1185 TRT - VERBOSE Conv_26 [Conv] outputs: [1185 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Relu_27 [Relu] TRT - VERBOSE Searching for input: 1185 TRT - VERBOSE Relu_27 [Relu] inputs: [1185 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Relu_27 for ONNX node: Relu_27 TRT - VERBOSE Registering tensor: 79 for ONNX tensor: 79 TRT - VERBOSE Relu_27 [Relu] outputs: [79 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_28 [Conv] TRT - VERBOSE Searching for input: 79 TRT - VERBOSE Searching for input: descriptor_map.layer_678.6.weight TRT - VERBOSE Conv_28 [Conv] inputs: [79 -> (-1, 128, -1, -1)[FLOAT]], [descriptor_map.layer_678.6.weight -> (128, 128, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 128, -1, -1) TRT - VERBOSE Registering layer: Conv_28 for ONNX node: Conv_28 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 TRT - VERBOSE Convolution output dimensions: (-1, 128, -1, -1) TRT - VERBOSE Registering tensor: 80 for ONNX tensor: 80 TRT - VERBOSE Conv_28 [Conv] outputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_29 [Shape] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Shape_29 [Shape] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_29 for ONNX node: Shape_29 TRT - VERBOSE Registering tensor: 81 for ONNX tensor: 81 TRT - VERBOSE Shape_29 [Shape] outputs: [81 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_31 [Gather] TRT - VERBOSE Searching for input: 81 TRT - VERBOSE Searching for input: 82 TRT - VERBOSE Gather_31 [Gather] inputs: [81 -> (4)[INT32]], [82 -> ()[INT32]], TRT - VERBOSE Registering layer: 82 for ONNX node: 82 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_31 for ONNX node: Gather_31 TRT - VERBOSE Registering tensor: 83 for ONNX tensor: 83 TRT - VERBOSE Gather_31 [Gather] outputs: [83 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_33 [Unsqueeze] TRT - VERBOSE Searching for input: 83 TRT - VERBOSE Searching for input: 85 TRT - VERBOSE Unsqueeze_33 [Unsqueeze] inputs: [83 -> ()[INT32]], [85 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_33 for ONNX node: Unsqueeze_33 TRT - VERBOSE Registering tensor: 86 for ONNX tensor: 86 TRT - VERBOSE Unsqueeze_33 [Unsqueeze] outputs: [86 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_35 [Unsqueeze] TRT - VERBOSE Searching for input: 36 TRT - VERBOSE Searching for input: 89 TRT - VERBOSE Unsqueeze_35 [Unsqueeze] inputs: [36 -> ()[INT32]], [89 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_35 for ONNX node: Unsqueeze_35 TRT - VERBOSE Registering tensor: 90 for ONNX tensor: 90 TRT - VERBOSE Unsqueeze_35 [Unsqueeze] outputs: [90 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_37 [Unsqueeze] TRT - VERBOSE Searching for input: 39 TRT - VERBOSE Searching for input: 91 TRT - VERBOSE Unsqueeze_37 [Unsqueeze] inputs: [39 -> ()[INT32]], [91 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_37 for ONNX node: Unsqueeze_37 TRT - VERBOSE Registering tensor: 92 for ONNX tensor: 92 TRT - VERBOSE Unsqueeze_37 [Unsqueeze] outputs: [92 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_38 [Concat] TRT - VERBOSE Searching for input: 86 TRT - VERBOSE Searching for input: 1188 TRT - VERBOSE Searching for input: 90 TRT - VERBOSE Searching for input: 92 TRT - VERBOSE Concat_38 [Concat] inputs: [86 -> (1)[INT32]], [1188 -> (1)[INT32]], [90 -> (1)[INT32]], [92 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1188 for ONNX node: 1188 TRT - VERBOSE Registering layer: Concat_38 for ONNX node: Concat_38 TRT - VERBOSE Registering tensor: 93 for ONNX tensor: 93 TRT - VERBOSE Concat_38 [Concat] outputs: [93 -> (4)[INT32]], TRT - VERBOSE Parsing node: ConstantOfShape_39 [ConstantOfShape] TRT - VERBOSE Searching for input: 93 TRT - VERBOSE ConstantOfShape_39 [ConstantOfShape] inputs: [93 -> (4)[INT32]], TRT - VERBOSE Registering layer: ConstantOfShape_39 for ONNX node: ConstantOfShape_39 TRT - VERBOSE Registering tensor: 94 for ONNX tensor: 94 TRT - VERBOSE ConstantOfShape_39 [ConstantOfShape] outputs: [94 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Div_41 [Div] TRT - VERBOSE Searching for input: 45 TRT - VERBOSE Searching for input: 95 TRT - VERBOSE Div_41 [Div] inputs: [45 -> (-1, 32, -1, -1)[FLOAT]], [95 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 95 for ONNX node: 95 TRT - VERBOSE Registering layer: Div_41 for ONNX node: Div_41 TRT - VERBOSE Registering tensor: 96 for ONNX tensor: 96 TRT - VERBOSE Div_41 [Div] outputs: [96 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_42 [Shape] TRT - VERBOSE Searching for input: 96 TRT - VERBOSE Shape_42 [Shape] inputs: [96 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_42 for ONNX node: Shape_42 TRT - VERBOSE Registering tensor: 97 for ONNX tensor: 97 TRT - VERBOSE Shape_42 [Shape] outputs: [97 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_44 [Gather] TRT - VERBOSE Searching for input: 97 TRT - VERBOSE Searching for input: 98 TRT - VERBOSE Gather_44 [Gather] inputs: [97 -> (4)[INT32]], [98 -> ()[INT32]], TRT - VERBOSE Registering layer: 98 for ONNX node: 98 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_44 for ONNX node: Gather_44 TRT - VERBOSE Registering tensor: 99 for ONNX tensor: 99 TRT - VERBOSE Gather_44 [Gather] outputs: [99 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_48 [Shape] TRT - VERBOSE Searching for input: 96 TRT - VERBOSE Shape_48 [Shape] inputs: [96 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_48 for ONNX node: Shape_48 TRT - VERBOSE Registering tensor: 103 for ONNX tensor: 103 TRT - VERBOSE Shape_48 [Shape] outputs: [103 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_50 [Gather] TRT - VERBOSE Searching for input: 103 TRT - VERBOSE Searching for input: 104 TRT - VERBOSE Gather_50 [Gather] inputs: [103 -> (4)[INT32]], [104 -> ()[INT32]], TRT - VERBOSE Registering layer: 104 for ONNX node: 104 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_50 for ONNX node: Gather_50 TRT - VERBOSE Registering tensor: 105 for ONNX tensor: 105 TRT - VERBOSE Gather_50 [Gather] outputs: [105 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_51 [Shape] TRT - VERBOSE Searching for input: 96 TRT - VERBOSE Shape_51 [Shape] inputs: [96 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_51 for ONNX node: Shape_51 TRT - VERBOSE Registering tensor: 106 for ONNX tensor: 106 TRT - VERBOSE Shape_51 [Shape] outputs: [106 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_53 [Gather] TRT - VERBOSE Searching for input: 106 TRT - VERBOSE Searching for input: 107 TRT - VERBOSE Gather_53 [Gather] inputs: [106 -> (4)[INT32]], [107 -> ()[INT32]], TRT - VERBOSE Registering layer: 107 for ONNX node: 107 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_53 for ONNX node: Gather_53 TRT - VERBOSE Registering tensor: 108 for ONNX tensor: 108 TRT - VERBOSE Gather_53 [Gather] outputs: [108 -> ()[INT32]], TRT - VERBOSE Parsing node: Mul_54 [Mul] TRT - VERBOSE Searching for input: 99 TRT - VERBOSE Searching for input: 102 TRT - VERBOSE Mul_54 [Mul] inputs: [99 -> ()[INT32]], [102 -> ()[INT32]], TRT - VERBOSE Registering layer: 102 for ONNX node: 102 TRT - VERBOSE Registering layer: Mul_54 for ONNX node: Mul_54 TRT - VERBOSE Registering tensor: 109 for ONNX tensor: 109 TRT - VERBOSE Mul_54 [Mul] outputs: [109 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_56 [Unsqueeze] TRT - VERBOSE Searching for input: 109 TRT - VERBOSE Searching for input: 111 TRT - VERBOSE Unsqueeze_56 [Unsqueeze] inputs: [109 -> ()[INT32]], [111 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_56 for ONNX node: Unsqueeze_56 TRT - VERBOSE Registering tensor: 112 for ONNX tensor: 112 TRT - VERBOSE Unsqueeze_56 [Unsqueeze] outputs: [112 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_58 [Unsqueeze] TRT - VERBOSE Searching for input: 105 TRT - VERBOSE Searching for input: 115 TRT - VERBOSE Unsqueeze_58 [Unsqueeze] inputs: [105 -> ()[INT32]], [115 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_58 for ONNX node: Unsqueeze_58 TRT - VERBOSE Registering tensor: 116 for ONNX tensor: 116 TRT - VERBOSE Unsqueeze_58 [Unsqueeze] outputs: [116 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_60 [Unsqueeze] TRT - VERBOSE Searching for input: 108 TRT - VERBOSE Searching for input: 117 TRT - VERBOSE Unsqueeze_60 [Unsqueeze] inputs: [108 -> ()[INT32]], [117 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_60 for ONNX node: Unsqueeze_60 TRT - VERBOSE Registering tensor: 118 for ONNX tensor: 118 TRT - VERBOSE Unsqueeze_60 [Unsqueeze] outputs: [118 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_61 [Concat] TRT - VERBOSE Searching for input: 112 TRT - VERBOSE Searching for input: 1189 TRT - VERBOSE Searching for input: 116 TRT - VERBOSE Searching for input: 118 TRT - VERBOSE Concat_61 [Concat] inputs: [112 -> (1)[INT32]], [1189 -> (1)[INT32]], [116 -> (1)[INT32]], [118 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1189 for ONNX node: 1189 TRT - VERBOSE Registering layer: Concat_61 for ONNX node: Concat_61 TRT - VERBOSE Registering tensor: 119 for ONNX tensor: 119 TRT - VERBOSE Concat_61 [Concat] outputs: [119 -> (4)[INT32]], TRT - VERBOSE Parsing node: Reshape_62 [Reshape] TRT - VERBOSE Searching for input: 96 TRT - VERBOSE Searching for input: 119 TRT - VERBOSE Reshape_62 [Reshape] inputs: [96 -> (-1, 32, -1, -1)[FLOAT]], [119 -> (4)[INT32]], TRT - VERBOSE Registering layer: Reshape_62 for ONNX node: Reshape_62 TRT - VERBOSE Registering tensor: 120 for ONNX tensor: 120 TRT - VERBOSE Reshape_62 [Reshape] outputs: [120 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Pad_76 [Pad] TRT - VERBOSE Searching for input: 120 TRT - VERBOSE Searching for input: 142 TRT - VERBOSE Pad_76 [Pad] inputs: [120 -> (-1, 1, -1, -1)[FLOAT]], [142 -> (8)[INT32]], TRT - VERBOSE Registering layer: Pad_76 for ONNX node: Pad_76 TRT - VERBOSE Registering tensor: 143 for ONNX tensor: 143 TRT - VERBOSE Pad_76 [Pad] outputs: [143 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_78 [Conv] TRT - VERBOSE Searching for input: 143 TRT - VERBOSE Searching for input: 144 TRT - VERBOSE Conv_78 [Conv] inputs: [143 -> (-1, 1, -1, -1)[FLOAT]], [144 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_78 for ONNX node: Conv_78 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (3, 3), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 145 for ONNX tensor: 145 TRT - VERBOSE Conv_78 [Conv] outputs: [145 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_80 [Unsqueeze] TRT - VERBOSE Searching for input: 99 TRT - VERBOSE Searching for input: 146 TRT - VERBOSE Unsqueeze_80 [Unsqueeze] inputs: [99 -> ()[INT32]], [146 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_80 for ONNX node: Unsqueeze_80 TRT - VERBOSE Registering tensor: 147 for ONNX tensor: 147 TRT - VERBOSE Unsqueeze_80 [Unsqueeze] outputs: [147 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_84 [Unsqueeze] TRT - VERBOSE Searching for input: 105 TRT - VERBOSE Searching for input: 150 TRT - VERBOSE Unsqueeze_84 [Unsqueeze] inputs: [105 -> ()[INT32]], [150 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_84 for ONNX node: Unsqueeze_84 TRT - VERBOSE Registering tensor: 151 for ONNX tensor: 151 TRT - VERBOSE Unsqueeze_84 [Unsqueeze] outputs: [151 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_86 [Unsqueeze] TRT - VERBOSE Searching for input: 108 TRT - VERBOSE Searching for input: 152 TRT - VERBOSE Unsqueeze_86 [Unsqueeze] inputs: [108 -> ()[INT32]], [152 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_86 for ONNX node: Unsqueeze_86 TRT - VERBOSE Registering tensor: 153 for ONNX tensor: 153 TRT - VERBOSE Unsqueeze_86 [Unsqueeze] outputs: [153 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_87 [Concat] TRT - VERBOSE Searching for input: 147 TRT - VERBOSE Searching for input: 149 TRT - VERBOSE Searching for input: 151 TRT - VERBOSE Searching for input: 153 TRT - VERBOSE Concat_87 [Concat] inputs: [147 -> (1)[INT32]], [149 -> (1)[INT32]], [151 -> (1)[INT32]], [153 -> (1)[INT32]], TRT - VERBOSE Registering layer: 149 for ONNX node: 149 TRT - VERBOSE Registering layer: Concat_87 for ONNX node: Concat_87 TRT - VERBOSE Registering tensor: 154 for ONNX tensor: 154 TRT - VERBOSE Concat_87 [Concat] outputs: [154 -> (4)[INT32]], TRT - VERBOSE Parsing node: Reshape_88 [Reshape] TRT - VERBOSE Searching for input: 145 TRT - VERBOSE Searching for input: 154 TRT - VERBOSE Reshape_88 [Reshape] inputs: [145 -> (-1, 1, -1, -1)[FLOAT]], [154 -> (4)[INT32]], TRT - VERBOSE Registering layer: Reshape_88 for ONNX node: Reshape_88 TRT - VERBOSE Registering tensor: 155 for ONNX tensor: 155 TRT - VERBOSE Reshape_88 [Reshape] outputs: [155 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: ReduceMean_89 [ReduceMean] TRT - VERBOSE Searching for input: 96 TRT - VERBOSE ReduceMean_89 [ReduceMean] inputs: [96 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: ReduceMean_89 for ONNX node: ReduceMean_89 TRT - VERBOSE Registering tensor: 156 for ONNX tensor: 156 TRT - VERBOSE ReduceMean_89 [ReduceMean] outputs: [156 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Sub_90 [Sub] TRT - VERBOSE Searching for input: 96 TRT - VERBOSE Searching for input: 155 TRT - VERBOSE Sub_90 [Sub] inputs: [96 -> (-1, 32, -1, -1)[FLOAT]], [155 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Sub_90 for ONNX node: Sub_90 TRT - VERBOSE Registering tensor: 157 for ONNX tensor: 157 TRT - VERBOSE Sub_90 [Sub] outputs: [157 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Softplus_91 [Softplus] TRT - VERBOSE Searching for input: 157 TRT - VERBOSE Softplus_91 [Softplus] inputs: [157 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Softplus_91 for ONNX node: Softplus_91 TRT - VERBOSE Registering tensor: 158 for ONNX tensor: 158 TRT - VERBOSE Softplus_91 [Softplus] outputs: [158 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Sub_92 [Sub] TRT - VERBOSE Searching for input: 96 TRT - VERBOSE Searching for input: 156 TRT - VERBOSE Sub_92 [Sub] inputs: [96 -> (-1, 32, -1, -1)[FLOAT]], [156 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Sub_92 for ONNX node: Sub_92 TRT - VERBOSE Registering tensor: 159 for ONNX tensor: 159 TRT - VERBOSE Sub_92 [Sub] outputs: [159 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Softplus_93 [Softplus] TRT - VERBOSE Searching for input: 159 TRT - VERBOSE Softplus_93 [Softplus] inputs: [159 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Softplus_93 for ONNX node: Softplus_93 TRT - VERBOSE Registering tensor: 160 for ONNX tensor: 160 TRT - VERBOSE Softplus_93 [Softplus] outputs: [160 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_94 [Mul] TRT - VERBOSE Searching for input: 158 TRT - VERBOSE Searching for input: 160 TRT - VERBOSE Mul_94 [Mul] inputs: [158 -> (-1, 32, -1, -1)[FLOAT]], [160 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_94 for ONNX node: Mul_94 TRT - VERBOSE Registering tensor: 161 for ONNX tensor: 161 TRT - VERBOSE Mul_94 [Mul] outputs: [161 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: ReduceMax_95 [ReduceMax] TRT - VERBOSE Searching for input: 161 TRT - VERBOSE ReduceMax_95 [ReduceMax] inputs: [161 -> (-1, 32, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: ReduceMax_95 for ONNX node: ReduceMax_95 TRT - VERBOSE Registering tensor: 162 for ONNX tensor: 162 TRT - VERBOSE ReduceMax_95 [ReduceMax] outputs: [162 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_97 [Unsqueeze] TRT - VERBOSE Searching for input: 36 TRT - VERBOSE Searching for input: 163 TRT - VERBOSE Unsqueeze_97 [Unsqueeze] inputs: [36 -> ()[INT32]], [163 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_97 for ONNX node: Unsqueeze_97 TRT - VERBOSE Registering tensor: 164 for ONNX tensor: 164 TRT - VERBOSE Unsqueeze_97 [Unsqueeze] outputs: [164 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_99 [Unsqueeze] TRT - VERBOSE Searching for input: 39 TRT - VERBOSE Searching for input: 165 TRT - VERBOSE Unsqueeze_99 [Unsqueeze] inputs: [39 -> ()[INT32]], [165 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_99 for ONNX node: Unsqueeze_99 TRT - VERBOSE Registering tensor: 166 for ONNX tensor: 166 TRT - VERBOSE Unsqueeze_99 [Unsqueeze] outputs: [166 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_100 [Concat] TRT - VERBOSE Searching for input: 164 TRT - VERBOSE Searching for input: 166 TRT - VERBOSE Concat_100 [Concat] inputs: [164 -> (1)[INT32]], [166 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_100 for ONNX node: Concat_100 TRT - VERBOSE Registering tensor: 167 for ONNX tensor: 167 TRT - VERBOSE Concat_100 [Concat] outputs: [167 -> (2)[INT32]], TRT - VERBOSE Parsing node: Shape_101 [Shape] TRT - VERBOSE Searching for input: 162 TRT - VERBOSE Shape_101 [Shape] inputs: [162 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_101 for ONNX node: Shape_101 TRT - VERBOSE Registering tensor: 168 for ONNX tensor: 168 TRT - VERBOSE Shape_101 [Shape] outputs: [168 -> (4)[INT32]], TRT - VERBOSE Parsing node: Slice_105 [Slice] TRT - VERBOSE Searching for input: 168 TRT - VERBOSE Searching for input: 170 TRT - VERBOSE Searching for input: 171 TRT - VERBOSE Searching for input: 169 TRT - VERBOSE Slice_105 [Slice] inputs: [168 -> (4)[INT32]], [170 -> (1)[INT32]], [171 -> (1)[INT32]], [169 -> (1)[INT32]], TRT - VERBOSE Registering layer: Slice_105 for ONNX node: Slice_105 TRT - VERBOSE Registering tensor: 172 for ONNX tensor: 172 TRT - VERBOSE Slice_105 [Slice] outputs: [172 -> (2)[INT32]], TRT - VERBOSE Parsing node: Cast_106 [Cast] TRT - VERBOSE Searching for input: 167 TRT - VERBOSE Cast_106 [Cast] inputs: [167 -> (2)[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_106 for ONNX node: Cast_106 TRT - VERBOSE Registering tensor: 173 for ONNX tensor: 173 TRT - VERBOSE Cast_106 [Cast] outputs: [173 -> (2)[INT32]], TRT - VERBOSE Parsing node: Concat_107 [Concat] TRT - VERBOSE Searching for input: 172 TRT - VERBOSE Searching for input: 173 TRT - VERBOSE Concat_107 [Concat] inputs: [172 -> (2)[INT32]], [173 -> (2)[INT32]], TRT - VERBOSE Registering layer: Concat_107 for ONNX node: Concat_107 TRT - VERBOSE Registering tensor: 174 for ONNX tensor: 174 TRT - VERBOSE Concat_107 [Concat] outputs: [174 -> (4)[INT32]], TRT - VERBOSE Parsing node: Resize_108 [Resize] TRT - VERBOSE Searching for input: 162 TRT - VERBOSE Searching for input: 174 TRT - VERBOSE Resize_108 [Resize] inputs: [162 -> (-1, 1, -1, -1)[FLOAT]], [optional input, not set], [optional input, not set], [174 -> (4)[INT32]], TRT - VERBOSE Registering layer: Resize_108 for ONNX node: Resize_108 TRT - VERBOSE Registering tensor: 177 for ONNX tensor: 177 TRT - VERBOSE Resize_108 [Resize] outputs: [177 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_110 [Mul] TRT - VERBOSE Searching for input: 178 TRT - VERBOSE Searching for input: 177 TRT - VERBOSE Mul_110 [Mul] inputs: [178 -> ()[FLOAT]], [177 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: 178 for ONNX node: 178 TRT - VERBOSE Registering layer: Mul_110 for ONNX node: Mul_110 TRT - VERBOSE Registering tensor: 179 for ONNX tensor: 179 TRT - VERBOSE Mul_110 [Mul] outputs: [179 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Add_111 [Add] TRT - VERBOSE Searching for input: 94 TRT - VERBOSE Searching for input: 179 TRT - VERBOSE Add_111 [Add] inputs: [94 -> (-1, 1, -1, -1)[FLOAT]], [179 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Add_111 for ONNX node: Add_111 TRT - VERBOSE Registering tensor: 180 for ONNX tensor: 180 TRT - VERBOSE Add_111 [Add] outputs: [180 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Div_113 [Div] TRT - VERBOSE Searching for input: 55 TRT - VERBOSE Searching for input: 181 TRT - VERBOSE Div_113 [Div] inputs: [55 -> (-1, 64, -1, -1)[FLOAT]], [181 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 181 for ONNX node: 181 TRT - VERBOSE Registering layer: Div_113 for ONNX node: Div_113 TRT - VERBOSE Registering tensor: 182 for ONNX tensor: 182 TRT - VERBOSE Div_113 [Div] outputs: [182 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_114 [Shape] TRT - VERBOSE Searching for input: 182 TRT - VERBOSE Shape_114 [Shape] inputs: [182 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_114 for ONNX node: Shape_114 TRT - VERBOSE Registering tensor: 183 for ONNX tensor: 183 TRT - VERBOSE Shape_114 [Shape] outputs: [183 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_116 [Gather] TRT - VERBOSE Searching for input: 183 TRT - VERBOSE Searching for input: 184 TRT - VERBOSE Gather_116 [Gather] inputs: [183 -> (4)[INT32]], [184 -> ()[INT32]], TRT - VERBOSE Registering layer: 184 for ONNX node: 184 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_116 for ONNX node: Gather_116 TRT - VERBOSE Registering tensor: 185 for ONNX tensor: 185 TRT - VERBOSE Gather_116 [Gather] outputs: [185 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_120 [Shape] TRT - VERBOSE Searching for input: 182 TRT - VERBOSE Shape_120 [Shape] inputs: [182 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_120 for ONNX node: Shape_120 TRT - VERBOSE Registering tensor: 189 for ONNX tensor: 189 TRT - VERBOSE Shape_120 [Shape] outputs: [189 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_122 [Gather] TRT - VERBOSE Searching for input: 189 TRT - VERBOSE Searching for input: 190 TRT - VERBOSE Gather_122 [Gather] inputs: [189 -> (4)[INT32]], [190 -> ()[INT32]], TRT - VERBOSE Registering layer: 190 for ONNX node: 190 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_122 for ONNX node: Gather_122 TRT - VERBOSE Registering tensor: 191 for ONNX tensor: 191 TRT - VERBOSE Gather_122 [Gather] outputs: [191 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_123 [Shape] TRT - VERBOSE Searching for input: 182 TRT - VERBOSE Shape_123 [Shape] inputs: [182 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_123 for ONNX node: Shape_123 TRT - VERBOSE Registering tensor: 192 for ONNX tensor: 192 TRT - VERBOSE Shape_123 [Shape] outputs: [192 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_125 [Gather] TRT - VERBOSE Searching for input: 192 TRT - VERBOSE Searching for input: 193 TRT - VERBOSE Gather_125 [Gather] inputs: [192 -> (4)[INT32]], [193 -> ()[INT32]], TRT - VERBOSE Registering layer: 193 for ONNX node: 193 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_125 for ONNX node: Gather_125 TRT - VERBOSE Registering tensor: 194 for ONNX tensor: 194 TRT - VERBOSE Gather_125 [Gather] outputs: [194 -> ()[INT32]], TRT - VERBOSE Parsing node: Mul_126 [Mul] TRT - VERBOSE Searching for input: 185 TRT - VERBOSE Searching for input: 188 TRT - VERBOSE Mul_126 [Mul] inputs: [185 -> ()[INT32]], [188 -> ()[INT32]], TRT - VERBOSE Registering layer: 188 for ONNX node: 188 TRT - VERBOSE Registering layer: Mul_126 for ONNX node: Mul_126 TRT - VERBOSE Registering tensor: 195 for ONNX tensor: 195 TRT - VERBOSE Mul_126 [Mul] outputs: [195 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_128 [Unsqueeze] TRT - VERBOSE Searching for input: 195 TRT - VERBOSE Searching for input: 197 TRT - VERBOSE Unsqueeze_128 [Unsqueeze] inputs: [195 -> ()[INT32]], [197 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_128 for ONNX node: Unsqueeze_128 TRT - VERBOSE Registering tensor: 198 for ONNX tensor: 198 TRT - VERBOSE Unsqueeze_128 [Unsqueeze] outputs: [198 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_130 [Unsqueeze] TRT - VERBOSE Searching for input: 191 TRT - VERBOSE Searching for input: 201 TRT - VERBOSE Unsqueeze_130 [Unsqueeze] inputs: [191 -> ()[INT32]], [201 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_130 for ONNX node: Unsqueeze_130 TRT - VERBOSE Registering tensor: 202 for ONNX tensor: 202 TRT - VERBOSE Unsqueeze_130 [Unsqueeze] outputs: [202 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_132 [Unsqueeze] TRT - VERBOSE Searching for input: 194 TRT - VERBOSE Searching for input: 203 TRT - VERBOSE Unsqueeze_132 [Unsqueeze] inputs: [194 -> ()[INT32]], [203 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_132 for ONNX node: Unsqueeze_132 TRT - VERBOSE Registering tensor: 204 for ONNX tensor: 204 TRT - VERBOSE Unsqueeze_132 [Unsqueeze] outputs: [204 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_133 [Concat] TRT - VERBOSE Searching for input: 198 TRT - VERBOSE Searching for input: 1195 TRT - VERBOSE Searching for input: 202 TRT - VERBOSE Searching for input: 204 TRT - VERBOSE Concat_133 [Concat] inputs: [198 -> (1)[INT32]], [1195 -> (1)[INT32]], [202 -> (1)[INT32]], [204 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1195 for ONNX node: 1195 TRT - VERBOSE Registering layer: Concat_133 for ONNX node: Concat_133 TRT - VERBOSE Registering tensor: 205 for ONNX tensor: 205 TRT - VERBOSE Concat_133 [Concat] outputs: [205 -> (4)[INT32]], TRT - VERBOSE Parsing node: Reshape_134 [Reshape] TRT - VERBOSE Searching for input: 182 TRT - VERBOSE Searching for input: 205 TRT - VERBOSE Reshape_134 [Reshape] inputs: [182 -> (-1, 64, -1, -1)[FLOAT]], [205 -> (4)[INT32]], TRT - VERBOSE Registering layer: Reshape_134 for ONNX node: Reshape_134 TRT - VERBOSE Registering tensor: 206 for ONNX tensor: 206 TRT - VERBOSE Reshape_134 [Reshape] outputs: [206 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Pad_148 [Pad] TRT - VERBOSE Searching for input: 206 TRT - VERBOSE Searching for input: 228 TRT - VERBOSE Pad_148 [Pad] inputs: [206 -> (-1, 1, -1, -1)[FLOAT]], [228 -> (8)[INT32]], TRT - VERBOSE Registering layer: Pad_148 for ONNX node: Pad_148 TRT - VERBOSE Registering tensor: 229 for ONNX tensor: 229 TRT - VERBOSE Pad_148 [Pad] outputs: [229 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_149 [Conv] TRT - VERBOSE Searching for input: 229 TRT - VERBOSE Searching for input: 144 TRT - VERBOSE Conv_149 [Conv] inputs: [229 -> (-1, 1, -1, -1)[FLOAT]], [144 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_149 for ONNX node: Conv_149 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (2, 2), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 230 for ONNX tensor: 230 TRT - VERBOSE Conv_149 [Conv] outputs: [230 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_151 [Unsqueeze] TRT - VERBOSE Searching for input: 185 TRT - VERBOSE Searching for input: 231 TRT - VERBOSE Unsqueeze_151 [Unsqueeze] inputs: [185 -> ()[INT32]], [231 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_151 for ONNX node: Unsqueeze_151 TRT - VERBOSE Registering tensor: 232 for ONNX tensor: 232 TRT - VERBOSE Unsqueeze_151 [Unsqueeze] outputs: [232 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_155 [Unsqueeze] TRT - VERBOSE Searching for input: 191 TRT - VERBOSE Searching for input: 235 TRT - VERBOSE Unsqueeze_155 [Unsqueeze] inputs: [191 -> ()[INT32]], [235 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_155 for ONNX node: Unsqueeze_155 TRT - VERBOSE Registering tensor: 236 for ONNX tensor: 236 TRT - VERBOSE Unsqueeze_155 [Unsqueeze] outputs: [236 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_157 [Unsqueeze] TRT - VERBOSE Searching for input: 194 TRT - VERBOSE Searching for input: 237 TRT - VERBOSE Unsqueeze_157 [Unsqueeze] inputs: [194 -> ()[INT32]], [237 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_157 for ONNX node: Unsqueeze_157 TRT - VERBOSE Registering tensor: 238 for ONNX tensor: 238 TRT - VERBOSE Unsqueeze_157 [Unsqueeze] outputs: [238 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_158 [Concat] TRT - VERBOSE Searching for input: 232 TRT - VERBOSE Searching for input: 234 TRT - VERBOSE Searching for input: 236 TRT - VERBOSE Searching for input: 238 TRT - VERBOSE Concat_158 [Concat] inputs: [232 -> (1)[INT32]], [234 -> (1)[INT32]], [236 -> (1)[INT32]], [238 -> (1)[INT32]], TRT - VERBOSE Registering layer: 234 for ONNX node: 234 TRT - VERBOSE Registering layer: Concat_158 for ONNX node: Concat_158 TRT - VERBOSE Registering tensor: 239 for ONNX tensor: 239 TRT - VERBOSE Concat_158 [Concat] outputs: [239 -> (4)[INT32]], TRT - VERBOSE Parsing node: Reshape_159 [Reshape] TRT - VERBOSE Searching for input: 230 TRT - VERBOSE Searching for input: 239 TRT - VERBOSE Reshape_159 [Reshape] inputs: [230 -> (-1, 1, -1, -1)[FLOAT]], [239 -> (4)[INT32]], TRT - VERBOSE Registering layer: Reshape_159 for ONNX node: Reshape_159 TRT - VERBOSE Registering tensor: 240 for ONNX tensor: 240 TRT - VERBOSE Reshape_159 [Reshape] outputs: [240 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: ReduceMean_160 [ReduceMean] TRT - VERBOSE Searching for input: 182 TRT - VERBOSE ReduceMean_160 [ReduceMean] inputs: [182 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: ReduceMean_160 for ONNX node: ReduceMean_160 TRT - VERBOSE Registering tensor: 241 for ONNX tensor: 241 TRT - VERBOSE ReduceMean_160 [ReduceMean] outputs: [241 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Sub_161 [Sub] TRT - VERBOSE Searching for input: 182 TRT - VERBOSE Searching for input: 240 TRT - VERBOSE Sub_161 [Sub] inputs: [182 -> (-1, 64, -1, -1)[FLOAT]], [240 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Sub_161 for ONNX node: Sub_161 TRT - VERBOSE Registering tensor: 242 for ONNX tensor: 242 TRT - VERBOSE Sub_161 [Sub] outputs: [242 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Softplus_162 [Softplus] TRT - VERBOSE Searching for input: 242 TRT - VERBOSE Softplus_162 [Softplus] inputs: [242 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Softplus_162 for ONNX node: Softplus_162 TRT - VERBOSE Registering tensor: 243 for ONNX tensor: 243 TRT - VERBOSE Softplus_162 [Softplus] outputs: [243 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Sub_163 [Sub] TRT - VERBOSE Searching for input: 182 TRT - VERBOSE Searching for input: 241 TRT - VERBOSE Sub_163 [Sub] inputs: [182 -> (-1, 64, -1, -1)[FLOAT]], [241 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Sub_163 for ONNX node: Sub_163 TRT - VERBOSE Registering tensor: 244 for ONNX tensor: 244 TRT - VERBOSE Sub_163 [Sub] outputs: [244 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Softplus_164 [Softplus] TRT - VERBOSE Searching for input: 244 TRT - VERBOSE Softplus_164 [Softplus] inputs: [244 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Softplus_164 for ONNX node: Softplus_164 TRT - VERBOSE Registering tensor: 245 for ONNX tensor: 245 TRT - VERBOSE Softplus_164 [Softplus] outputs: [245 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_165 [Mul] TRT - VERBOSE Searching for input: 243 TRT - VERBOSE Searching for input: 245 TRT - VERBOSE Mul_165 [Mul] inputs: [243 -> (-1, 64, -1, -1)[FLOAT]], [245 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_165 for ONNX node: Mul_165 TRT - VERBOSE Registering tensor: 246 for ONNX tensor: 246 TRT - VERBOSE Mul_165 [Mul] outputs: [246 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: ReduceMax_166 [ReduceMax] TRT - VERBOSE Searching for input: 246 TRT - VERBOSE ReduceMax_166 [ReduceMax] inputs: [246 -> (-1, 64, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: ReduceMax_166 for ONNX node: ReduceMax_166 TRT - VERBOSE Registering tensor: 247 for ONNX tensor: 247 TRT - VERBOSE ReduceMax_166 [ReduceMax] outputs: [247 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_168 [Unsqueeze] TRT - VERBOSE Searching for input: 36 TRT - VERBOSE Searching for input: 248 TRT - VERBOSE Unsqueeze_168 [Unsqueeze] inputs: [36 -> ()[INT32]], [248 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_168 for ONNX node: Unsqueeze_168 TRT - VERBOSE Registering tensor: 249 for ONNX tensor: 249 TRT - VERBOSE Unsqueeze_168 [Unsqueeze] outputs: [249 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_170 [Unsqueeze] TRT - VERBOSE Searching for input: 39 TRT - VERBOSE Searching for input: 250 TRT - VERBOSE Unsqueeze_170 [Unsqueeze] inputs: [39 -> ()[INT32]], [250 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_170 for ONNX node: Unsqueeze_170 TRT - VERBOSE Registering tensor: 251 for ONNX tensor: 251 TRT - VERBOSE Unsqueeze_170 [Unsqueeze] outputs: [251 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_171 [Concat] TRT - VERBOSE Searching for input: 249 TRT - VERBOSE Searching for input: 251 TRT - VERBOSE Concat_171 [Concat] inputs: [249 -> (1)[INT32]], [251 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_171 for ONNX node: Concat_171 TRT - VERBOSE Registering tensor: 252 for ONNX tensor: 252 TRT - VERBOSE Concat_171 [Concat] outputs: [252 -> (2)[INT32]], TRT - VERBOSE Parsing node: Shape_172 [Shape] TRT - VERBOSE Searching for input: 247 TRT - VERBOSE Shape_172 [Shape] inputs: [247 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_172 for ONNX node: Shape_172 TRT - VERBOSE Registering tensor: 253 for ONNX tensor: 253 TRT - VERBOSE Shape_172 [Shape] outputs: [253 -> (4)[INT32]], TRT - VERBOSE Parsing node: Slice_176 [Slice] TRT - VERBOSE Searching for input: 253 TRT - VERBOSE Searching for input: 255 TRT - VERBOSE Searching for input: 256 TRT - VERBOSE Searching for input: 254 TRT - VERBOSE Slice_176 [Slice] inputs: [253 -> (4)[INT32]], [255 -> (1)[INT32]], [256 -> (1)[INT32]], [254 -> (1)[INT32]], TRT - VERBOSE Registering layer: Slice_176 for ONNX node: Slice_176 TRT - VERBOSE Registering tensor: 257 for ONNX tensor: 257 TRT - VERBOSE Slice_176 [Slice] outputs: [257 -> (2)[INT32]], TRT - VERBOSE Parsing node: Cast_177 [Cast] TRT - VERBOSE Searching for input: 252 TRT - VERBOSE Cast_177 [Cast] inputs: [252 -> (2)[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_177 for ONNX node: Cast_177 TRT - VERBOSE Registering tensor: 258 for ONNX tensor: 258 TRT - VERBOSE Cast_177 [Cast] outputs: [258 -> (2)[INT32]], TRT - VERBOSE Parsing node: Concat_178 [Concat] TRT - VERBOSE Searching for input: 257 TRT - VERBOSE Searching for input: 258 TRT - VERBOSE Concat_178 [Concat] inputs: [257 -> (2)[INT32]], [258 -> (2)[INT32]], TRT - VERBOSE Registering layer: Concat_178 for ONNX node: Concat_178 TRT - VERBOSE Registering tensor: 259 for ONNX tensor: 259 TRT - VERBOSE Concat_178 [Concat] outputs: [259 -> (4)[INT32]], TRT - VERBOSE Parsing node: Resize_179 [Resize] TRT - VERBOSE Searching for input: 247 TRT - VERBOSE Searching for input: 259 TRT - VERBOSE Resize_179 [Resize] inputs: [247 -> (-1, 1, -1, -1)[FLOAT]], [optional input, not set], [optional input, not set], [259 -> (4)[INT32]], TRT - VERBOSE Registering layer: Resize_179 for ONNX node: Resize_179 TRT - VERBOSE Registering tensor: 262 for ONNX tensor: 262 TRT - VERBOSE Resize_179 [Resize] outputs: [262 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_181 [Mul] TRT - VERBOSE Searching for input: 263 TRT - VERBOSE Searching for input: 262 TRT - VERBOSE Mul_181 [Mul] inputs: [263 -> ()[FLOAT]], [262 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: 263 for ONNX node: 263 TRT - VERBOSE Registering layer: Mul_181 for ONNX node: Mul_181 TRT - VERBOSE Registering tensor: 264 for ONNX tensor: 264 TRT - VERBOSE Mul_181 [Mul] outputs: [264 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Add_182 [Add] TRT - VERBOSE Searching for input: 180 TRT - VERBOSE Searching for input: 264 TRT - VERBOSE Add_182 [Add] inputs: [180 -> (-1, 1, -1, -1)[FLOAT]], [264 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Add_182 for ONNX node: Add_182 TRT - VERBOSE Registering tensor: 265 for ONNX tensor: 265 TRT - VERBOSE Add_182 [Add] outputs: [265 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Div_184 [Div] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Searching for input: 266 TRT - VERBOSE Div_184 [Div] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], [266 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 266 for ONNX node: 266 TRT - VERBOSE Registering layer: Div_184 for ONNX node: Div_184 TRT - VERBOSE Registering tensor: 267 for ONNX tensor: 267 TRT - VERBOSE Div_184 [Div] outputs: [267 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_185 [Shape] TRT - VERBOSE Searching for input: 267 TRT - VERBOSE Shape_185 [Shape] inputs: [267 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_185 for ONNX node: Shape_185 TRT - VERBOSE Registering tensor: 268 for ONNX tensor: 268 TRT - VERBOSE Shape_185 [Shape] outputs: [268 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_187 [Gather] TRT - VERBOSE Searching for input: 268 TRT - VERBOSE Searching for input: 269 TRT - VERBOSE Gather_187 [Gather] inputs: [268 -> (4)[INT32]], [269 -> ()[INT32]], TRT - VERBOSE Registering layer: 269 for ONNX node: 269 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_187 for ONNX node: Gather_187 TRT - VERBOSE Registering tensor: 270 for ONNX tensor: 270 TRT - VERBOSE Gather_187 [Gather] outputs: [270 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_191 [Shape] TRT - VERBOSE Searching for input: 267 TRT - VERBOSE Shape_191 [Shape] inputs: [267 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_191 for ONNX node: Shape_191 TRT - VERBOSE Registering tensor: 274 for ONNX tensor: 274 TRT - VERBOSE Shape_191 [Shape] outputs: [274 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_193 [Gather] TRT - VERBOSE Searching for input: 274 TRT - VERBOSE Searching for input: 275 TRT - VERBOSE Gather_193 [Gather] inputs: [274 -> (4)[INT32]], [275 -> ()[INT32]], TRT - VERBOSE Registering layer: 275 for ONNX node: 275 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_193 for ONNX node: Gather_193 TRT - VERBOSE Registering tensor: 276 for ONNX tensor: 276 TRT - VERBOSE Gather_193 [Gather] outputs: [276 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_194 [Shape] TRT - VERBOSE Searching for input: 267 TRT - VERBOSE Shape_194 [Shape] inputs: [267 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_194 for ONNX node: Shape_194 TRT - VERBOSE Registering tensor: 277 for ONNX tensor: 277 TRT - VERBOSE Shape_194 [Shape] outputs: [277 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_196 [Gather] TRT - VERBOSE Searching for input: 277 TRT - VERBOSE Searching for input: 278 TRT - VERBOSE Gather_196 [Gather] inputs: [277 -> (4)[INT32]], [278 -> ()[INT32]], TRT - VERBOSE Registering layer: 278 for ONNX node: 278 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_196 for ONNX node: Gather_196 TRT - VERBOSE Registering tensor: 279 for ONNX tensor: 279 TRT - VERBOSE Gather_196 [Gather] outputs: [279 -> ()[INT32]], TRT - VERBOSE Parsing node: Mul_197 [Mul] TRT - VERBOSE Searching for input: 270 TRT - VERBOSE Searching for input: 273 TRT - VERBOSE Mul_197 [Mul] inputs: [270 -> ()[INT32]], [273 -> ()[INT32]], TRT - VERBOSE Registering layer: 273 for ONNX node: 273 TRT - VERBOSE Registering layer: Mul_197 for ONNX node: Mul_197 TRT - VERBOSE Registering tensor: 280 for ONNX tensor: 280 TRT - VERBOSE Mul_197 [Mul] outputs: [280 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_199 [Unsqueeze] TRT - VERBOSE Searching for input: 280 TRT - VERBOSE Searching for input: 282 TRT - VERBOSE Unsqueeze_199 [Unsqueeze] inputs: [280 -> ()[INT32]], [282 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_199 for ONNX node: Unsqueeze_199 TRT - VERBOSE Registering tensor: 283 for ONNX tensor: 283 TRT - VERBOSE Unsqueeze_199 [Unsqueeze] outputs: [283 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_201 [Unsqueeze] TRT - VERBOSE Searching for input: 276 TRT - VERBOSE Searching for input: 286 TRT - VERBOSE Unsqueeze_201 [Unsqueeze] inputs: [276 -> ()[INT32]], [286 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_201 for ONNX node: Unsqueeze_201 TRT - VERBOSE Registering tensor: 287 for ONNX tensor: 287 TRT - VERBOSE Unsqueeze_201 [Unsqueeze] outputs: [287 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_203 [Unsqueeze] TRT - VERBOSE Searching for input: 279 TRT - VERBOSE Searching for input: 288 TRT - VERBOSE Unsqueeze_203 [Unsqueeze] inputs: [279 -> ()[INT32]], [288 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_203 for ONNX node: Unsqueeze_203 TRT - VERBOSE Registering tensor: 289 for ONNX tensor: 289 TRT - VERBOSE Unsqueeze_203 [Unsqueeze] outputs: [289 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_204 [Concat] TRT - VERBOSE Searching for input: 283 TRT - VERBOSE Searching for input: 1201 TRT - VERBOSE Searching for input: 287 TRT - VERBOSE Searching for input: 289 TRT - VERBOSE Concat_204 [Concat] inputs: [283 -> (1)[INT32]], [1201 -> (1)[INT32]], [287 -> (1)[INT32]], [289 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1201 for ONNX node: 1201 TRT - VERBOSE Registering layer: Concat_204 for ONNX node: Concat_204 TRT - VERBOSE Registering tensor: 290 for ONNX tensor: 290 TRT - VERBOSE Concat_204 [Concat] outputs: [290 -> (4)[INT32]], TRT - VERBOSE Parsing node: Reshape_205 [Reshape] TRT - VERBOSE Searching for input: 267 TRT - VERBOSE Searching for input: 290 TRT - VERBOSE Reshape_205 [Reshape] inputs: [267 -> (-1, 128, -1, -1)[FLOAT]], [290 -> (4)[INT32]], TRT - VERBOSE Registering layer: Reshape_205 for ONNX node: Reshape_205 TRT - VERBOSE Registering tensor: 291 for ONNX tensor: 291 TRT - VERBOSE Reshape_205 [Reshape] outputs: [291 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Pad_219 [Pad] TRT - VERBOSE Searching for input: 291 TRT - VERBOSE Searching for input: 313 TRT - VERBOSE Pad_219 [Pad] inputs: [291 -> (-1, 1, -1, -1)[FLOAT]], [313 -> (8)[INT32]], TRT - VERBOSE Registering layer: Pad_219 for ONNX node: Pad_219 TRT - VERBOSE Registering tensor: 314 for ONNX tensor: 314 TRT - VERBOSE Pad_219 [Pad] outputs: [314 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_220 [Conv] TRT - VERBOSE Searching for input: 314 TRT - VERBOSE Searching for input: 144 TRT - VERBOSE Conv_220 [Conv] inputs: [314 -> (-1, 1, -1, -1)[FLOAT]], [144 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_220 for ONNX node: Conv_220 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 315 for ONNX tensor: 315 TRT - VERBOSE Conv_220 [Conv] outputs: [315 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_222 [Unsqueeze] TRT - VERBOSE Searching for input: 270 TRT - VERBOSE Searching for input: 316 TRT - VERBOSE Unsqueeze_222 [Unsqueeze] inputs: [270 -> ()[INT32]], [316 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_222 for ONNX node: Unsqueeze_222 TRT - VERBOSE Registering tensor: 317 for ONNX tensor: 317 TRT - VERBOSE Unsqueeze_222 [Unsqueeze] outputs: [317 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_226 [Unsqueeze] TRT - VERBOSE Searching for input: 276 TRT - VERBOSE Searching for input: 320 TRT - VERBOSE Unsqueeze_226 [Unsqueeze] inputs: [276 -> ()[INT32]], [320 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_226 for ONNX node: Unsqueeze_226 TRT - VERBOSE Registering tensor: 321 for ONNX tensor: 321 TRT - VERBOSE Unsqueeze_226 [Unsqueeze] outputs: [321 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_228 [Unsqueeze] TRT - VERBOSE Searching for input: 279 TRT - VERBOSE Searching for input: 322 TRT - VERBOSE Unsqueeze_228 [Unsqueeze] inputs: [279 -> ()[INT32]], [322 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_228 for ONNX node: Unsqueeze_228 TRT - VERBOSE Registering tensor: 323 for ONNX tensor: 323 TRT - VERBOSE Unsqueeze_228 [Unsqueeze] outputs: [323 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_229 [Concat] TRT - VERBOSE Searching for input: 317 TRT - VERBOSE Searching for input: 319 TRT - VERBOSE Searching for input: 321 TRT - VERBOSE Searching for input: 323 TRT - VERBOSE Concat_229 [Concat] inputs: [317 -> (1)[INT32]], [319 -> (1)[INT32]], [321 -> (1)[INT32]], [323 -> (1)[INT32]], TRT - VERBOSE Registering layer: 319 for ONNX node: 319 TRT - VERBOSE Registering layer: Concat_229 for ONNX node: Concat_229 TRT - VERBOSE Registering tensor: 324 for ONNX tensor: 324 TRT - VERBOSE Concat_229 [Concat] outputs: [324 -> (4)[INT32]], TRT - VERBOSE Parsing node: Reshape_230 [Reshape] TRT - VERBOSE Searching for input: 315 TRT - VERBOSE Searching for input: 324 TRT - VERBOSE Reshape_230 [Reshape] inputs: [315 -> (-1, 1, -1, -1)[FLOAT]], [324 -> (4)[INT32]], TRT - VERBOSE Registering layer: Reshape_230 for ONNX node: Reshape_230 TRT - VERBOSE Registering tensor: 325 for ONNX tensor: 325 TRT - VERBOSE Reshape_230 [Reshape] outputs: [325 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: ReduceMean_231 [ReduceMean] TRT - VERBOSE Searching for input: 267 TRT - VERBOSE ReduceMean_231 [ReduceMean] inputs: [267 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: ReduceMean_231 for ONNX node: ReduceMean_231 TRT - VERBOSE Registering tensor: 326 for ONNX tensor: 326 TRT - VERBOSE ReduceMean_231 [ReduceMean] outputs: [326 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Sub_232 [Sub] TRT - VERBOSE Searching for input: 267 TRT - VERBOSE Searching for input: 325 TRT - VERBOSE Sub_232 [Sub] inputs: [267 -> (-1, 128, -1, -1)[FLOAT]], [325 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Sub_232 for ONNX node: Sub_232 TRT - VERBOSE Registering tensor: 327 for ONNX tensor: 327 TRT - VERBOSE Sub_232 [Sub] outputs: [327 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Softplus_233 [Softplus] TRT - VERBOSE Searching for input: 327 TRT - VERBOSE Softplus_233 [Softplus] inputs: [327 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Softplus_233 for ONNX node: Softplus_233 TRT - VERBOSE Registering tensor: 328 for ONNX tensor: 328 TRT - VERBOSE Softplus_233 [Softplus] outputs: [328 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Sub_234 [Sub] TRT - VERBOSE Searching for input: 267 TRT - VERBOSE Searching for input: 326 TRT - VERBOSE Sub_234 [Sub] inputs: [267 -> (-1, 128, -1, -1)[FLOAT]], [326 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Sub_234 for ONNX node: Sub_234 TRT - VERBOSE Registering tensor: 329 for ONNX tensor: 329 TRT - VERBOSE Sub_234 [Sub] outputs: [329 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Softplus_235 [Softplus] TRT - VERBOSE Searching for input: 329 TRT - VERBOSE Softplus_235 [Softplus] inputs: [329 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Softplus_235 for ONNX node: Softplus_235 TRT - VERBOSE Registering tensor: 330 for ONNX tensor: 330 TRT - VERBOSE Softplus_235 [Softplus] outputs: [330 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_236 [Mul] TRT - VERBOSE Searching for input: 328 TRT - VERBOSE Searching for input: 330 TRT - VERBOSE Mul_236 [Mul] inputs: [328 -> (-1, 128, -1, -1)[FLOAT]], [330 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_236 for ONNX node: Mul_236 TRT - VERBOSE Registering tensor: 331 for ONNX tensor: 331 TRT - VERBOSE Mul_236 [Mul] outputs: [331 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: ReduceMax_237 [ReduceMax] TRT - VERBOSE Searching for input: 331 TRT - VERBOSE ReduceMax_237 [ReduceMax] inputs: [331 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: ReduceMax_237 for ONNX node: ReduceMax_237 TRT - VERBOSE Registering tensor: 332 for ONNX tensor: 332 TRT - VERBOSE ReduceMax_237 [ReduceMax] outputs: [332 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_239 [Unsqueeze] TRT - VERBOSE Searching for input: 36 TRT - VERBOSE Searching for input: 333 TRT - VERBOSE Unsqueeze_239 [Unsqueeze] inputs: [36 -> ()[INT32]], [333 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_239 for ONNX node: Unsqueeze_239 TRT - VERBOSE Registering tensor: 334 for ONNX tensor: 334 TRT - VERBOSE Unsqueeze_239 [Unsqueeze] outputs: [334 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_241 [Unsqueeze] TRT - VERBOSE Searching for input: 39 TRT - VERBOSE Searching for input: 335 TRT - VERBOSE Unsqueeze_241 [Unsqueeze] inputs: [39 -> ()[INT32]], [335 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_241 for ONNX node: Unsqueeze_241 TRT - VERBOSE Registering tensor: 336 for ONNX tensor: 336 TRT - VERBOSE Unsqueeze_241 [Unsqueeze] outputs: [336 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_242 [Concat] TRT - VERBOSE Searching for input: 334 TRT - VERBOSE Searching for input: 336 TRT - VERBOSE Concat_242 [Concat] inputs: [334 -> (1)[INT32]], [336 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_242 for ONNX node: Concat_242 TRT - VERBOSE Registering tensor: 337 for ONNX tensor: 337 TRT - VERBOSE Concat_242 [Concat] outputs: [337 -> (2)[INT32]], TRT - VERBOSE Parsing node: Shape_243 [Shape] TRT - VERBOSE Searching for input: 332 TRT - VERBOSE Shape_243 [Shape] inputs: [332 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_243 for ONNX node: Shape_243 TRT - VERBOSE Registering tensor: 338 for ONNX tensor: 338 TRT - VERBOSE Shape_243 [Shape] outputs: [338 -> (4)[INT32]], TRT - VERBOSE Parsing node: Slice_247 [Slice] TRT - VERBOSE Searching for input: 338 TRT - VERBOSE Searching for input: 340 TRT - VERBOSE Searching for input: 341 TRT - VERBOSE Searching for input: 339 TRT - VERBOSE Slice_247 [Slice] inputs: [338 -> (4)[INT32]], [340 -> (1)[INT32]], [341 -> (1)[INT32]], [339 -> (1)[INT32]], TRT - VERBOSE Registering layer: Slice_247 for ONNX node: Slice_247 TRT - VERBOSE Registering tensor: 342 for ONNX tensor: 342 TRT - VERBOSE Slice_247 [Slice] outputs: [342 -> (2)[INT32]], TRT - VERBOSE Parsing node: Cast_248 [Cast] TRT - VERBOSE Searching for input: 337 TRT - VERBOSE Cast_248 [Cast] inputs: [337 -> (2)[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_248 for ONNX node: Cast_248 TRT - VERBOSE Registering tensor: 343 for ONNX tensor: 343 TRT - VERBOSE Cast_248 [Cast] outputs: [343 -> (2)[INT32]], TRT - VERBOSE Parsing node: Concat_249 [Concat] TRT - VERBOSE Searching for input: 342 TRT - VERBOSE Searching for input: 343 TRT - VERBOSE Concat_249 [Concat] inputs: [342 -> (2)[INT32]], [343 -> (2)[INT32]], TRT - VERBOSE Registering layer: Concat_249 for ONNX node: Concat_249 TRT - VERBOSE Registering tensor: 344 for ONNX tensor: 344 TRT - VERBOSE Concat_249 [Concat] outputs: [344 -> (4)[INT32]], TRT - VERBOSE Parsing node: Resize_250 [Resize] TRT - VERBOSE Searching for input: 332 TRT - VERBOSE Searching for input: 344 TRT - VERBOSE Resize_250 [Resize] inputs: [332 -> (-1, 1, -1, -1)[FLOAT]], [optional input, not set], [optional input, not set], [344 -> (4)[INT32]], TRT - VERBOSE Registering layer: Resize_250 for ONNX node: Resize_250 TRT - VERBOSE Registering tensor: 347 for ONNX tensor: 347 TRT - VERBOSE Resize_250 [Resize] outputs: [347 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_252 [Mul] TRT - VERBOSE Searching for input: 348 TRT - VERBOSE Searching for input: 347 TRT - VERBOSE Mul_252 [Mul] inputs: [348 -> ()[FLOAT]], [347 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: 348 for ONNX node: 348 TRT - VERBOSE Registering layer: Mul_252 for ONNX node: Mul_252 TRT - VERBOSE Registering tensor: 349 for ONNX tensor: 349 TRT - VERBOSE Mul_252 [Mul] outputs: [349 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Add_253 [Add] TRT - VERBOSE Searching for input: 265 TRT - VERBOSE Searching for input: 349 TRT - VERBOSE Add_253 [Add] inputs: [265 -> (-1, 1, -1, -1)[FLOAT]], [349 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Add_253 for ONNX node: Add_253 TRT - VERBOSE Registering tensor: 350 for ONNX tensor: 350 TRT - VERBOSE Add_253 [Add] outputs: [350 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_254 [Shape] TRT - VERBOSE Searching for input: 350 TRT - VERBOSE Shape_254 [Shape] inputs: [350 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_254 for ONNX node: Shape_254 TRT - VERBOSE Registering tensor: 351 for ONNX tensor: 351 TRT - VERBOSE Shape_254 [Shape] outputs: [351 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_256 [Gather] TRT - VERBOSE Searching for input: 351 TRT - VERBOSE Searching for input: 352 TRT - VERBOSE Gather_256 [Gather] inputs: [351 -> (4)[INT32]], [352 -> ()[INT32]], TRT - VERBOSE Registering layer: 352 for ONNX node: 352 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_256 for ONNX node: Gather_256 TRT - VERBOSE Registering tensor: 353 for ONNX tensor: 353 TRT - VERBOSE Gather_256 [Gather] outputs: [353 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_257 [Shape] TRT - VERBOSE Searching for input: 350 TRT - VERBOSE Shape_257 [Shape] inputs: [350 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_257 for ONNX node: Shape_257 TRT - VERBOSE Registering tensor: 354 for ONNX tensor: 354 TRT - VERBOSE Shape_257 [Shape] outputs: [354 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_259 [Gather] TRT - VERBOSE Searching for input: 354 TRT - VERBOSE Searching for input: 355 TRT - VERBOSE Gather_259 [Gather] inputs: [354 -> (4)[INT32]], [355 -> ()[INT32]], TRT - VERBOSE Registering layer: 355 for ONNX node: 355 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_259 for ONNX node: Gather_259 TRT - VERBOSE Registering tensor: 356 for ONNX tensor: 356 TRT - VERBOSE Gather_259 [Gather] outputs: [356 -> ()[INT32]], TRT - VERBOSE Parsing node: Greater_261 [Greater] TRT - VERBOSE Searching for input: 350 TRT - VERBOSE Searching for input: 357 TRT - VERBOSE Greater_261 [Greater] inputs: [350 -> (-1, 1, -1, -1)[FLOAT]], [357 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 357 for ONNX node: 357 TRT - VERBOSE Registering layer: Greater_261 for ONNX node: Greater_261 TRT - VERBOSE Registering tensor: 358 for ONNX tensor: 358 TRT - VERBOSE Greater_261 [Greater] outputs: [358 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: MaxPool_262 [MaxPool] TRT - VERBOSE Searching for input: 350 TRT - VERBOSE MaxPool_262 [MaxPool] inputs: [350 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: MaxPool_262 for ONNX node: MaxPool_262 TRT - VERBOSE Registering tensor: 359 for ONNX tensor: 359 TRT - VERBOSE MaxPool_262 [MaxPool] outputs: [359 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Equal_263 [Equal] TRT - VERBOSE Searching for input: 350 TRT - VERBOSE Searching for input: 359 TRT - VERBOSE Equal_263 [Equal] inputs: [350 -> (-1, 1, -1, -1)[FLOAT]], [359 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Equal_263 for ONNX node: Equal_263 TRT - VERBOSE Registering tensor: 360 for ONNX tensor: 360 TRT - VERBOSE Equal_263 [Equal] outputs: [360 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_264 [Cast] TRT - VERBOSE Searching for input: 360 TRT - VERBOSE Cast_264 [Cast] inputs: [360 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_264 for ONNX node: Cast_264 TRT - VERBOSE Registering tensor: 361 for ONNX tensor: 361 TRT - VERBOSE Cast_264 [Cast] outputs: [361 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_265 [Cast] TRT - VERBOSE Searching for input: 358 TRT - VERBOSE Cast_265 [Cast] inputs: [358 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_265 for ONNX node: Cast_265 TRT - VERBOSE Registering tensor: 362 for ONNX tensor: 362 TRT - VERBOSE Cast_265 [Cast] outputs: [362 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: And_266 [And] TRT - VERBOSE Searching for input: 361 TRT - VERBOSE Searching for input: 362 TRT - VERBOSE And_266 [And] inputs: [361 -> (-1, 1, -1, -1)[BOOL]], [362 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Registering layer: And_266 for ONNX node: And_266 TRT - VERBOSE Registering tensor: 363 for ONNX tensor: 363 TRT - VERBOSE And_266 [And] outputs: [363 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_267 [Cast] TRT - VERBOSE Searching for input: 363 TRT - VERBOSE Cast_267 [Cast] inputs: [363 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_267 for ONNX node: Cast_267 TRT - VERBOSE Registering tensor: 364 for ONNX tensor: 364 TRT - VERBOSE Cast_267 [Cast] outputs: [364 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Sub_269 [Sub] TRT - VERBOSE Searching for input: 353 TRT - VERBOSE Searching for input: 365 TRT - VERBOSE Sub_269 [Sub] inputs: [353 -> ()[INT32]], [365 -> ()[INT32]], TRT - VERBOSE Registering layer: 365 for ONNX node: 365 TRT - VERBOSE Registering layer: Sub_269 for ONNX node: Sub_269 TRT - VERBOSE Registering tensor: 366 for ONNX tensor: 366 TRT - VERBOSE Sub_269 [Sub] outputs: [366 -> ()[INT32]], TRT - VERBOSE Parsing node: Sub_271 [Sub] TRT - VERBOSE Searching for input: 356 TRT - VERBOSE Searching for input: 367 TRT - VERBOSE Sub_271 [Sub] inputs: [356 -> ()[INT32]], [367 -> ()[INT32]], TRT - VERBOSE Registering layer: 367 for ONNX node: 367 TRT - VERBOSE Registering layer: Sub_271 for ONNX node: Sub_271 TRT - VERBOSE Registering tensor: 368 for ONNX tensor: 368 TRT - VERBOSE Sub_271 [Sub] outputs: [368 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_273 [Unsqueeze] TRT - VERBOSE Searching for input: 366 TRT - VERBOSE Searching for input: 375 TRT - VERBOSE Unsqueeze_273 [Unsqueeze] inputs: [366 -> ()[INT32]], [375 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_273 for ONNX node: Unsqueeze_273 TRT - VERBOSE Registering tensor: 376 for ONNX tensor: 376 TRT - VERBOSE Unsqueeze_273 [Unsqueeze] outputs: [376 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_275 [Unsqueeze] TRT - VERBOSE Searching for input: 368 TRT - VERBOSE Searching for input: 377 TRT - VERBOSE Unsqueeze_275 [Unsqueeze] inputs: [368 -> ()[INT32]], [377 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_275 for ONNX node: Unsqueeze_275 TRT - VERBOSE Registering tensor: 378 for ONNX tensor: 378 TRT - VERBOSE Unsqueeze_275 [Unsqueeze] outputs: [378 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_276 [Concat] TRT - VERBOSE Searching for input: 1207 TRT - VERBOSE Searching for input: 1208 TRT - VERBOSE Searching for input: 376 TRT - VERBOSE Searching for input: 378 TRT - VERBOSE Concat_276 [Concat] inputs: [1207 -> (1)[INT32]], [1208 -> (1)[INT32]], [376 -> (1)[INT32]], [378 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1207 for ONNX node: 1207 TRT - VERBOSE Registering layer: 1208 for ONNX node: 1208 TRT - VERBOSE Registering layer: Concat_276 for ONNX node: Concat_276 TRT - VERBOSE Registering tensor: 379 for ONNX tensor: 379 TRT - VERBOSE Concat_276 [Concat] outputs: [379 -> (4)[INT32]], TRT - VERBOSE Parsing node: ConstantOfShape_277 [ConstantOfShape] TRT - VERBOSE Searching for input: 379 TRT - VERBOSE ConstantOfShape_277 [ConstantOfShape] inputs: [379 -> (4)[INT32]], TRT - VERBOSE Registering layer: ConstantOfShape_277 for ONNX node: ConstantOfShape_277 TRT - VERBOSE Registering tensor: 380 for ONNX tensor: 380 TRT - VERBOSE ConstantOfShape_277 [ConstantOfShape] outputs: [380 -> (1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Cast_278 [Cast] TRT - VERBOSE Searching for input: 380 TRT - VERBOSE Cast_278 [Cast] inputs: [380 -> (1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Casting to type: float32 TRT - VERBOSE Registering layer: Cast_278 for ONNX node: Cast_278 TRT - VERBOSE Registering tensor: 381 for ONNX tensor: 381 TRT - VERBOSE Cast_278 [Cast] outputs: [381 -> (1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Pad_293 [Pad] TRT - VERBOSE Searching for input: 381 TRT - VERBOSE Searching for input: 403 TRT - VERBOSE Searching for input: 404 TRT - VERBOSE Pad_293 [Pad] inputs: [381 -> (1, 1, -1, -1)[FLOAT]], [403 -> (8)[INT32]], [404 -> ()[FLOAT]], TRT - VERBOSE Registering layer: Pad_293 for ONNX node: Pad_293 TRT - VERBOSE Registering tensor: 405 for ONNX tensor: 405 TRT - VERBOSE Pad_293 [Pad] outputs: [405 -> (1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Cast_294 [Cast] TRT - VERBOSE Searching for input: 405 TRT - VERBOSE Cast_294 [Cast] inputs: [405 -> (1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_294 for ONNX node: Cast_294 TRT - VERBOSE Registering tensor: 406 for ONNX tensor: 406 TRT - VERBOSE Cast_294 [Cast] outputs: [406 -> (1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_295 [Cast] TRT - VERBOSE Searching for input: 406 TRT - VERBOSE Cast_295 [Cast] inputs: [406 -> (1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_295 for ONNX node: Cast_295 TRT - VERBOSE Registering tensor: 407 for ONNX tensor: 407 TRT - VERBOSE Cast_295 [Cast] outputs: [407 -> (1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_296 [Cast] TRT - VERBOSE Searching for input: 364 TRT - VERBOSE Cast_296 [Cast] inputs: [364 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_296 for ONNX node: Cast_296 TRT - VERBOSE Registering tensor: 408 for ONNX tensor: 408 TRT - VERBOSE Cast_296 [Cast] outputs: [408 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: And_297 [And] TRT - VERBOSE Searching for input: 407 TRT - VERBOSE Searching for input: 408 TRT - VERBOSE And_297 [And] inputs: [407 -> (1, 1, -1, -1)[BOOL]], [408 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Registering layer: And_297 for ONNX node: And_297 TRT - VERBOSE Registering tensor: 409 for ONNX tensor: 409 TRT - VERBOSE And_297 [And] outputs: [409 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_298 [Cast] TRT - VERBOSE Searching for input: 409 TRT - VERBOSE Cast_298 [Cast] inputs: [409 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_298 for ONNX node: Cast_298 TRT - VERBOSE Registering tensor: 410 for ONNX tensor: 410 TRT - VERBOSE Cast_298 [Cast] outputs: [410 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Pad_313 [Pad] TRT - VERBOSE Searching for input: 350 TRT - VERBOSE Searching for input: 432 TRT - VERBOSE Searching for input: 433 TRT - VERBOSE Pad_313 [Pad] inputs: [350 -> (-1, 1, -1, -1)[FLOAT]], [432 -> (8)[INT32]], [433 -> ()[FLOAT]], TRT - VERBOSE Registering layer: Pad_313 for ONNX node: Pad_313 TRT - VERBOSE Registering tensor: 434 for ONNX tensor: 434 TRT - VERBOSE Pad_313 [Pad] outputs: [434 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_315 [Conv] TRT - VERBOSE Searching for input: 434 TRT - VERBOSE Searching for input: 435 TRT - VERBOSE Conv_315 [Conv] inputs: [434 -> (-1, 1, -1, -1)[FLOAT]], [435 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_315 for ONNX node: Conv_315 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (3, 3), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 436 for ONNX tensor: 436 TRT - VERBOSE Conv_315 [Conv] outputs: [436 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_317 [Conv] TRT - VERBOSE Searching for input: 434 TRT - VERBOSE Searching for input: 437 TRT - VERBOSE Conv_317 [Conv] inputs: [434 -> (-1, 1, -1, -1)[FLOAT]], [437 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_317 for ONNX node: Conv_317 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (3, 3), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 438 for ONNX tensor: 438 TRT - VERBOSE Conv_317 [Conv] outputs: [438 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_319 [Conv] TRT - VERBOSE Searching for input: 434 TRT - VERBOSE Searching for input: 439 TRT - VERBOSE Conv_319 [Conv] inputs: [434 -> (-1, 1, -1, -1)[FLOAT]], [439 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_319 for ONNX node: Conv_319 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (3, 3), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 440 for ONNX tensor: 440 TRT - VERBOSE Conv_319 [Conv] outputs: [440 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_320 [Mul] TRT - VERBOSE Searching for input: 436 TRT - VERBOSE Searching for input: 440 TRT - VERBOSE Mul_320 [Mul] inputs: [436 -> (-1, 1, -1, -1)[FLOAT]], [440 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_320 for ONNX node: Mul_320 TRT - VERBOSE Registering tensor: 441 for ONNX tensor: 441 TRT - VERBOSE Mul_320 [Mul] outputs: [441 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_321 [Mul] TRT - VERBOSE Searching for input: 438 TRT - VERBOSE Searching for input: 438 TRT - VERBOSE Mul_321 [Mul] inputs: [438 -> (-1, 1, -1, -1)[FLOAT]], [438 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_321 for ONNX node: Mul_321 TRT - VERBOSE Registering tensor: 442 for ONNX tensor: 442 TRT - VERBOSE Mul_321 [Mul] outputs: [442 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Sub_322 [Sub] TRT - VERBOSE Searching for input: 441 TRT - VERBOSE Searching for input: 442 TRT - VERBOSE Sub_322 [Sub] inputs: [441 -> (-1, 1, -1, -1)[FLOAT]], [442 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Sub_322 for ONNX node: Sub_322 TRT - VERBOSE Registering tensor: 443 for ONNX tensor: 443 TRT - VERBOSE Sub_322 [Sub] outputs: [443 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Add_323 [Add] TRT - VERBOSE Searching for input: 436 TRT - VERBOSE Searching for input: 440 TRT - VERBOSE Add_323 [Add] inputs: [436 -> (-1, 1, -1, -1)[FLOAT]], [440 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Add_323 for ONNX node: Add_323 TRT - VERBOSE Registering tensor: 444 for ONNX tensor: 444 TRT - VERBOSE Add_323 [Add] outputs: [444 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Pow_325 [Pow] TRT - VERBOSE Searching for input: 444 TRT - VERBOSE Searching for input: 445 TRT - VERBOSE Pow_325 [Pow] inputs: [444 -> (-1, 1, -1, -1)[FLOAT]], [445 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 445 for ONNX node: 445 TRT - VERBOSE Registering layer: Pow_325 for ONNX node: Pow_325 TRT - VERBOSE Registering tensor: 446 for ONNX tensor: 446 TRT - VERBOSE Pow_325 [Pow] outputs: [446 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Div_326 [Div] TRT - VERBOSE Searching for input: 446 TRT - VERBOSE Searching for input: 443 TRT - VERBOSE Div_326 [Div] inputs: [446 -> (-1, 1, -1, -1)[FLOAT]], [443 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Div_326 for ONNX node: Div_326 TRT - VERBOSE Registering tensor: 447 for ONNX tensor: 447 TRT - VERBOSE Div_326 [Div] outputs: [447 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: LessOrEqual_328 [LessOrEqual] TRT - VERBOSE Searching for input: 447 TRT - VERBOSE Searching for input: 448 TRT - VERBOSE LessOrEqual_328 [LessOrEqual] inputs: [447 -> (-1, 1, -1, -1)[FLOAT]], [448 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 448 for ONNX node: 448 TRT - VERBOSE Registering layer: LessOrEqual_328 for ONNX node: LessOrEqual_328 TRT - VERBOSE Registering layer: LessOrEqual_328_264 for ONNX node: LessOrEqual_328 TRT - VERBOSE Registering layer: LessOrEqual_328_265 for ONNX node: LessOrEqual_328 TRT - VERBOSE Registering tensor: 449 for ONNX tensor: 449 TRT - VERBOSE LessOrEqual_328 [LessOrEqual] outputs: [449 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Greater_330 [Greater] TRT - VERBOSE Searching for input: 443 TRT - VERBOSE Searching for input: 450 TRT - VERBOSE Greater_330 [Greater] inputs: [443 -> (-1, 1, -1, -1)[FLOAT]], [450 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 450 for ONNX node: 450 TRT - VERBOSE Registering layer: Greater_330 for ONNX node: Greater_330 TRT - VERBOSE Registering tensor: 451 for ONNX tensor: 451 TRT - VERBOSE Greater_330 [Greater] outputs: [451 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_331 [Cast] TRT - VERBOSE Searching for input: 449 TRT - VERBOSE Cast_331 [Cast] inputs: [449 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_331 for ONNX node: Cast_331 TRT - VERBOSE Registering tensor: 452 for ONNX tensor: 452 TRT - VERBOSE Cast_331 [Cast] outputs: [452 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_332 [Cast] TRT - VERBOSE Searching for input: 451 TRT - VERBOSE Cast_332 [Cast] inputs: [451 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_332 for ONNX node: Cast_332 TRT - VERBOSE Registering tensor: 453 for ONNX tensor: 453 TRT - VERBOSE Cast_332 [Cast] outputs: [453 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: And_333 [And] TRT - VERBOSE Searching for input: 452 TRT - VERBOSE Searching for input: 453 TRT - VERBOSE And_333 [And] inputs: [452 -> (-1, 1, -1, -1)[BOOL]], [453 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Registering layer: And_333 for ONNX node: And_333 TRT - VERBOSE Registering tensor: 454 for ONNX tensor: 454 TRT - VERBOSE And_333 [And] outputs: [454 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_334 [Cast] TRT - VERBOSE Searching for input: 454 TRT - VERBOSE Cast_334 [Cast] inputs: [454 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_334 for ONNX node: Cast_334 TRT - VERBOSE Registering tensor: 455 for ONNX tensor: 455 TRT - VERBOSE Cast_334 [Cast] outputs: [455 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_335 [Cast] TRT - VERBOSE Searching for input: 455 TRT - VERBOSE Cast_335 [Cast] inputs: [455 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_335 for ONNX node: Cast_335 TRT - VERBOSE Registering tensor: 456 for ONNX tensor: 456 TRT - VERBOSE Cast_335 [Cast] outputs: [456 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_336 [Cast] TRT - VERBOSE Searching for input: 410 TRT - VERBOSE Cast_336 [Cast] inputs: [410 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_336 for ONNX node: Cast_336 TRT - VERBOSE Registering tensor: 457 for ONNX tensor: 457 TRT - VERBOSE Cast_336 [Cast] outputs: [457 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: And_337 [And] TRT - VERBOSE Searching for input: 456 TRT - VERBOSE Searching for input: 457 TRT - VERBOSE And_337 [And] inputs: [456 -> (-1, 1, -1, -1)[BOOL]], [457 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Registering layer: And_337 for ONNX node: And_337 TRT - VERBOSE Registering tensor: 458 for ONNX tensor: 458 TRT - VERBOSE And_337 [And] outputs: [458 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_338 [Cast] TRT - VERBOSE Searching for input: 458 TRT - VERBOSE Cast_338 [Cast] inputs: [458 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_338 for ONNX node: Cast_338 TRT - VERBOSE Registering tensor: 459 for ONNX tensor: 459 TRT - VERBOSE Cast_338 [Cast] outputs: [459 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_339 [Cast] TRT - VERBOSE Searching for input: 459 TRT - VERBOSE Cast_339 [Cast] inputs: [459 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_339 for ONNX node: Cast_339 TRT - VERBOSE Registering tensor: 460 for ONNX tensor: 460 TRT - VERBOSE Cast_339 [Cast] outputs: [460 -> (-1, 1, -1, -1)[INT32]], TRT - VERBOSE Parsing node: Equal_341 [Equal] TRT - VERBOSE Searching for input: 460 TRT - VERBOSE Searching for input: 461 TRT - VERBOSE Equal_341 [Equal] inputs: [460 -> (-1, 1, -1, -1)[INT32]], [461 -> ()[INT32]], TRT - VERBOSE Registering layer: 461 for ONNX node: 461 TRT - VERBOSE Registering layer: Equal_341 for ONNX node: Equal_341 TRT - VERBOSE Registering tensor: 462 for ONNX tensor: 462 TRT - VERBOSE Equal_341 [Equal] outputs: [462 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_342 [Cast] TRT - VERBOSE Searching for input: 462 TRT - VERBOSE Cast_342 [Cast] inputs: [462 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_342 for ONNX node: Cast_342 TRT - VERBOSE Registering tensor: 463 for ONNX tensor: 463 TRT - VERBOSE Cast_342 [Cast] outputs: [463 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Where_344 [Where] TRT - VERBOSE Searching for input: 463 TRT - VERBOSE Searching for input: 464 TRT - VERBOSE Searching for input: 350 TRT - VERBOSE Where_344 [Where] inputs: [463 -> (-1, 1, -1, -1)[BOOL]], [464 -> ()[FLOAT]], [350 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: 464 for ONNX node: 464 TRT - VERBOSE Registering layer: Where_344 for ONNX node: Where_344 TRT - VERBOSE Registering tensor: 465 for ONNX tensor: 465 TRT - VERBOSE Where_344 [Where] outputs: [465 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_345 [Shape] TRT - VERBOSE Searching for input: 465 TRT - VERBOSE Shape_345 [Shape] inputs: [465 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_345 for ONNX node: Shape_345 TRT - VERBOSE Registering tensor: 466 for ONNX tensor: 466 TRT - VERBOSE Shape_345 [Shape] outputs: [466 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_347 [Gather] TRT - VERBOSE Searching for input: 466 TRT - VERBOSE Searching for input: 467 TRT - VERBOSE Gather_347 [Gather] inputs: [466 -> (4)[INT32]], [467 -> ()[INT32]], TRT - VERBOSE Registering layer: 467 for ONNX node: 467 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_347 for ONNX node: Gather_347 TRT - VERBOSE Registering tensor: 468 for ONNX tensor: 468 TRT - VERBOSE Gather_347 [Gather] outputs: [468 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_348 [Shape] TRT - VERBOSE Searching for input: 465 TRT - VERBOSE Shape_348 [Shape] inputs: [465 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_348 for ONNX node: Shape_348 TRT - VERBOSE Registering tensor: 469 for ONNX tensor: 469 TRT - VERBOSE Shape_348 [Shape] outputs: [469 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_350 [Gather] TRT - VERBOSE Searching for input: 469 TRT - VERBOSE Searching for input: 470 TRT - VERBOSE Gather_350 [Gather] inputs: [469 -> (4)[INT32]], [470 -> ()[INT32]], TRT - VERBOSE Registering layer: 470 for ONNX node: 470 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_350 for ONNX node: Gather_350 TRT - VERBOSE Registering tensor: 471 for ONNX tensor: 471 TRT - VERBOSE Gather_350 [Gather] outputs: [471 -> ()[INT32]], TRT - VERBOSE Parsing node: Mul_351 [Mul] TRT - VERBOSE Searching for input: 468 TRT - VERBOSE Searching for input: 471 TRT - VERBOSE Mul_351 [Mul] inputs: [468 -> ()[INT32]], [471 -> ()[INT32]], TRT - VERBOSE Registering layer: Mul_351 for ONNX node: Mul_351 TRT - VERBOSE Registering tensor: 472 for ONNX tensor: 472 TRT - VERBOSE Mul_351 [Mul] outputs: [472 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_353 [Unsqueeze] TRT - VERBOSE Searching for input: 472 TRT - VERBOSE Searching for input: 473 TRT - VERBOSE Unsqueeze_353 [Unsqueeze] inputs: [472 -> ()[INT32]], [473 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_353 for ONNX node: Unsqueeze_353 TRT - VERBOSE Registering tensor: 474 for ONNX tensor: 474 TRT - VERBOSE Unsqueeze_353 [Unsqueeze] outputs: [474 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_354 [Concat] TRT - VERBOSE Searching for input: 474 TRT - VERBOSE Concat_354 [Concat] inputs: [474 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_354 for ONNX node: Concat_354 TRT - VERBOSE Registering tensor: 475 for ONNX tensor: 475 TRT - VERBOSE Concat_354 [Concat] outputs: [475 -> (1)[INT32]], TRT - VERBOSE Parsing node: Reshape_355 [Reshape] TRT - VERBOSE Searching for input: 465 TRT - VERBOSE Searching for input: 475 TRT - VERBOSE Reshape_355 [Reshape] inputs: [465 -> (-1, 1, -1, -1)[FLOAT]], [475 -> (1)[INT32]], TRT - VERBOSE Registering layer: Reshape_355 for ONNX node: Reshape_355 TRT - VERBOSE Registering tensor: 476 for ONNX tensor: 476 TRT - VERBOSE Reshape_355 [Reshape] outputs: [476 -> (-1)[FLOAT]], TRT - VERBOSE Parsing node: TopK_356 [TopK] TRT - VERBOSE Searching for input: 476 TRT - VERBOSE Searching for input: 1219 TRT - VERBOSE TopK_356 [TopK] inputs: [476 -> (-1)[FLOAT]], [1219 -> (1)[INT32]], TRT - VERBOSE Original shape: (_,), unsqueezing to: (_, _) TRT - VERBOSE Registering layer: TopK_356 for ONNX node: TopK_356 TRT - VERBOSE Original shape: (3000, 1), squeezing to: (3000,) TRT - VERBOSE Original shape: (3000, 1), squeezing to: (3000,) TRT - VERBOSE Registering tensor: 480 for ONNX tensor: 480 TRT - VERBOSE Registering tensor: 481 for ONNX tensor: 481 TRT - VERBOSE TopK_356 [TopK] outputs: [480 -> (3000)[FLOAT]], [481 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_357 [Shape] TRT - VERBOSE Searching for input: 480 TRT - VERBOSE Shape_357 [Shape] inputs: [480 -> (3000)[FLOAT]], TRT - VERBOSE Registering layer: Shape_357 for ONNX node: Shape_357 TRT - VERBOSE Registering tensor: 482 for ONNX tensor: 482 TRT - VERBOSE Shape_357 [Shape] outputs: [482 -> (1)[INT32]], TRT - VERBOSE Parsing node: Gather_359 [Gather] TRT - VERBOSE Searching for input: 482 TRT - VERBOSE Searching for input: 483 TRT - VERBOSE Gather_359 [Gather] inputs: [482 -> (1)[INT32]], [483 -> ()[INT32]], TRT - VERBOSE Registering layer: 483 for ONNX node: 483 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_359 for ONNX node: Gather_359 TRT - VERBOSE Registering tensor: 484 for ONNX tensor: 484 TRT - VERBOSE Gather_359 [Gather] outputs: [484 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_361 [Unsqueeze] TRT - VERBOSE Searching for input: 484 TRT - VERBOSE Searching for input: 486 TRT - VERBOSE Unsqueeze_361 [Unsqueeze] inputs: [484 -> ()[INT32]], [486 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_361 for ONNX node: Unsqueeze_361 TRT - VERBOSE Registering tensor: 487 for ONNX tensor: 487 TRT - VERBOSE Unsqueeze_361 [Unsqueeze] outputs: [487 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_362 [Concat] TRT - VERBOSE Searching for input: 487 TRT - VERBOSE Searching for input: 1220 TRT - VERBOSE Concat_362 [Concat] inputs: [487 -> (1)[INT32]], [1220 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1220 for ONNX node: 1220 TRT - VERBOSE Registering layer: Concat_362 for ONNX node: Concat_362 TRT - VERBOSE Registering tensor: 490 for ONNX tensor: 490 TRT - VERBOSE Concat_362 [Concat] outputs: [490 -> (2)[INT32]], TRT - VERBOSE Parsing node: ConstantOfShape_363 [ConstantOfShape] TRT - VERBOSE Searching for input: 490 TRT - VERBOSE ConstantOfShape_363 [ConstantOfShape] inputs: [490 -> (2)[INT32]], TRT - VERBOSE Registering layer: ConstantOfShape_363 for ONNX node: ConstantOfShape_363 TRT - VERBOSE Registering tensor: 491 for ONNX tensor: 491 TRT - VERBOSE ConstantOfShape_363 [ConstantOfShape] outputs: [491 -> (3000, 2)[FLOAT]], TRT - VERBOSE Parsing node: RandomUniformLike_364 [RandomUniformLike] TRT - VERBOSE Searching for input: 491 TRT - VERBOSE RandomUniformLike_364 [RandomUniformLike] inputs: [491 -> (3000, 2)[FLOAT]], TRT - VERBOSE Registering layer: RandomUniformLike_364 for ONNX node: RandomUniformLike_364 TRT - VERBOSE Registering tensor: 492 for ONNX tensor: 492 TRT - VERBOSE RandomUniformLike_364 [RandomUniformLike] outputs: [492 -> (3000, 2)[FLOAT]], TRT - VERBOSE Parsing node: Cast_365 [Cast] TRT - VERBOSE Searching for input: 492 TRT - VERBOSE Cast_365 [Cast] inputs: [492 -> (3000, 2)[FLOAT]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_365 for ONNX node: Cast_365 TRT - VERBOSE Registering tensor: 493 for ONNX tensor: 493 TRT - VERBOSE Cast_365 [Cast] outputs: [493 -> (3000, 2)[INT32]], TRT - VERBOSE Parsing node: Shape_366 [Shape] TRT - VERBOSE Searching for input: 459 TRT - VERBOSE Shape_366 [Shape] inputs: [459 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Registering layer: Shape_366 for ONNX node: Shape_366 TRT - VERBOSE Registering tensor: 494 for ONNX tensor: 494 TRT - VERBOSE Shape_366 [Shape] outputs: [494 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_368 [Gather] TRT - VERBOSE Searching for input: 494 TRT - VERBOSE Searching for input: 495 TRT - VERBOSE Gather_368 [Gather] inputs: [494 -> (4)[INT32]], [495 -> ()[INT32]], TRT - VERBOSE Registering layer: 495 for ONNX node: 495 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_368 for ONNX node: Gather_368 TRT - VERBOSE Registering tensor: 496 for ONNX tensor: 496 TRT - VERBOSE Gather_368 [Gather] outputs: [496 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_369 [Cast] TRT - VERBOSE Searching for input: 481 TRT - VERBOSE Cast_369 [Cast] inputs: [481 -> (3000)[INT32]], TRT - VERBOSE Casting to type: float32 TRT - VERBOSE Registering layer: Cast_369 for ONNX node: Cast_369 TRT - VERBOSE Registering tensor: 497 for ONNX tensor: 497 TRT - VERBOSE Cast_369 [Cast] outputs: [497 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Cast_370 [Cast] TRT - VERBOSE Searching for input: 496 TRT - VERBOSE Cast_370 [Cast] inputs: [496 -> ()[INT32]], TRT - VERBOSE Casting to type: float32 TRT - VERBOSE Registering layer: Cast_370 for ONNX node: Cast_370 TRT - VERBOSE Registering tensor: 498 for ONNX tensor: 498 TRT - VERBOSE Cast_370 [Cast] outputs: [498 -> ()[FLOAT]], TRT - VERBOSE Parsing node: Div_371 [Div] TRT - VERBOSE Searching for input: 497 TRT - VERBOSE Searching for input: 498 TRT - VERBOSE Div_371 [Div] inputs: [497 -> (3000)[FLOAT]], [498 -> ()[FLOAT]], TRT - VERBOSE Registering layer: Div_371 for ONNX node: Div_371 TRT - VERBOSE Registering tensor: 499 for ONNX tensor: 499 TRT - VERBOSE Div_371 [Div] outputs: [499 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Gather_373 [Gather] TRT - VERBOSE Searching for input: 493 TRT - VERBOSE Searching for input: 500 TRT - VERBOSE Gather_373 [Gather] inputs: [493 -> (3000, 2)[INT32]], [500 -> ()[INT32]], TRT - VERBOSE Registering layer: 500 for ONNX node: 500 TRT - VERBOSE Using Gather axis: 1 TRT - VERBOSE Registering layer: Gather_373 for ONNX node: Gather_373 TRT - VERBOSE Registering tensor: 501 for ONNX tensor: 501 TRT - VERBOSE Gather_373 [Gather] outputs: [501 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_374 [Shape] TRT - VERBOSE Searching for input: 501 TRT - VERBOSE Shape_374 [Shape] inputs: [501 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Shape_374 for ONNX node: Shape_374 TRT - VERBOSE Registering tensor: 502 for ONNX tensor: 502 TRT - VERBOSE Shape_374 [Shape] outputs: [502 -> (1)[INT32]], TRT - VERBOSE Parsing node: Expand_375 [Expand] TRT - VERBOSE Searching for input: 499 TRT - VERBOSE Searching for input: 502 TRT - VERBOSE Expand_375 [Expand] inputs: [499 -> (3000)[FLOAT]], [502 -> (1)[INT32]], TRT - VERBOSE Registering layer: Expand_375 for ONNX node: Expand_375 TRT - VERBOSE Registering tensor: 503 for ONNX tensor: 503 TRT - VERBOSE Expand_375 [Expand] outputs: [503 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Shape_376 [Shape] TRT - VERBOSE Searching for input: 493 TRT - VERBOSE Shape_376 [Shape] inputs: [493 -> (3000, 2)[INT32]], TRT - VERBOSE Registering layer: Shape_376 for ONNX node: Shape_376 TRT - VERBOSE Registering tensor: 504 for ONNX tensor: 504 TRT - VERBOSE Shape_376 [Shape] outputs: [504 -> (2)[INT32]], TRT - VERBOSE Parsing node: Gather_378 [Gather] TRT - VERBOSE Searching for input: 504 TRT - VERBOSE Searching for input: 505 TRT - VERBOSE Gather_378 [Gather] inputs: [504 -> (2)[INT32]], [505 -> ()[INT32]], TRT - VERBOSE Registering layer: 505 for ONNX node: 505 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_378 for ONNX node: Gather_378 TRT - VERBOSE Registering tensor: 506 for ONNX tensor: 506 TRT - VERBOSE Gather_378 [Gather] outputs: [506 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_379 [Cast] TRT - VERBOSE Searching for input: 506 TRT - VERBOSE Cast_379 [Cast] inputs: [506 -> ()[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_379 for ONNX node: Cast_379 TRT - VERBOSE Registering tensor: 507 for ONNX tensor: 507 TRT - VERBOSE Cast_379 [Cast] outputs: [507 -> ()[INT32]], TRT - VERBOSE Parsing node: Range_382 [Range] TRT - VERBOSE Searching for input: 508 TRT - VERBOSE Searching for input: 507 TRT - VERBOSE Searching for input: 509 TRT - VERBOSE Range_382 [Range] inputs: [508 -> ()[INT32]], [507 -> ()[INT32]], [509 -> ()[INT32]], TRT - VERBOSE Registering layer: Range_382 for ONNX node: Range_382 TRT - VERBOSE Registering tensor: 510 for ONNX tensor: 510 TRT - VERBOSE Range_382 [Range] outputs: [510 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Reshape_385 [Reshape] TRT - VERBOSE Searching for input: 510 TRT - VERBOSE Searching for input: 512 TRT - VERBOSE Reshape_385 [Reshape] inputs: [510 -> (3000)[INT32]], [512 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_385 for ONNX node: Reshape_385 TRT - VERBOSE Registering tensor: 513 for ONNX tensor: 513 TRT - VERBOSE Reshape_385 [Reshape] outputs: [513 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Add_387 [Add] TRT - VERBOSE Searching for input: 513 TRT - VERBOSE Searching for input: 514 TRT - VERBOSE Add_387 [Add] inputs: [513 -> (3000, 1)[INT32]], [514 -> (1)[INT32]], TRT - VERBOSE Registering layer: 514 for ONNX node: 514 TRT - VERBOSE Registering layer: Add_387 for ONNX node: Add_387 TRT - VERBOSE Registering tensor: 515 for ONNX tensor: 515 TRT - VERBOSE Add_387 [Add] outputs: [515 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Shape_388 [Shape] TRT - VERBOSE Searching for input: 515 TRT - VERBOSE Shape_388 [Shape] inputs: [515 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: Shape_388 for ONNX node: Shape_388 TRT - VERBOSE Registering tensor: 516 for ONNX tensor: 516 TRT - VERBOSE Shape_388 [Shape] outputs: [516 -> (2)[INT32]], TRT - VERBOSE Parsing node: Equal_393 [Equal] TRT - VERBOSE Searching for input: 516 TRT - VERBOSE Searching for input: 520 TRT - VERBOSE Equal_393 [Equal] inputs: [516 -> (2)[INT32]], [520 -> (2)[INT32]], TRT - VERBOSE Registering layer: 520 for ONNX node: 520 TRT - VERBOSE Registering layer: Equal_393 for ONNX node: Equal_393 TRT - VERBOSE Registering tensor: 521 for ONNX tensor: 521 TRT - VERBOSE Equal_393 [Equal] outputs: [521 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_394 [Where] TRT - VERBOSE Searching for input: 521 TRT - VERBOSE Searching for input: 518 TRT - VERBOSE Searching for input: 516 TRT - VERBOSE Where_394 [Where] inputs: [521 -> (2)[BOOL]], [518 -> (2)[INT32]], [516 -> (2)[INT32]], TRT - VERBOSE Registering layer: 518 for ONNX node: 518 TRT - VERBOSE Registering layer: Where_394 for ONNX node: Where_394 TRT - VERBOSE Registering tensor: 522 for ONNX tensor: 522 TRT - VERBOSE Where_394 [Where] outputs: [522 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_395 [Expand] TRT - VERBOSE Searching for input: 513 TRT - VERBOSE Searching for input: 522 TRT - VERBOSE Expand_395 [Expand] inputs: [513 -> (3000, 1)[INT32]], [522 -> (2)[INT32]], TRT - VERBOSE Registering layer: Expand_395 for ONNX node: Expand_395 TRT - VERBOSE Registering tensor: 523 for ONNX tensor: 523 TRT - VERBOSE Expand_395 [Expand] outputs: [523 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_397 [Unsqueeze] TRT - VERBOSE Searching for input: 523 TRT - VERBOSE Searching for input: 524 TRT - VERBOSE Unsqueeze_397 [Unsqueeze] inputs: [523 -> (3000, 1)[INT32]], [524 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_397 for ONNX node: Unsqueeze_397 TRT - VERBOSE Registering tensor: 525 for ONNX tensor: 525 TRT - VERBOSE Unsqueeze_397 [Unsqueeze] outputs: [525 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Equal_402 [Equal] TRT - VERBOSE Searching for input: 516 TRT - VERBOSE Searching for input: 529 TRT - VERBOSE Equal_402 [Equal] inputs: [516 -> (2)[INT32]], [529 -> (2)[INT32]], TRT - VERBOSE Registering layer: 529 for ONNX node: 529 TRT - VERBOSE Registering layer: Equal_402 for ONNX node: Equal_402 TRT - VERBOSE Registering tensor: 530 for ONNX tensor: 530 TRT - VERBOSE Equal_402 [Equal] outputs: [530 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_403 [Where] TRT - VERBOSE Searching for input: 530 TRT - VERBOSE Searching for input: 527 TRT - VERBOSE Searching for input: 516 TRT - VERBOSE Where_403 [Where] inputs: [530 -> (2)[BOOL]], [527 -> (2)[INT32]], [516 -> (2)[INT32]], TRT - VERBOSE Registering layer: 527 for ONNX node: 527 TRT - VERBOSE Registering layer: Where_403 for ONNX node: Where_403 TRT - VERBOSE Registering tensor: 531 for ONNX tensor: 531 TRT - VERBOSE Where_403 [Where] outputs: [531 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_404 [Expand] TRT - VERBOSE Searching for input: 511 TRT - VERBOSE Searching for input: 531 TRT - VERBOSE Expand_404 [Expand] inputs: [511 -> (1)[INT32]], [531 -> (2)[INT32]], TRT - VERBOSE Registering layer: 511 for ONNX node: 511 TRT - VERBOSE Registering layer: Expand_404 for ONNX node: Expand_404 TRT - VERBOSE Registering tensor: 532 for ONNX tensor: 532 TRT - VERBOSE Expand_404 [Expand] outputs: [532 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_406 [Unsqueeze] TRT - VERBOSE Searching for input: 532 TRT - VERBOSE Searching for input: 533 TRT - VERBOSE Unsqueeze_406 [Unsqueeze] inputs: [532 -> (3000, 1)[INT32]], [533 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_406 for ONNX node: Unsqueeze_406 TRT - VERBOSE Registering tensor: 534 for ONNX tensor: 534 TRT - VERBOSE Unsqueeze_406 [Unsqueeze] outputs: [534 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Concat_407 [Concat] TRT - VERBOSE Searching for input: 525 TRT - VERBOSE Searching for input: 534 TRT - VERBOSE Concat_407 [Concat] inputs: [525 -> (3000, 1, 1)[INT32]], [534 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Registering layer: Concat_407 for ONNX node: Concat_407 TRT - VERBOSE Registering tensor: 535 for ONNX tensor: 535 TRT - VERBOSE Concat_407 [Concat] outputs: [535 -> (3000, 1, 2)[INT32]], TRT - VERBOSE Parsing node: Concat_413 [Concat] TRT - VERBOSE Searching for input: 516 TRT - VERBOSE Searching for input: 540 TRT - VERBOSE Concat_413 [Concat] inputs: [516 -> (2)[INT32]], [540 -> (0)[INT32]], TRT - VERBOSE Registering layer: Concat_413 for ONNX node: Concat_413 TRT - VERBOSE Registering tensor: 541 for ONNX tensor: 541 TRT - VERBOSE Concat_413 [Concat] outputs: [541 -> (2)[INT32]], TRT - VERBOSE Parsing node: Reshape_414 [Reshape] TRT - VERBOSE Searching for input: 503 TRT - VERBOSE Searching for input: 541 TRT - VERBOSE Reshape_414 [Reshape] inputs: [503 -> (3000)[FLOAT]], [541 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_414 for ONNX node: Reshape_414 TRT - VERBOSE Registering tensor: 542 for ONNX tensor: 542 TRT - VERBOSE Reshape_414 [Reshape] outputs: [542 -> (3000, 1)[FLOAT]], TRT - VERBOSE Parsing node: Cast_415 [Cast] TRT - VERBOSE Searching for input: 542 TRT - VERBOSE Cast_415 [Cast] inputs: [542 -> (3000, 1)[FLOAT]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_415 for ONNX node: Cast_415 TRT - VERBOSE Registering tensor: 543 for ONNX tensor: 543 TRT - VERBOSE Cast_415 [Cast] outputs: [543 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: ScatterND_416 [ScatterND] TRT - VERBOSE Searching for input: 493 TRT - VERBOSE Searching for input: 535 TRT - VERBOSE Searching for input: 543 TRT - VERBOSE ScatterND_416 [ScatterND] inputs: [493 -> (3000, 2)[INT32]], [535 -> (3000, 1, 2)[INT32]], [543 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: ScatterND_416 for ONNX node: ScatterND_416 TRT - VERBOSE Registering tensor: 544 for ONNX tensor: 544 TRT - VERBOSE ScatterND_416 [ScatterND] outputs: [544 -> (3000, 2)[INT32]], TRT - VERBOSE Parsing node: Shape_417 [Shape] TRT - VERBOSE Searching for input: 459 TRT - VERBOSE Shape_417 [Shape] inputs: [459 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Registering layer: Shape_417 for ONNX node: Shape_417 TRT - VERBOSE Registering tensor: 545 for ONNX tensor: 545 TRT - VERBOSE Shape_417 [Shape] outputs: [545 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_419 [Gather] TRT - VERBOSE Searching for input: 545 TRT - VERBOSE Searching for input: 546 TRT - VERBOSE Gather_419 [Gather] inputs: [545 -> (4)[INT32]], [546 -> ()[INT32]], TRT - VERBOSE Registering layer: 546 for ONNX node: 546 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_419 for ONNX node: Gather_419 TRT - VERBOSE Registering tensor: 547 for ONNX tensor: 547 TRT - VERBOSE Gather_419 [Gather] outputs: [547 -> ()[INT32]], TRT - VERBOSE Parsing node: Div_420 [Div] TRT - VERBOSE Searching for input: 481 TRT - VERBOSE Searching for input: 547 TRT - VERBOSE Div_420 [Div] inputs: [481 -> (3000)[INT32]], [547 -> ()[INT32]], TRT - VERBOSE Registering layer: Div_420 for ONNX node: Div_420 TRT - VERBOSE Registering tensor: 548 for ONNX tensor: 548 TRT - VERBOSE Div_420 [Div] outputs: [548 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Mul_421 [Mul] TRT - VERBOSE Searching for input: 548 TRT - VERBOSE Searching for input: 547 TRT - VERBOSE Mul_421 [Mul] inputs: [548 -> (3000)[INT32]], [547 -> ()[INT32]], TRT - VERBOSE Registering layer: Mul_421 for ONNX node: Mul_421 TRT - VERBOSE Registering tensor: 549 for ONNX tensor: 549 TRT - VERBOSE Mul_421 [Mul] outputs: [549 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Sub_422 [Sub] TRT - VERBOSE Searching for input: 481 TRT - VERBOSE Searching for input: 549 TRT - VERBOSE Sub_422 [Sub] inputs: [481 -> (3000)[INT32]], [549 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Sub_422 for ONNX node: Sub_422 TRT - VERBOSE Registering tensor: 550 for ONNX tensor: 550 TRT - VERBOSE Sub_422 [Sub] outputs: [550 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Gather_424 [Gather] TRT - VERBOSE Searching for input: 544 TRT - VERBOSE Searching for input: 551 TRT - VERBOSE Gather_424 [Gather] inputs: [544 -> (3000, 2)[INT32]], [551 -> ()[INT32]], TRT - VERBOSE Registering layer: 551 for ONNX node: 551 TRT - VERBOSE Using Gather axis: 1 TRT - VERBOSE Registering layer: Gather_424 for ONNX node: Gather_424 TRT - VERBOSE Registering tensor: 552 for ONNX tensor: 552 TRT - VERBOSE Gather_424 [Gather] outputs: [552 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_425 [Shape] TRT - VERBOSE Searching for input: 552 TRT - VERBOSE Shape_425 [Shape] inputs: [552 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Shape_425 for ONNX node: Shape_425 TRT - VERBOSE Registering tensor: 553 for ONNX tensor: 553 TRT - VERBOSE Shape_425 [Shape] outputs: [553 -> (1)[INT32]], TRT - VERBOSE Parsing node: Expand_426 [Expand] TRT - VERBOSE Searching for input: 550 TRT - VERBOSE Searching for input: 553 TRT - VERBOSE Expand_426 [Expand] inputs: [550 -> (3000)[INT32]], [553 -> (1)[INT32]], TRT - VERBOSE Registering layer: Expand_426 for ONNX node: Expand_426 TRT - VERBOSE Registering tensor: 554 for ONNX tensor: 554 TRT - VERBOSE Expand_426 [Expand] outputs: [554 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_427 [Shape] TRT - VERBOSE Searching for input: 544 TRT - VERBOSE Shape_427 [Shape] inputs: [544 -> (3000, 2)[INT32]], TRT - VERBOSE Registering layer: Shape_427 for ONNX node: Shape_427 TRT - VERBOSE Registering tensor: 555 for ONNX tensor: 555 TRT - VERBOSE Shape_427 [Shape] outputs: [555 -> (2)[INT32]], TRT - VERBOSE Parsing node: Gather_429 [Gather] TRT - VERBOSE Searching for input: 555 TRT - VERBOSE Searching for input: 556 TRT - VERBOSE Gather_429 [Gather] inputs: [555 -> (2)[INT32]], [556 -> ()[INT32]], TRT - VERBOSE Registering layer: 556 for ONNX node: 556 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_429 for ONNX node: Gather_429 TRT - VERBOSE Registering tensor: 557 for ONNX tensor: 557 TRT - VERBOSE Gather_429 [Gather] outputs: [557 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_430 [Cast] TRT - VERBOSE Searching for input: 557 TRT - VERBOSE Cast_430 [Cast] inputs: [557 -> ()[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_430 for ONNX node: Cast_430 TRT - VERBOSE Registering tensor: 558 for ONNX tensor: 558 TRT - VERBOSE Cast_430 [Cast] outputs: [558 -> ()[INT32]], TRT - VERBOSE Parsing node: Range_433 [Range] TRT - VERBOSE Searching for input: 559 TRT - VERBOSE Searching for input: 558 TRT - VERBOSE Searching for input: 560 TRT - VERBOSE Range_433 [Range] inputs: [559 -> ()[INT32]], [558 -> ()[INT32]], [560 -> ()[INT32]], TRT - VERBOSE Registering layer: Range_433 for ONNX node: Range_433 TRT - VERBOSE Registering tensor: 561 for ONNX tensor: 561 TRT - VERBOSE Range_433 [Range] outputs: [561 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Reshape_436 [Reshape] TRT - VERBOSE Searching for input: 561 TRT - VERBOSE Searching for input: 563 TRT - VERBOSE Reshape_436 [Reshape] inputs: [561 -> (3000)[INT32]], [563 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_436 for ONNX node: Reshape_436 TRT - VERBOSE Registering tensor: 564 for ONNX tensor: 564 TRT - VERBOSE Reshape_436 [Reshape] outputs: [564 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Add_438 [Add] TRT - VERBOSE Searching for input: 564 TRT - VERBOSE Searching for input: 565 TRT - VERBOSE Add_438 [Add] inputs: [564 -> (3000, 1)[INT32]], [565 -> (1)[INT32]], TRT - VERBOSE Registering layer: 565 for ONNX node: 565 TRT - VERBOSE Registering layer: Add_438 for ONNX node: Add_438 TRT - VERBOSE Registering tensor: 566 for ONNX tensor: 566 TRT - VERBOSE Add_438 [Add] outputs: [566 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Shape_439 [Shape] TRT - VERBOSE Searching for input: 566 TRT - VERBOSE Shape_439 [Shape] inputs: [566 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: Shape_439 for ONNX node: Shape_439 TRT - VERBOSE Registering tensor: 567 for ONNX tensor: 567 TRT - VERBOSE Shape_439 [Shape] outputs: [567 -> (2)[INT32]], TRT - VERBOSE Parsing node: Equal_444 [Equal] TRT - VERBOSE Searching for input: 567 TRT - VERBOSE Searching for input: 571 TRT - VERBOSE Equal_444 [Equal] inputs: [567 -> (2)[INT32]], [571 -> (2)[INT32]], TRT - VERBOSE Registering layer: 571 for ONNX node: 571 TRT - VERBOSE Registering layer: Equal_444 for ONNX node: Equal_444 TRT - VERBOSE Registering tensor: 572 for ONNX tensor: 572 TRT - VERBOSE Equal_444 [Equal] outputs: [572 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_445 [Where] TRT - VERBOSE Searching for input: 572 TRT - VERBOSE Searching for input: 569 TRT - VERBOSE Searching for input: 567 TRT - VERBOSE Where_445 [Where] inputs: [572 -> (2)[BOOL]], [569 -> (2)[INT32]], [567 -> (2)[INT32]], TRT - VERBOSE Registering layer: 569 for ONNX node: 569 TRT - VERBOSE Registering layer: Where_445 for ONNX node: Where_445 TRT - VERBOSE Registering tensor: 573 for ONNX tensor: 573 TRT - VERBOSE Where_445 [Where] outputs: [573 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_446 [Expand] TRT - VERBOSE Searching for input: 564 TRT - VERBOSE Searching for input: 573 TRT - VERBOSE Expand_446 [Expand] inputs: [564 -> (3000, 1)[INT32]], [573 -> (2)[INT32]], TRT - VERBOSE Registering layer: Expand_446 for ONNX node: Expand_446 TRT - VERBOSE Registering tensor: 574 for ONNX tensor: 574 TRT - VERBOSE Expand_446 [Expand] outputs: [574 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_448 [Unsqueeze] TRT - VERBOSE Searching for input: 574 TRT - VERBOSE Searching for input: 575 TRT - VERBOSE Unsqueeze_448 [Unsqueeze] inputs: [574 -> (3000, 1)[INT32]], [575 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_448 for ONNX node: Unsqueeze_448 TRT - VERBOSE Registering tensor: 576 for ONNX tensor: 576 TRT - VERBOSE Unsqueeze_448 [Unsqueeze] outputs: [576 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Equal_453 [Equal] TRT - VERBOSE Searching for input: 567 TRT - VERBOSE Searching for input: 580 TRT - VERBOSE Equal_453 [Equal] inputs: [567 -> (2)[INT32]], [580 -> (2)[INT32]], TRT - VERBOSE Registering layer: 580 for ONNX node: 580 TRT - VERBOSE Registering layer: Equal_453 for ONNX node: Equal_453 TRT - VERBOSE Registering tensor: 581 for ONNX tensor: 581 TRT - VERBOSE Equal_453 [Equal] outputs: [581 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_454 [Where] TRT - VERBOSE Searching for input: 581 TRT - VERBOSE Searching for input: 578 TRT - VERBOSE Searching for input: 567 TRT - VERBOSE Where_454 [Where] inputs: [581 -> (2)[BOOL]], [578 -> (2)[INT32]], [567 -> (2)[INT32]], TRT - VERBOSE Registering layer: 578 for ONNX node: 578 TRT - VERBOSE Registering layer: Where_454 for ONNX node: Where_454 TRT - VERBOSE Registering tensor: 582 for ONNX tensor: 582 TRT - VERBOSE Where_454 [Where] outputs: [582 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_455 [Expand] TRT - VERBOSE Searching for input: 562 TRT - VERBOSE Searching for input: 582 TRT - VERBOSE Expand_455 [Expand] inputs: [562 -> (1)[INT32]], [582 -> (2)[INT32]], TRT - VERBOSE Registering layer: 562 for ONNX node: 562 TRT - VERBOSE Registering layer: Expand_455 for ONNX node: Expand_455 TRT - VERBOSE Registering tensor: 583 for ONNX tensor: 583 TRT - VERBOSE Expand_455 [Expand] outputs: [583 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_457 [Unsqueeze] TRT - VERBOSE Searching for input: 583 TRT - VERBOSE Searching for input: 584 TRT - VERBOSE Unsqueeze_457 [Unsqueeze] inputs: [583 -> (3000, 1)[INT32]], [584 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_457 for ONNX node: Unsqueeze_457 TRT - VERBOSE Registering tensor: 585 for ONNX tensor: 585 TRT - VERBOSE Unsqueeze_457 [Unsqueeze] outputs: [585 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Concat_458 [Concat] TRT - VERBOSE Searching for input: 576 TRT - VERBOSE Searching for input: 585 TRT - VERBOSE Concat_458 [Concat] inputs: [576 -> (3000, 1, 1)[INT32]], [585 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Registering layer: Concat_458 for ONNX node: Concat_458 TRT - VERBOSE Registering tensor: 586 for ONNX tensor: 586 TRT - VERBOSE Concat_458 [Concat] outputs: [586 -> (3000, 1, 2)[INT32]], TRT - VERBOSE Parsing node: Concat_464 [Concat] TRT - VERBOSE Searching for input: 567 TRT - VERBOSE Searching for input: 591 TRT - VERBOSE Concat_464 [Concat] inputs: [567 -> (2)[INT32]], [591 -> (0)[INT32]], TRT - VERBOSE Registering layer: Concat_464 for ONNX node: Concat_464 TRT - VERBOSE Registering tensor: 592 for ONNX tensor: 592 TRT - VERBOSE Concat_464 [Concat] outputs: [592 -> (2)[INT32]], TRT - VERBOSE Parsing node: Reshape_465 [Reshape] TRT - VERBOSE Searching for input: 554 TRT - VERBOSE Searching for input: 592 TRT - VERBOSE Reshape_465 [Reshape] inputs: [554 -> (3000)[INT32]], [592 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_465 for ONNX node: Reshape_465 TRT - VERBOSE Registering tensor: 593 for ONNX tensor: 593 TRT - VERBOSE Reshape_465 [Reshape] outputs: [593 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Cast_466 [Cast] TRT - VERBOSE Searching for input: 593 TRT - VERBOSE Cast_466 [Cast] inputs: [593 -> (3000, 1)[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_466 for ONNX node: Cast_466 TRT - VERBOSE Registering tensor: 594 for ONNX tensor: 594 TRT - VERBOSE Cast_466 [Cast] outputs: [594 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: ScatterND_467 [ScatterND] TRT - VERBOSE Searching for input: 544 TRT - VERBOSE Searching for input: 586 TRT - VERBOSE Searching for input: 594 TRT - VERBOSE ScatterND_467 [ScatterND] inputs: [544 -> (3000, 2)[INT32]], [586 -> (3000, 1, 2)[INT32]], [594 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: ScatterND_467 for ONNX node: ScatterND_467 TRT - VERBOSE Registering tensor: 595 for ONNX tensor: 595 TRT - VERBOSE ScatterND_467 [ScatterND] outputs: [595 -> (3000, 2)[INT32]], TRT - VERBOSE Parsing node: Shape_469 [Shape] TRT - VERBOSE Searching for input: 481 TRT - VERBOSE Shape_469 [Shape] inputs: [481 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Shape_469 for ONNX node: Shape_469 TRT - VERBOSE Registering tensor: 597 for ONNX tensor: 597 TRT - VERBOSE Shape_469 [Shape] outputs: [597 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_471 [Unsqueeze] TRT - VERBOSE Searching for input: 481 TRT - VERBOSE Searching for input: 598 TRT - VERBOSE Unsqueeze_471 [Unsqueeze] inputs: [481 -> (3000)[INT32]], [598 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000,), unsqueezing to: (3000, 1) TRT - VERBOSE Registering layer: Unsqueeze_471 for ONNX node: Unsqueeze_471 TRT - VERBOSE Registering tensor: 599 for ONNX tensor: 599 TRT - VERBOSE Unsqueeze_471 [Unsqueeze] outputs: [599 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Shape_472 [Shape] TRT - VERBOSE Searching for input: 476 TRT - VERBOSE Shape_472 [Shape] inputs: [476 -> (-1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_472 for ONNX node: Shape_472 TRT - VERBOSE Registering tensor: 600 for ONNX tensor: 600 TRT - VERBOSE Shape_472 [Shape] outputs: [600 -> (1)[INT32]], TRT - VERBOSE Parsing node: Slice_476 [Slice] TRT - VERBOSE Searching for input: 600 TRT - VERBOSE Searching for input: 602 TRT - VERBOSE Searching for input: 603 TRT - VERBOSE Searching for input: 601 TRT - VERBOSE Slice_476 [Slice] inputs: [600 -> (1)[INT32]], [602 -> (1)[INT32]], [603 -> (1)[INT32]], [601 -> (1)[INT32]], TRT - VERBOSE Registering layer: Slice_476 for ONNX node: Slice_476 TRT - VERBOSE Registering tensor: 604 for ONNX tensor: 604 TRT - VERBOSE Slice_476 [Slice] outputs: [604 -> (0)[INT32]], TRT - VERBOSE Parsing node: Concat_477 [Concat] TRT - VERBOSE Searching for input: 597 TRT - VERBOSE Searching for input: 604 TRT - VERBOSE Concat_477 [Concat] inputs: [597 -> (1)[INT32]], [604 -> (0)[INT32]], TRT - VERBOSE Registering layer: Concat_477 for ONNX node: Concat_477 TRT - VERBOSE Registering tensor: 605 for ONNX tensor: 605 TRT - VERBOSE Concat_477 [Concat] outputs: [605 -> (1)[INT32]], TRT - VERBOSE Parsing node: Shape_478 [Shape] TRT - VERBOSE Searching for input: 605 TRT - VERBOSE Shape_478 [Shape] inputs: [605 -> (1)[INT32]], TRT - VERBOSE Registering layer: Shape_478 for ONNX node: Shape_478 TRT - VERBOSE Registering tensor: 606 for ONNX tensor: 606 TRT - VERBOSE Shape_478 [Shape] outputs: [606 -> (1)[INT32]], TRT - VERBOSE Parsing node: ConstantOfShape_479 [ConstantOfShape] TRT - VERBOSE Searching for input: 606 TRT - VERBOSE ConstantOfShape_479 [ConstantOfShape] inputs: [606 -> (1)[INT32]], TRT - VERBOSE Registering layer: ConstantOfShape_479 for ONNX node: ConstantOfShape_479 TRT - VERBOSE Registering tensor: 607 for ONNX tensor: 607 TRT - VERBOSE ConstantOfShape_479 [ConstantOfShape] outputs: [607 -> (1)[INT32]], TRT - VERBOSE Parsing node: Mul_481 [Mul] TRT - VERBOSE Searching for input: 607 TRT - VERBOSE Searching for input: 608 TRT - VERBOSE Mul_481 [Mul] inputs: [607 -> (1)[INT32]], [608 -> ()[INT32]], TRT - VERBOSE Registering layer: 608 for ONNX node: 608 TRT - VERBOSE Registering layer: Mul_481 for ONNX node: Mul_481 TRT - VERBOSE Registering tensor: 609 for ONNX tensor: 609 TRT - VERBOSE Mul_481 [Mul] outputs: [609 -> (1)[INT32]], TRT - VERBOSE Parsing node: Equal_482 [Equal] TRT - VERBOSE Searching for input: 605 TRT - VERBOSE Searching for input: 609 TRT - VERBOSE Equal_482 [Equal] inputs: [605 -> (1)[INT32]], [609 -> (1)[INT32]], TRT - VERBOSE Registering layer: Equal_482 for ONNX node: Equal_482 TRT - VERBOSE Registering tensor: 610 for ONNX tensor: 610 TRT - VERBOSE Equal_482 [Equal] outputs: [610 -> (1)[BOOL]], TRT - VERBOSE Parsing node: Where_483 [Where] TRT - VERBOSE Searching for input: 610 TRT - VERBOSE Searching for input: 607 TRT - VERBOSE Searching for input: 605 TRT - VERBOSE Where_483 [Where] inputs: [610 -> (1)[BOOL]], [607 -> (1)[INT32]], [605 -> (1)[INT32]], TRT - VERBOSE Registering layer: Where_483 for ONNX node: Where_483 TRT - VERBOSE Registering tensor: 611 for ONNX tensor: 611 TRT - VERBOSE Where_483 [Where] outputs: [611 -> (1)[INT32]], TRT - VERBOSE Parsing node: Expand_484 [Expand] TRT - VERBOSE Searching for input: 596 TRT - VERBOSE Searching for input: 611 TRT - VERBOSE Expand_484 [Expand] inputs: [596 -> ()[FLOAT]], [611 -> (1)[INT32]], TRT - VERBOSE Registering layer: 596 for ONNX node: 596 TRT - VERBOSE Registering layer: Expand_484 for ONNX node: Expand_484 TRT - VERBOSE Registering tensor: 612 for ONNX tensor: 612 TRT - VERBOSE Expand_484 [Expand] outputs: [612 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Reshape_485 [Reshape] TRT - VERBOSE Searching for input: 612 TRT - VERBOSE Searching for input: 605 TRT - VERBOSE Reshape_485 [Reshape] inputs: [612 -> (3000)[FLOAT]], [605 -> (1)[INT32]], TRT - VERBOSE Registering layer: Reshape_485 for ONNX node: Reshape_485 TRT - VERBOSE Registering tensor: 613 for ONNX tensor: 613 TRT - VERBOSE Reshape_485 [Reshape] outputs: [613 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: ScatterND_486 [ScatterND] TRT - VERBOSE Searching for input: 476 TRT - VERBOSE Searching for input: 599 TRT - VERBOSE Searching for input: 613 TRT - VERBOSE ScatterND_486 [ScatterND] inputs: [476 -> (-1)[FLOAT]], [599 -> (3000, 1)[INT32]], [613 -> (3000)[FLOAT]], TRT - VERBOSE Registering layer: ScatterND_486 for ONNX node: ScatterND_486 TRT - VERBOSE Registering tensor: 614 for ONNX tensor: 614 TRT - VERBOSE ScatterND_486 [ScatterND] outputs: [614 -> (-1)[FLOAT]], TRT - VERBOSE Parsing node: TopK_487 [TopK] TRT - VERBOSE Searching for input: 614 TRT - VERBOSE Searching for input: 1221 TRT - VERBOSE TopK_487 [TopK] inputs: [614 -> (-1)[FLOAT]], [1221 -> (1)[INT32]], TRT - VERBOSE Original shape: (_,), unsqueezing to: (_, _) TRT - VERBOSE Registering layer: TopK_487 for ONNX node: TopK_487 TRT - VERBOSE Original shape: (3000, 1), squeezing to: (3000,) TRT - VERBOSE Original shape: (3000, 1), squeezing to: (3000,) TRT - VERBOSE Registering tensor: 618 for ONNX tensor: 618 TRT - VERBOSE Registering tensor: 619 for ONNX tensor: 619 TRT - VERBOSE TopK_487 [TopK] outputs: [618 -> (3000)[FLOAT]], [619 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_488 [Shape] TRT - VERBOSE Searching for input: 618 TRT - VERBOSE Shape_488 [Shape] inputs: [618 -> (3000)[FLOAT]], TRT - VERBOSE Registering layer: Shape_488 for ONNX node: Shape_488 TRT - VERBOSE Registering tensor: 620 for ONNX tensor: 620 TRT - VERBOSE Shape_488 [Shape] outputs: [620 -> (1)[INT32]], TRT - VERBOSE Parsing node: Gather_490 [Gather] TRT - VERBOSE Searching for input: 620 TRT - VERBOSE Searching for input: 621 TRT - VERBOSE Gather_490 [Gather] inputs: [620 -> (1)[INT32]], [621 -> ()[INT32]], TRT - VERBOSE Registering layer: 621 for ONNX node: 621 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_490 for ONNX node: Gather_490 TRT - VERBOSE Registering tensor: 622 for ONNX tensor: 622 TRT - VERBOSE Gather_490 [Gather] outputs: [622 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_492 [Unsqueeze] TRT - VERBOSE Searching for input: 622 TRT - VERBOSE Searching for input: 624 TRT - VERBOSE Unsqueeze_492 [Unsqueeze] inputs: [622 -> ()[INT32]], [624 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_492 for ONNX node: Unsqueeze_492 TRT - VERBOSE Registering tensor: 625 for ONNX tensor: 625 TRT - VERBOSE Unsqueeze_492 [Unsqueeze] outputs: [625 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_493 [Concat] TRT - VERBOSE Searching for input: 625 TRT - VERBOSE Searching for input: 1222 TRT - VERBOSE Concat_493 [Concat] inputs: [625 -> (1)[INT32]], [1222 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1222 for ONNX node: 1222 TRT - VERBOSE Registering layer: Concat_493 for ONNX node: Concat_493 TRT - VERBOSE Registering tensor: 628 for ONNX tensor: 628 TRT - VERBOSE Concat_493 [Concat] outputs: [628 -> (2)[INT32]], TRT - VERBOSE Parsing node: ConstantOfShape_494 [ConstantOfShape] TRT - VERBOSE Searching for input: 628 TRT - VERBOSE ConstantOfShape_494 [ConstantOfShape] inputs: [628 -> (2)[INT32]], TRT - VERBOSE Registering layer: ConstantOfShape_494 for ONNX node: ConstantOfShape_494 TRT - VERBOSE Registering tensor: 629 for ONNX tensor: 629 TRT - VERBOSE ConstantOfShape_494 [ConstantOfShape] outputs: [629 -> (3000, 2)[FLOAT]], TRT - VERBOSE Parsing node: RandomUniformLike_495 [RandomUniformLike] TRT - VERBOSE Searching for input: 629 TRT - VERBOSE RandomUniformLike_495 [RandomUniformLike] inputs: [629 -> (3000, 2)[FLOAT]], TRT - VERBOSE Registering layer: RandomUniformLike_495 for ONNX node: RandomUniformLike_495 TRT - VERBOSE Registering tensor: 630 for ONNX tensor: 630 TRT - VERBOSE RandomUniformLike_495 [RandomUniformLike] outputs: [630 -> (3000, 2)[FLOAT]], TRT - VERBOSE Parsing node: Cast_496 [Cast] TRT - VERBOSE Searching for input: 630 TRT - VERBOSE Cast_496 [Cast] inputs: [630 -> (3000, 2)[FLOAT]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_496 for ONNX node: Cast_496 TRT - VERBOSE Registering tensor: 631 for ONNX tensor: 631 TRT - VERBOSE Cast_496 [Cast] outputs: [631 -> (3000, 2)[INT32]], TRT - VERBOSE Parsing node: Shape_497 [Shape] TRT - VERBOSE Searching for input: 459 TRT - VERBOSE Shape_497 [Shape] inputs: [459 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Registering layer: Shape_497 for ONNX node: Shape_497 TRT - VERBOSE Registering tensor: 632 for ONNX tensor: 632 TRT - VERBOSE Shape_497 [Shape] outputs: [632 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_499 [Gather] TRT - VERBOSE Searching for input: 632 TRT - VERBOSE Searching for input: 633 TRT - VERBOSE Gather_499 [Gather] inputs: [632 -> (4)[INT32]], [633 -> ()[INT32]], TRT - VERBOSE Registering layer: 633 for ONNX node: 633 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_499 for ONNX node: Gather_499 TRT - VERBOSE Registering tensor: 634 for ONNX tensor: 634 TRT - VERBOSE Gather_499 [Gather] outputs: [634 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_500 [Cast] TRT - VERBOSE Searching for input: 619 TRT - VERBOSE Cast_500 [Cast] inputs: [619 -> (3000)[INT32]], TRT - VERBOSE Casting to type: float32 TRT - VERBOSE Registering layer: Cast_500 for ONNX node: Cast_500 TRT - VERBOSE Registering tensor: 635 for ONNX tensor: 635 TRT - VERBOSE Cast_500 [Cast] outputs: [635 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Cast_501 [Cast] TRT - VERBOSE Searching for input: 634 TRT - VERBOSE Cast_501 [Cast] inputs: [634 -> ()[INT32]], TRT - VERBOSE Casting to type: float32 TRT - VERBOSE Registering layer: Cast_501 for ONNX node: Cast_501 TRT - VERBOSE Registering tensor: 636 for ONNX tensor: 636 TRT - VERBOSE Cast_501 [Cast] outputs: [636 -> ()[FLOAT]], TRT - VERBOSE Parsing node: Div_502 [Div] TRT - VERBOSE Searching for input: 635 TRT - VERBOSE Searching for input: 636 TRT - VERBOSE Div_502 [Div] inputs: [635 -> (3000)[FLOAT]], [636 -> ()[FLOAT]], TRT - VERBOSE Registering layer: Div_502 for ONNX node: Div_502 TRT - VERBOSE Registering tensor: 637 for ONNX tensor: 637 TRT - VERBOSE Div_502 [Div] outputs: [637 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Gather_504 [Gather] TRT - VERBOSE Searching for input: 631 TRT - VERBOSE Searching for input: 638 TRT - VERBOSE Gather_504 [Gather] inputs: [631 -> (3000, 2)[INT32]], [638 -> ()[INT32]], TRT - VERBOSE Registering layer: 638 for ONNX node: 638 TRT - VERBOSE Using Gather axis: 1 TRT - VERBOSE Registering layer: Gather_504 for ONNX node: Gather_504 TRT - VERBOSE Registering tensor: 639 for ONNX tensor: 639 TRT - VERBOSE Gather_504 [Gather] outputs: [639 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_505 [Shape] TRT - VERBOSE Searching for input: 639 TRT - VERBOSE Shape_505 [Shape] inputs: [639 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Shape_505 for ONNX node: Shape_505 TRT - VERBOSE Registering tensor: 640 for ONNX tensor: 640 TRT - VERBOSE Shape_505 [Shape] outputs: [640 -> (1)[INT32]], TRT - VERBOSE Parsing node: Expand_506 [Expand] TRT - VERBOSE Searching for input: 637 TRT - VERBOSE Searching for input: 640 TRT - VERBOSE Expand_506 [Expand] inputs: [637 -> (3000)[FLOAT]], [640 -> (1)[INT32]], TRT - VERBOSE Registering layer: Expand_506 for ONNX node: Expand_506 TRT - VERBOSE Registering tensor: 641 for ONNX tensor: 641 TRT - VERBOSE Expand_506 [Expand] outputs: [641 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Shape_507 [Shape] TRT - VERBOSE Searching for input: 631 TRT - VERBOSE Shape_507 [Shape] inputs: [631 -> (3000, 2)[INT32]], TRT - VERBOSE Registering layer: Shape_507 for ONNX node: Shape_507 TRT - VERBOSE Registering tensor: 642 for ONNX tensor: 642 TRT - VERBOSE Shape_507 [Shape] outputs: [642 -> (2)[INT32]], TRT - VERBOSE Parsing node: Gather_509 [Gather] TRT - VERBOSE Searching for input: 642 TRT - VERBOSE Searching for input: 643 TRT - VERBOSE Gather_509 [Gather] inputs: [642 -> (2)[INT32]], [643 -> ()[INT32]], TRT - VERBOSE Registering layer: 643 for ONNX node: 643 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_509 for ONNX node: Gather_509 TRT - VERBOSE Registering tensor: 644 for ONNX tensor: 644 TRT - VERBOSE Gather_509 [Gather] outputs: [644 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_510 [Cast] TRT - VERBOSE Searching for input: 644 TRT - VERBOSE Cast_510 [Cast] inputs: [644 -> ()[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_510 for ONNX node: Cast_510 TRT - VERBOSE Registering tensor: 645 for ONNX tensor: 645 TRT - VERBOSE Cast_510 [Cast] outputs: [645 -> ()[INT32]], TRT - VERBOSE Parsing node: Range_513 [Range] TRT - VERBOSE Searching for input: 646 TRT - VERBOSE Searching for input: 645 TRT - VERBOSE Searching for input: 647 TRT - VERBOSE Range_513 [Range] inputs: [646 -> ()[INT32]], [645 -> ()[INT32]], [647 -> ()[INT32]], TRT - VERBOSE Registering layer: Range_513 for ONNX node: Range_513 TRT - VERBOSE Registering tensor: 648 for ONNX tensor: 648 TRT - VERBOSE Range_513 [Range] outputs: [648 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Reshape_516 [Reshape] TRT - VERBOSE Searching for input: 648 TRT - VERBOSE Searching for input: 650 TRT - VERBOSE Reshape_516 [Reshape] inputs: [648 -> (3000)[INT32]], [650 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_516 for ONNX node: Reshape_516 TRT - VERBOSE Registering tensor: 651 for ONNX tensor: 651 TRT - VERBOSE Reshape_516 [Reshape] outputs: [651 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Add_518 [Add] TRT - VERBOSE Searching for input: 651 TRT - VERBOSE Searching for input: 652 TRT - VERBOSE Add_518 [Add] inputs: [651 -> (3000, 1)[INT32]], [652 -> (1)[INT32]], TRT - VERBOSE Registering layer: 652 for ONNX node: 652 TRT - VERBOSE Registering layer: Add_518 for ONNX node: Add_518 TRT - VERBOSE Registering tensor: 653 for ONNX tensor: 653 TRT - VERBOSE Add_518 [Add] outputs: [653 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Shape_519 [Shape] TRT - VERBOSE Searching for input: 653 TRT - VERBOSE Shape_519 [Shape] inputs: [653 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: Shape_519 for ONNX node: Shape_519 TRT - VERBOSE Registering tensor: 654 for ONNX tensor: 654 TRT - VERBOSE Shape_519 [Shape] outputs: [654 -> (2)[INT32]], TRT - VERBOSE Parsing node: Equal_524 [Equal] TRT - VERBOSE Searching for input: 654 TRT - VERBOSE Searching for input: 658 TRT - VERBOSE Equal_524 [Equal] inputs: [654 -> (2)[INT32]], [658 -> (2)[INT32]], TRT - VERBOSE Registering layer: 658 for ONNX node: 658 TRT - VERBOSE Registering layer: Equal_524 for ONNX node: Equal_524 TRT - VERBOSE Registering tensor: 659 for ONNX tensor: 659 TRT - VERBOSE Equal_524 [Equal] outputs: [659 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_525 [Where] TRT - VERBOSE Searching for input: 659 TRT - VERBOSE Searching for input: 656 TRT - VERBOSE Searching for input: 654 TRT - VERBOSE Where_525 [Where] inputs: [659 -> (2)[BOOL]], [656 -> (2)[INT32]], [654 -> (2)[INT32]], TRT - VERBOSE Registering layer: 656 for ONNX node: 656 TRT - VERBOSE Registering layer: Where_525 for ONNX node: Where_525 TRT - VERBOSE Registering tensor: 660 for ONNX tensor: 660 TRT - VERBOSE Where_525 [Where] outputs: [660 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_526 [Expand] TRT - VERBOSE Searching for input: 651 TRT - VERBOSE Searching for input: 660 TRT - VERBOSE Expand_526 [Expand] inputs: [651 -> (3000, 1)[INT32]], [660 -> (2)[INT32]], TRT - VERBOSE Registering layer: Expand_526 for ONNX node: Expand_526 TRT - VERBOSE Registering tensor: 661 for ONNX tensor: 661 TRT - VERBOSE Expand_526 [Expand] outputs: [661 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_528 [Unsqueeze] TRT - VERBOSE Searching for input: 661 TRT - VERBOSE Searching for input: 662 TRT - VERBOSE Unsqueeze_528 [Unsqueeze] inputs: [661 -> (3000, 1)[INT32]], [662 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_528 for ONNX node: Unsqueeze_528 TRT - VERBOSE Registering tensor: 663 for ONNX tensor: 663 TRT - VERBOSE Unsqueeze_528 [Unsqueeze] outputs: [663 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Equal_533 [Equal] TRT - VERBOSE Searching for input: 654 TRT - VERBOSE Searching for input: 667 TRT - VERBOSE Equal_533 [Equal] inputs: [654 -> (2)[INT32]], [667 -> (2)[INT32]], TRT - VERBOSE Registering layer: 667 for ONNX node: 667 TRT - VERBOSE Registering layer: Equal_533 for ONNX node: Equal_533 TRT - VERBOSE Registering tensor: 668 for ONNX tensor: 668 TRT - VERBOSE Equal_533 [Equal] outputs: [668 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_534 [Where] TRT - VERBOSE Searching for input: 668 TRT - VERBOSE Searching for input: 665 TRT - VERBOSE Searching for input: 654 TRT - VERBOSE Where_534 [Where] inputs: [668 -> (2)[BOOL]], [665 -> (2)[INT32]], [654 -> (2)[INT32]], TRT - VERBOSE Registering layer: 665 for ONNX node: 665 TRT - VERBOSE Registering layer: Where_534 for ONNX node: Where_534 TRT - VERBOSE Registering tensor: 669 for ONNX tensor: 669 TRT - VERBOSE Where_534 [Where] outputs: [669 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_535 [Expand] TRT - VERBOSE Searching for input: 649 TRT - VERBOSE Searching for input: 669 TRT - VERBOSE Expand_535 [Expand] inputs: [649 -> (1)[INT32]], [669 -> (2)[INT32]], TRT - VERBOSE Registering layer: 649 for ONNX node: 649 TRT - VERBOSE Registering layer: Expand_535 for ONNX node: Expand_535 TRT - VERBOSE Registering tensor: 670 for ONNX tensor: 670 TRT - VERBOSE Expand_535 [Expand] outputs: [670 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_537 [Unsqueeze] TRT - VERBOSE Searching for input: 670 TRT - VERBOSE Searching for input: 671 TRT - VERBOSE Unsqueeze_537 [Unsqueeze] inputs: [670 -> (3000, 1)[INT32]], [671 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_537 for ONNX node: Unsqueeze_537 TRT - VERBOSE Registering tensor: 672 for ONNX tensor: 672 TRT - VERBOSE Unsqueeze_537 [Unsqueeze] outputs: [672 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Concat_538 [Concat] TRT - VERBOSE Searching for input: 663 TRT - VERBOSE Searching for input: 672 TRT - VERBOSE Concat_538 [Concat] inputs: [663 -> (3000, 1, 1)[INT32]], [672 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Registering layer: Concat_538 for ONNX node: Concat_538 TRT - VERBOSE Registering tensor: 673 for ONNX tensor: 673 TRT - VERBOSE Concat_538 [Concat] outputs: [673 -> (3000, 1, 2)[INT32]], TRT - VERBOSE Parsing node: Concat_544 [Concat] TRT - VERBOSE Searching for input: 654 TRT - VERBOSE Searching for input: 678 TRT - VERBOSE Concat_544 [Concat] inputs: [654 -> (2)[INT32]], [678 -> (0)[INT32]], TRT - VERBOSE Registering layer: Concat_544 for ONNX node: Concat_544 TRT - VERBOSE Registering tensor: 679 for ONNX tensor: 679 TRT - VERBOSE Concat_544 [Concat] outputs: [679 -> (2)[INT32]], TRT - VERBOSE Parsing node: Reshape_545 [Reshape] TRT - VERBOSE Searching for input: 641 TRT - VERBOSE Searching for input: 679 TRT - VERBOSE Reshape_545 [Reshape] inputs: [641 -> (3000)[FLOAT]], [679 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_545 for ONNX node: Reshape_545 TRT - VERBOSE Registering tensor: 680 for ONNX tensor: 680 TRT - VERBOSE Reshape_545 [Reshape] outputs: [680 -> (3000, 1)[FLOAT]], TRT - VERBOSE Parsing node: Cast_546 [Cast] TRT - VERBOSE Searching for input: 680 TRT - VERBOSE Cast_546 [Cast] inputs: [680 -> (3000, 1)[FLOAT]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_546 for ONNX node: Cast_546 TRT - VERBOSE Registering tensor: 681 for ONNX tensor: 681 TRT - VERBOSE Cast_546 [Cast] outputs: [681 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: ScatterND_547 [ScatterND] TRT - VERBOSE Searching for input: 631 TRT - VERBOSE Searching for input: 673 TRT - VERBOSE Searching for input: 681 TRT - VERBOSE ScatterND_547 [ScatterND] inputs: [631 -> (3000, 2)[INT32]], [673 -> (3000, 1, 2)[INT32]], [681 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: ScatterND_547 for ONNX node: ScatterND_547 TRT - VERBOSE Registering tensor: 682 for ONNX tensor: 682 TRT - VERBOSE ScatterND_547 [ScatterND] outputs: [682 -> (3000, 2)[INT32]], TRT - VERBOSE Parsing node: Shape_548 [Shape] TRT - VERBOSE Searching for input: 459 TRT - VERBOSE Shape_548 [Shape] inputs: [459 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Registering layer: Shape_548 for ONNX node: Shape_548 TRT - VERBOSE Registering tensor: 683 for ONNX tensor: 683 TRT - VERBOSE Shape_548 [Shape] outputs: [683 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_550 [Gather] TRT - VERBOSE Searching for input: 683 TRT - VERBOSE Searching for input: 684 TRT - VERBOSE Gather_550 [Gather] inputs: [683 -> (4)[INT32]], [684 -> ()[INT32]], TRT - VERBOSE Registering layer: 684 for ONNX node: 684 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_550 for ONNX node: Gather_550 TRT - VERBOSE Registering tensor: 685 for ONNX tensor: 685 TRT - VERBOSE Gather_550 [Gather] outputs: [685 -> ()[INT32]], TRT - VERBOSE Parsing node: Div_551 [Div] TRT - VERBOSE Searching for input: 619 TRT - VERBOSE Searching for input: 685 TRT - VERBOSE Div_551 [Div] inputs: [619 -> (3000)[INT32]], [685 -> ()[INT32]], TRT - VERBOSE Registering layer: Div_551 for ONNX node: Div_551 TRT - VERBOSE Registering tensor: 686 for ONNX tensor: 686 TRT - VERBOSE Div_551 [Div] outputs: [686 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Mul_552 [Mul] TRT - VERBOSE Searching for input: 686 TRT - VERBOSE Searching for input: 685 TRT - VERBOSE Mul_552 [Mul] inputs: [686 -> (3000)[INT32]], [685 -> ()[INT32]], TRT - VERBOSE Registering layer: Mul_552 for ONNX node: Mul_552 TRT - VERBOSE Registering tensor: 687 for ONNX tensor: 687 TRT - VERBOSE Mul_552 [Mul] outputs: [687 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Sub_553 [Sub] TRT - VERBOSE Searching for input: 619 TRT - VERBOSE Searching for input: 687 TRT - VERBOSE Sub_553 [Sub] inputs: [619 -> (3000)[INT32]], [687 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Sub_553 for ONNX node: Sub_553 TRT - VERBOSE Registering tensor: 688 for ONNX tensor: 688 TRT - VERBOSE Sub_553 [Sub] outputs: [688 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Gather_555 [Gather] TRT - VERBOSE Searching for input: 682 TRT - VERBOSE Searching for input: 689 TRT - VERBOSE Gather_555 [Gather] inputs: [682 -> (3000, 2)[INT32]], [689 -> ()[INT32]], TRT - VERBOSE Registering layer: 689 for ONNX node: 689 TRT - VERBOSE Using Gather axis: 1 TRT - VERBOSE Registering layer: Gather_555 for ONNX node: Gather_555 TRT - VERBOSE Registering tensor: 690 for ONNX tensor: 690 TRT - VERBOSE Gather_555 [Gather] outputs: [690 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_556 [Shape] TRT - VERBOSE Searching for input: 690 TRT - VERBOSE Shape_556 [Shape] inputs: [690 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Shape_556 for ONNX node: Shape_556 TRT - VERBOSE Registering tensor: 691 for ONNX tensor: 691 TRT - VERBOSE Shape_556 [Shape] outputs: [691 -> (1)[INT32]], TRT - VERBOSE Parsing node: Expand_557 [Expand] TRT - VERBOSE Searching for input: 688 TRT - VERBOSE Searching for input: 691 TRT - VERBOSE Expand_557 [Expand] inputs: [688 -> (3000)[INT32]], [691 -> (1)[INT32]], TRT - VERBOSE Registering layer: Expand_557 for ONNX node: Expand_557 TRT - VERBOSE Registering tensor: 692 for ONNX tensor: 692 TRT - VERBOSE Expand_557 [Expand] outputs: [692 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_558 [Shape] TRT - VERBOSE Searching for input: 682 TRT - VERBOSE Shape_558 [Shape] inputs: [682 -> (3000, 2)[INT32]], TRT - VERBOSE Registering layer: Shape_558 for ONNX node: Shape_558 TRT - VERBOSE Registering tensor: 693 for ONNX tensor: 693 TRT - VERBOSE Shape_558 [Shape] outputs: [693 -> (2)[INT32]], TRT - VERBOSE Parsing node: Gather_560 [Gather] TRT - VERBOSE Searching for input: 693 TRT - VERBOSE Searching for input: 694 TRT - VERBOSE Gather_560 [Gather] inputs: [693 -> (2)[INT32]], [694 -> ()[INT32]], TRT - VERBOSE Registering layer: 694 for ONNX node: 694 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_560 for ONNX node: Gather_560 TRT - VERBOSE Registering tensor: 695 for ONNX tensor: 695 TRT - VERBOSE Gather_560 [Gather] outputs: [695 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_561 [Cast] TRT - VERBOSE Searching for input: 695 TRT - VERBOSE Cast_561 [Cast] inputs: [695 -> ()[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_561 for ONNX node: Cast_561 TRT - VERBOSE Registering tensor: 696 for ONNX tensor: 696 TRT - VERBOSE Cast_561 [Cast] outputs: [696 -> ()[INT32]], TRT - VERBOSE Parsing node: Range_564 [Range] TRT - VERBOSE Searching for input: 697 TRT - VERBOSE Searching for input: 696 TRT - VERBOSE Searching for input: 698 TRT - VERBOSE Range_564 [Range] inputs: [697 -> ()[INT32]], [696 -> ()[INT32]], [698 -> ()[INT32]], TRT - VERBOSE Registering layer: Range_564 for ONNX node: Range_564 TRT - VERBOSE Registering tensor: 699 for ONNX tensor: 699 TRT - VERBOSE Range_564 [Range] outputs: [699 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Reshape_567 [Reshape] TRT - VERBOSE Searching for input: 699 TRT - VERBOSE Searching for input: 701 TRT - VERBOSE Reshape_567 [Reshape] inputs: [699 -> (3000)[INT32]], [701 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_567 for ONNX node: Reshape_567 TRT - VERBOSE Registering tensor: 702 for ONNX tensor: 702 TRT - VERBOSE Reshape_567 [Reshape] outputs: [702 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Add_569 [Add] TRT - VERBOSE Searching for input: 702 TRT - VERBOSE Searching for input: 703 TRT - VERBOSE Add_569 [Add] inputs: [702 -> (3000, 1)[INT32]], [703 -> (1)[INT32]], TRT - VERBOSE Registering layer: 703 for ONNX node: 703 TRT - VERBOSE Registering layer: Add_569 for ONNX node: Add_569 TRT - VERBOSE Registering tensor: 704 for ONNX tensor: 704 TRT - VERBOSE Add_569 [Add] outputs: [704 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Shape_570 [Shape] TRT - VERBOSE Searching for input: 704 TRT - VERBOSE Shape_570 [Shape] inputs: [704 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: Shape_570 for ONNX node: Shape_570 TRT - VERBOSE Registering tensor: 705 for ONNX tensor: 705 TRT - VERBOSE Shape_570 [Shape] outputs: [705 -> (2)[INT32]], TRT - VERBOSE Parsing node: Equal_575 [Equal] TRT - VERBOSE Searching for input: 705 TRT - VERBOSE Searching for input: 709 TRT - VERBOSE Equal_575 [Equal] inputs: [705 -> (2)[INT32]], [709 -> (2)[INT32]], TRT - VERBOSE Registering layer: 709 for ONNX node: 709 TRT - VERBOSE Registering layer: Equal_575 for ONNX node: Equal_575 TRT - VERBOSE Registering tensor: 710 for ONNX tensor: 710 TRT - VERBOSE Equal_575 [Equal] outputs: [710 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_576 [Where] TRT - VERBOSE Searching for input: 710 TRT - VERBOSE Searching for input: 707 TRT - VERBOSE Searching for input: 705 TRT - VERBOSE Where_576 [Where] inputs: [710 -> (2)[BOOL]], [707 -> (2)[INT32]], [705 -> (2)[INT32]], TRT - VERBOSE Registering layer: 707 for ONNX node: 707 TRT - VERBOSE Registering layer: Where_576 for ONNX node: Where_576 TRT - VERBOSE Registering tensor: 711 for ONNX tensor: 711 TRT - VERBOSE Where_576 [Where] outputs: [711 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_577 [Expand] TRT - VERBOSE Searching for input: 702 TRT - VERBOSE Searching for input: 711 TRT - VERBOSE Expand_577 [Expand] inputs: [702 -> (3000, 1)[INT32]], [711 -> (2)[INT32]], TRT - VERBOSE Registering layer: Expand_577 for ONNX node: Expand_577 TRT - VERBOSE Registering tensor: 712 for ONNX tensor: 712 TRT - VERBOSE Expand_577 [Expand] outputs: [712 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_579 [Unsqueeze] TRT - VERBOSE Searching for input: 712 TRT - VERBOSE Searching for input: 713 TRT - VERBOSE Unsqueeze_579 [Unsqueeze] inputs: [712 -> (3000, 1)[INT32]], [713 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_579 for ONNX node: Unsqueeze_579 TRT - VERBOSE Registering tensor: 714 for ONNX tensor: 714 TRT - VERBOSE Unsqueeze_579 [Unsqueeze] outputs: [714 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Equal_584 [Equal] TRT - VERBOSE Searching for input: 705 TRT - VERBOSE Searching for input: 718 TRT - VERBOSE Equal_584 [Equal] inputs: [705 -> (2)[INT32]], [718 -> (2)[INT32]], TRT - VERBOSE Registering layer: 718 for ONNX node: 718 TRT - VERBOSE Registering layer: Equal_584 for ONNX node: Equal_584 TRT - VERBOSE Registering tensor: 719 for ONNX tensor: 719 TRT - VERBOSE Equal_584 [Equal] outputs: [719 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_585 [Where] TRT - VERBOSE Searching for input: 719 TRT - VERBOSE Searching for input: 716 TRT - VERBOSE Searching for input: 705 TRT - VERBOSE Where_585 [Where] inputs: [719 -> (2)[BOOL]], [716 -> (2)[INT32]], [705 -> (2)[INT32]], TRT - VERBOSE Registering layer: 716 for ONNX node: 716 TRT - VERBOSE Registering layer: Where_585 for ONNX node: Where_585 TRT - VERBOSE Registering tensor: 720 for ONNX tensor: 720 TRT - VERBOSE Where_585 [Where] outputs: [720 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_586 [Expand] TRT - VERBOSE Searching for input: 700 TRT - VERBOSE Searching for input: 720 TRT - VERBOSE Expand_586 [Expand] inputs: [700 -> (1)[INT32]], [720 -> (2)[INT32]], TRT - VERBOSE Registering layer: 700 for ONNX node: 700 TRT - VERBOSE Registering layer: Expand_586 for ONNX node: Expand_586 TRT - VERBOSE Registering tensor: 721 for ONNX tensor: 721 TRT - VERBOSE Expand_586 [Expand] outputs: [721 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_588 [Unsqueeze] TRT - VERBOSE Searching for input: 721 TRT - VERBOSE Searching for input: 722 TRT - VERBOSE Unsqueeze_588 [Unsqueeze] inputs: [721 -> (3000, 1)[INT32]], [722 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_588 for ONNX node: Unsqueeze_588 TRT - VERBOSE Registering tensor: 723 for ONNX tensor: 723 TRT - VERBOSE Unsqueeze_588 [Unsqueeze] outputs: [723 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Concat_589 [Concat] TRT - VERBOSE Searching for input: 714 TRT - VERBOSE Searching for input: 723 TRT - VERBOSE Concat_589 [Concat] inputs: [714 -> (3000, 1, 1)[INT32]], [723 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Registering layer: Concat_589 for ONNX node: Concat_589 TRT - VERBOSE Registering tensor: 724 for ONNX tensor: 724 TRT - VERBOSE Concat_589 [Concat] outputs: [724 -> (3000, 1, 2)[INT32]], TRT - VERBOSE Parsing node: Concat_595 [Concat] TRT - VERBOSE Searching for input: 705 TRT - VERBOSE Searching for input: 729 TRT - VERBOSE Concat_595 [Concat] inputs: [705 -> (2)[INT32]], [729 -> (0)[INT32]], TRT - VERBOSE Registering layer: Concat_595 for ONNX node: Concat_595 TRT - VERBOSE Registering tensor: 730 for ONNX tensor: 730 TRT - VERBOSE Concat_595 [Concat] outputs: [730 -> (2)[INT32]], TRT - VERBOSE Parsing node: Reshape_596 [Reshape] TRT - VERBOSE Searching for input: 692 TRT - VERBOSE Searching for input: 730 TRT - VERBOSE Reshape_596 [Reshape] inputs: [692 -> (3000)[INT32]], [730 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_596 for ONNX node: Reshape_596 TRT - VERBOSE Registering tensor: 731 for ONNX tensor: 731 TRT - VERBOSE Reshape_596 [Reshape] outputs: [731 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Cast_597 [Cast] TRT - VERBOSE Searching for input: 731 TRT - VERBOSE Cast_597 [Cast] inputs: [731 -> (3000, 1)[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_597 for ONNX node: Cast_597 TRT - VERBOSE Registering tensor: 732 for ONNX tensor: 732 TRT - VERBOSE Cast_597 [Cast] outputs: [732 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: ScatterND_598 [ScatterND] TRT - VERBOSE Searching for input: 682 TRT - VERBOSE Searching for input: 724 TRT - VERBOSE Searching for input: 732 TRT - VERBOSE ScatterND_598 [ScatterND] inputs: [682 -> (3000, 2)[INT32]], [724 -> (3000, 1, 2)[INT32]], [732 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: ScatterND_598 for ONNX node: ScatterND_598 TRT - VERBOSE Registering tensor: 733 for ONNX tensor: 733 TRT - VERBOSE ScatterND_598 [ScatterND] outputs: [733 -> (3000, 2)[INT32]], TRT - VERBOSE Parsing node: Shape_600 [Shape] TRT - VERBOSE Searching for input: 619 TRT - VERBOSE Shape_600 [Shape] inputs: [619 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Shape_600 for ONNX node: Shape_600 TRT - VERBOSE Registering tensor: 735 for ONNX tensor: 735 TRT - VERBOSE Shape_600 [Shape] outputs: [735 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_602 [Unsqueeze] TRT - VERBOSE Searching for input: 619 TRT - VERBOSE Searching for input: 736 TRT - VERBOSE Unsqueeze_602 [Unsqueeze] inputs: [619 -> (3000)[INT32]], [736 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000,), unsqueezing to: (3000, 1) TRT - VERBOSE Registering layer: Unsqueeze_602 for ONNX node: Unsqueeze_602 TRT - VERBOSE Registering tensor: 737 for ONNX tensor: 737 TRT - VERBOSE Unsqueeze_602 [Unsqueeze] outputs: [737 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Shape_603 [Shape] TRT - VERBOSE Searching for input: 614 TRT - VERBOSE Shape_603 [Shape] inputs: [614 -> (-1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_603 for ONNX node: Shape_603 TRT - VERBOSE Registering tensor: 738 for ONNX tensor: 738 TRT - VERBOSE Shape_603 [Shape] outputs: [738 -> (1)[INT32]], TRT - VERBOSE Parsing node: Slice_607 [Slice] TRT - VERBOSE Searching for input: 738 TRT - VERBOSE Searching for input: 740 TRT - VERBOSE Searching for input: 741 TRT - VERBOSE Searching for input: 739 TRT - VERBOSE Slice_607 [Slice] inputs: [738 -> (1)[INT32]], [740 -> (1)[INT32]], [741 -> (1)[INT32]], [739 -> (1)[INT32]], TRT - VERBOSE Registering layer: Slice_607 for ONNX node: Slice_607 TRT - VERBOSE Registering tensor: 742 for ONNX tensor: 742 TRT - VERBOSE Slice_607 [Slice] outputs: [742 -> (0)[INT32]], TRT - VERBOSE Parsing node: Concat_608 [Concat] TRT - VERBOSE Searching for input: 735 TRT - VERBOSE Searching for input: 742 TRT - VERBOSE Concat_608 [Concat] inputs: [735 -> (1)[INT32]], [742 -> (0)[INT32]], TRT - VERBOSE Registering layer: Concat_608 for ONNX node: Concat_608 TRT - VERBOSE Registering tensor: 743 for ONNX tensor: 743 TRT - VERBOSE Concat_608 [Concat] outputs: [743 -> (1)[INT32]], TRT - VERBOSE Parsing node: Shape_609 [Shape] TRT - VERBOSE Searching for input: 743 TRT - VERBOSE Shape_609 [Shape] inputs: [743 -> (1)[INT32]], TRT - VERBOSE Registering layer: Shape_609 for ONNX node: Shape_609 TRT - VERBOSE Registering tensor: 744 for ONNX tensor: 744 TRT - VERBOSE Shape_609 [Shape] outputs: [744 -> (1)[INT32]], TRT - VERBOSE Parsing node: ConstantOfShape_610 [ConstantOfShape] TRT - VERBOSE Searching for input: 744 TRT - VERBOSE ConstantOfShape_610 [ConstantOfShape] inputs: [744 -> (1)[INT32]], TRT - VERBOSE Registering layer: ConstantOfShape_610 for ONNX node: ConstantOfShape_610 TRT - VERBOSE Registering tensor: 745 for ONNX tensor: 745 TRT - VERBOSE ConstantOfShape_610 [ConstantOfShape] outputs: [745 -> (1)[INT32]], TRT - VERBOSE Parsing node: Mul_612 [Mul] TRT - VERBOSE Searching for input: 745 TRT - VERBOSE Searching for input: 746 TRT - VERBOSE Mul_612 [Mul] inputs: [745 -> (1)[INT32]], [746 -> ()[INT32]], TRT - VERBOSE Registering layer: 746 for ONNX node: 746 TRT - VERBOSE Registering layer: Mul_612 for ONNX node: Mul_612 TRT - VERBOSE Registering tensor: 747 for ONNX tensor: 747 TRT - VERBOSE Mul_612 [Mul] outputs: [747 -> (1)[INT32]], TRT - VERBOSE Parsing node: Equal_613 [Equal] TRT - VERBOSE Searching for input: 743 TRT - VERBOSE Searching for input: 747 TRT - VERBOSE Equal_613 [Equal] inputs: [743 -> (1)[INT32]], [747 -> (1)[INT32]], TRT - VERBOSE Registering layer: Equal_613 for ONNX node: Equal_613 TRT - VERBOSE Registering tensor: 748 for ONNX tensor: 748 TRT - VERBOSE Equal_613 [Equal] outputs: [748 -> (1)[BOOL]], TRT - VERBOSE Parsing node: Where_614 [Where] TRT - VERBOSE Searching for input: 748 TRT - VERBOSE Searching for input: 745 TRT - VERBOSE Searching for input: 743 TRT - VERBOSE Where_614 [Where] inputs: [748 -> (1)[BOOL]], [745 -> (1)[INT32]], [743 -> (1)[INT32]], TRT - VERBOSE Registering layer: Where_614 for ONNX node: Where_614 TRT - VERBOSE Registering tensor: 749 for ONNX tensor: 749 TRT - VERBOSE Where_614 [Where] outputs: [749 -> (1)[INT32]], TRT - VERBOSE Parsing node: Expand_615 [Expand] TRT - VERBOSE Searching for input: 734 TRT - VERBOSE Searching for input: 749 TRT - VERBOSE Expand_615 [Expand] inputs: [734 -> ()[FLOAT]], [749 -> (1)[INT32]], TRT - VERBOSE Registering layer: 734 for ONNX node: 734 TRT - VERBOSE Registering layer: Expand_615 for ONNX node: Expand_615 TRT - VERBOSE Registering tensor: 750 for ONNX tensor: 750 TRT - VERBOSE Expand_615 [Expand] outputs: [750 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Reshape_616 [Reshape] TRT - VERBOSE Searching for input: 750 TRT - VERBOSE Searching for input: 743 TRT - VERBOSE Reshape_616 [Reshape] inputs: [750 -> (3000)[FLOAT]], [743 -> (1)[INT32]], TRT - VERBOSE Registering layer: Reshape_616 for ONNX node: Reshape_616 TRT - VERBOSE Registering tensor: 751 for ONNX tensor: 751 TRT - VERBOSE Reshape_616 [Reshape] outputs: [751 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: ScatterND_617 [ScatterND] TRT - VERBOSE Searching for input: 614 TRT - VERBOSE Searching for input: 737 TRT - VERBOSE Searching for input: 751 TRT - VERBOSE ScatterND_617 [ScatterND] inputs: [614 -> (-1)[FLOAT]], [737 -> (3000, 1)[INT32]], [751 -> (3000)[FLOAT]], TRT - VERBOSE Registering layer: ScatterND_617 for ONNX node: ScatterND_617 TRT - VERBOSE Registering tensor: 752 for ONNX tensor: 752 TRT - VERBOSE ScatterND_617 [ScatterND] outputs: [752 -> (-1)[FLOAT]], TRT - VERBOSE Parsing node: Concat_618 [Concat] TRT - VERBOSE Searching for input: 595 TRT - VERBOSE Searching for input: 733 TRT - VERBOSE Concat_618 [Concat] inputs: [595 -> (3000, 2)[INT32]], [733 -> (3000, 2)[INT32]], TRT - VERBOSE Registering layer: Concat_618 for ONNX node: Concat_618 TRT - VERBOSE Registering tensor: 753 for ONNX tensor: 753 TRT - VERBOSE Concat_618 [Concat] outputs: [753 -> (6000, 2)[INT32]], TRT - VERBOSE Parsing node: Concat_619 [Concat] TRT - VERBOSE Searching for input: 480 TRT - VERBOSE Searching for input: 618 TRT - VERBOSE Concat_619 [Concat] inputs: [480 -> (3000)[FLOAT]], [618 -> (3000)[FLOAT]], TRT - VERBOSE Registering layer: Concat_619 for ONNX node: Concat_619 TRT - VERBOSE Registering tensor: 754 for ONNX tensor: 754 TRT - VERBOSE Concat_619 [Concat] outputs: [754 -> (6000)[FLOAT]], TRT - VERBOSE Parsing node: TopK_620 [TopK] TRT - VERBOSE Searching for input: 752 TRT - VERBOSE Searching for input: 1223 TRT - VERBOSE TopK_620 [TopK] inputs: [752 -> (-1)[FLOAT]], [1223 -> (1)[INT32]], TRT - VERBOSE Original shape: (_,), unsqueezing to: (_, _) TRT - VERBOSE Registering layer: TopK_620 for ONNX node: TopK_620 TRT - VERBOSE Original shape: (3000, 1), squeezing to: (3000,) TRT - VERBOSE Original shape: (3000, 1), squeezing to: (3000,) TRT - VERBOSE Registering tensor: 758 for ONNX tensor: 758 TRT - VERBOSE Registering tensor: 759 for ONNX tensor: 759 TRT - VERBOSE TopK_620 [TopK] outputs: [758 -> (3000)[FLOAT]], [759 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_621 [Shape] TRT - VERBOSE Searching for input: 758 TRT - VERBOSE Shape_621 [Shape] inputs: [758 -> (3000)[FLOAT]], TRT - VERBOSE Registering layer: Shape_621 for ONNX node: Shape_621 TRT - VERBOSE Registering tensor: 760 for ONNX tensor: 760 TRT - VERBOSE Shape_621 [Shape] outputs: [760 -> (1)[INT32]], TRT - VERBOSE Parsing node: Gather_623 [Gather] TRT - VERBOSE Searching for input: 760 TRT - VERBOSE Searching for input: 761 TRT - VERBOSE Gather_623 [Gather] inputs: [760 -> (1)[INT32]], [761 -> ()[INT32]], TRT - VERBOSE Registering layer: 761 for ONNX node: 761 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_623 for ONNX node: Gather_623 TRT - VERBOSE Registering tensor: 762 for ONNX tensor: 762 TRT - VERBOSE Gather_623 [Gather] outputs: [762 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_625 [Unsqueeze] TRT - VERBOSE Searching for input: 762 TRT - VERBOSE Searching for input: 764 TRT - VERBOSE Unsqueeze_625 [Unsqueeze] inputs: [762 -> ()[INT32]], [764 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_625 for ONNX node: Unsqueeze_625 TRT - VERBOSE Registering tensor: 765 for ONNX tensor: 765 TRT - VERBOSE Unsqueeze_625 [Unsqueeze] outputs: [765 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_626 [Concat] TRT - VERBOSE Searching for input: 765 TRT - VERBOSE Searching for input: 1224 TRT - VERBOSE Concat_626 [Concat] inputs: [765 -> (1)[INT32]], [1224 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1224 for ONNX node: 1224 TRT - VERBOSE Registering layer: Concat_626 for ONNX node: Concat_626 TRT - VERBOSE Registering tensor: 768 for ONNX tensor: 768 TRT - VERBOSE Concat_626 [Concat] outputs: [768 -> (2)[INT32]], TRT - VERBOSE Parsing node: ConstantOfShape_627 [ConstantOfShape] TRT - VERBOSE Searching for input: 768 TRT - VERBOSE ConstantOfShape_627 [ConstantOfShape] inputs: [768 -> (2)[INT32]], TRT - VERBOSE Registering layer: ConstantOfShape_627 for ONNX node: ConstantOfShape_627 TRT - VERBOSE Registering tensor: 769 for ONNX tensor: 769 TRT - VERBOSE ConstantOfShape_627 [ConstantOfShape] outputs: [769 -> (3000, 2)[FLOAT]], TRT - VERBOSE Parsing node: RandomUniformLike_628 [RandomUniformLike] TRT - VERBOSE Searching for input: 769 TRT - VERBOSE RandomUniformLike_628 [RandomUniformLike] inputs: [769 -> (3000, 2)[FLOAT]], TRT - VERBOSE Registering layer: RandomUniformLike_628 for ONNX node: RandomUniformLike_628 TRT - VERBOSE Registering tensor: 770 for ONNX tensor: 770 TRT - VERBOSE RandomUniformLike_628 [RandomUniformLike] outputs: [770 -> (3000, 2)[FLOAT]], TRT - VERBOSE Parsing node: Cast_629 [Cast] TRT - VERBOSE Searching for input: 770 TRT - VERBOSE Cast_629 [Cast] inputs: [770 -> (3000, 2)[FLOAT]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_629 for ONNX node: Cast_629 TRT - VERBOSE Registering tensor: 771 for ONNX tensor: 771 TRT - VERBOSE Cast_629 [Cast] outputs: [771 -> (3000, 2)[INT32]], TRT - VERBOSE Parsing node: Shape_630 [Shape] TRT - VERBOSE Searching for input: 459 TRT - VERBOSE Shape_630 [Shape] inputs: [459 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Registering layer: Shape_630 for ONNX node: Shape_630 TRT - VERBOSE Registering tensor: 772 for ONNX tensor: 772 TRT - VERBOSE Shape_630 [Shape] outputs: [772 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_632 [Gather] TRT - VERBOSE Searching for input: 772 TRT - VERBOSE Searching for input: 773 TRT - VERBOSE Gather_632 [Gather] inputs: [772 -> (4)[INT32]], [773 -> ()[INT32]], TRT - VERBOSE Registering layer: 773 for ONNX node: 773 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_632 for ONNX node: Gather_632 TRT - VERBOSE Registering tensor: 774 for ONNX tensor: 774 TRT - VERBOSE Gather_632 [Gather] outputs: [774 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_633 [Cast] TRT - VERBOSE Searching for input: 759 TRT - VERBOSE Cast_633 [Cast] inputs: [759 -> (3000)[INT32]], TRT - VERBOSE Casting to type: float32 TRT - VERBOSE Registering layer: Cast_633 for ONNX node: Cast_633 TRT - VERBOSE Registering tensor: 775 for ONNX tensor: 775 TRT - VERBOSE Cast_633 [Cast] outputs: [775 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Cast_634 [Cast] TRT - VERBOSE Searching for input: 774 TRT - VERBOSE Cast_634 [Cast] inputs: [774 -> ()[INT32]], TRT - VERBOSE Casting to type: float32 TRT - VERBOSE Registering layer: Cast_634 for ONNX node: Cast_634 TRT - VERBOSE Registering tensor: 776 for ONNX tensor: 776 TRT - VERBOSE Cast_634 [Cast] outputs: [776 -> ()[FLOAT]], TRT - VERBOSE Parsing node: Div_635 [Div] TRT - VERBOSE Searching for input: 775 TRT - VERBOSE Searching for input: 776 TRT - VERBOSE Div_635 [Div] inputs: [775 -> (3000)[FLOAT]], [776 -> ()[FLOAT]], TRT - VERBOSE Registering layer: Div_635 for ONNX node: Div_635 TRT - VERBOSE Registering tensor: 777 for ONNX tensor: 777 TRT - VERBOSE Div_635 [Div] outputs: [777 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Gather_637 [Gather] TRT - VERBOSE Searching for input: 771 TRT - VERBOSE Searching for input: 778 TRT - VERBOSE Gather_637 [Gather] inputs: [771 -> (3000, 2)[INT32]], [778 -> ()[INT32]], TRT - VERBOSE Registering layer: 778 for ONNX node: 778 TRT - VERBOSE Using Gather axis: 1 TRT - VERBOSE Registering layer: Gather_637 for ONNX node: Gather_637 TRT - VERBOSE Registering tensor: 779 for ONNX tensor: 779 TRT - VERBOSE Gather_637 [Gather] outputs: [779 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_638 [Shape] TRT - VERBOSE Searching for input: 779 TRT - VERBOSE Shape_638 [Shape] inputs: [779 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Shape_638 for ONNX node: Shape_638 TRT - VERBOSE Registering tensor: 780 for ONNX tensor: 780 TRT - VERBOSE Shape_638 [Shape] outputs: [780 -> (1)[INT32]], TRT - VERBOSE Parsing node: Expand_639 [Expand] TRT - VERBOSE Searching for input: 777 TRT - VERBOSE Searching for input: 780 TRT - VERBOSE Expand_639 [Expand] inputs: [777 -> (3000)[FLOAT]], [780 -> (1)[INT32]], TRT - VERBOSE Registering layer: Expand_639 for ONNX node: Expand_639 TRT - VERBOSE Registering tensor: 781 for ONNX tensor: 781 TRT - VERBOSE Expand_639 [Expand] outputs: [781 -> (3000)[FLOAT]], TRT - VERBOSE Parsing node: Shape_640 [Shape] TRT - VERBOSE Searching for input: 771 TRT - VERBOSE Shape_640 [Shape] inputs: [771 -> (3000, 2)[INT32]], TRT - VERBOSE Registering layer: Shape_640 for ONNX node: Shape_640 TRT - VERBOSE Registering tensor: 782 for ONNX tensor: 782 TRT - VERBOSE Shape_640 [Shape] outputs: [782 -> (2)[INT32]], TRT - VERBOSE Parsing node: Gather_642 [Gather] TRT - VERBOSE Searching for input: 782 TRT - VERBOSE Searching for input: 783 TRT - VERBOSE Gather_642 [Gather] inputs: [782 -> (2)[INT32]], [783 -> ()[INT32]], TRT - VERBOSE Registering layer: 783 for ONNX node: 783 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_642 for ONNX node: Gather_642 TRT - VERBOSE Registering tensor: 784 for ONNX tensor: 784 TRT - VERBOSE Gather_642 [Gather] outputs: [784 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_643 [Cast] TRT - VERBOSE Searching for input: 784 TRT - VERBOSE Cast_643 [Cast] inputs: [784 -> ()[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_643 for ONNX node: Cast_643 TRT - VERBOSE Registering tensor: 785 for ONNX tensor: 785 TRT - VERBOSE Cast_643 [Cast] outputs: [785 -> ()[INT32]], TRT - VERBOSE Parsing node: Range_646 [Range] TRT - VERBOSE Searching for input: 786 TRT - VERBOSE Searching for input: 785 TRT - VERBOSE Searching for input: 787 TRT - VERBOSE Range_646 [Range] inputs: [786 -> ()[INT32]], [785 -> ()[INT32]], [787 -> ()[INT32]], TRT - VERBOSE Registering layer: Range_646 for ONNX node: Range_646 TRT - VERBOSE Registering tensor: 788 for ONNX tensor: 788 TRT - VERBOSE Range_646 [Range] outputs: [788 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Reshape_649 [Reshape] TRT - VERBOSE Searching for input: 788 TRT - VERBOSE Searching for input: 790 TRT - VERBOSE Reshape_649 [Reshape] inputs: [788 -> (3000)[INT32]], [790 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_649 for ONNX node: Reshape_649 TRT - VERBOSE Registering tensor: 791 for ONNX tensor: 791 TRT - VERBOSE Reshape_649 [Reshape] outputs: [791 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Add_651 [Add] TRT - VERBOSE Searching for input: 791 TRT - VERBOSE Searching for input: 792 TRT - VERBOSE Add_651 [Add] inputs: [791 -> (3000, 1)[INT32]], [792 -> (1)[INT32]], TRT - VERBOSE Registering layer: 792 for ONNX node: 792 TRT - VERBOSE Registering layer: Add_651 for ONNX node: Add_651 TRT - VERBOSE Registering tensor: 793 for ONNX tensor: 793 TRT - VERBOSE Add_651 [Add] outputs: [793 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Shape_652 [Shape] TRT - VERBOSE Searching for input: 793 TRT - VERBOSE Shape_652 [Shape] inputs: [793 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: Shape_652 for ONNX node: Shape_652 TRT - VERBOSE Registering tensor: 794 for ONNX tensor: 794 TRT - VERBOSE Shape_652 [Shape] outputs: [794 -> (2)[INT32]], TRT - VERBOSE Parsing node: Equal_657 [Equal] TRT - VERBOSE Searching for input: 794 TRT - VERBOSE Searching for input: 798 TRT - VERBOSE Equal_657 [Equal] inputs: [794 -> (2)[INT32]], [798 -> (2)[INT32]], TRT - VERBOSE Registering layer: 798 for ONNX node: 798 TRT - VERBOSE Registering layer: Equal_657 for ONNX node: Equal_657 TRT - VERBOSE Registering tensor: 799 for ONNX tensor: 799 TRT - VERBOSE Equal_657 [Equal] outputs: [799 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_658 [Where] TRT - VERBOSE Searching for input: 799 TRT - VERBOSE Searching for input: 796 TRT - VERBOSE Searching for input: 794 TRT - VERBOSE Where_658 [Where] inputs: [799 -> (2)[BOOL]], [796 -> (2)[INT32]], [794 -> (2)[INT32]], TRT - VERBOSE Registering layer: 796 for ONNX node: 796 TRT - VERBOSE Registering layer: Where_658 for ONNX node: Where_658 TRT - VERBOSE Registering tensor: 800 for ONNX tensor: 800 TRT - VERBOSE Where_658 [Where] outputs: [800 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_659 [Expand] TRT - VERBOSE Searching for input: 791 TRT - VERBOSE Searching for input: 800 TRT - VERBOSE Expand_659 [Expand] inputs: [791 -> (3000, 1)[INT32]], [800 -> (2)[INT32]], TRT - VERBOSE Registering layer: Expand_659 for ONNX node: Expand_659 TRT - VERBOSE Registering tensor: 801 for ONNX tensor: 801 TRT - VERBOSE Expand_659 [Expand] outputs: [801 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_661 [Unsqueeze] TRT - VERBOSE Searching for input: 801 TRT - VERBOSE Searching for input: 802 TRT - VERBOSE Unsqueeze_661 [Unsqueeze] inputs: [801 -> (3000, 1)[INT32]], [802 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_661 for ONNX node: Unsqueeze_661 TRT - VERBOSE Registering tensor: 803 for ONNX tensor: 803 TRT - VERBOSE Unsqueeze_661 [Unsqueeze] outputs: [803 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Equal_666 [Equal] TRT - VERBOSE Searching for input: 794 TRT - VERBOSE Searching for input: 807 TRT - VERBOSE Equal_666 [Equal] inputs: [794 -> (2)[INT32]], [807 -> (2)[INT32]], TRT - VERBOSE Registering layer: 807 for ONNX node: 807 TRT - VERBOSE Registering layer: Equal_666 for ONNX node: Equal_666 TRT - VERBOSE Registering tensor: 808 for ONNX tensor: 808 TRT - VERBOSE Equal_666 [Equal] outputs: [808 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_667 [Where] TRT - VERBOSE Searching for input: 808 TRT - VERBOSE Searching for input: 805 TRT - VERBOSE Searching for input: 794 TRT - VERBOSE Where_667 [Where] inputs: [808 -> (2)[BOOL]], [805 -> (2)[INT32]], [794 -> (2)[INT32]], TRT - VERBOSE Registering layer: 805 for ONNX node: 805 TRT - VERBOSE Registering layer: Where_667 for ONNX node: Where_667 TRT - VERBOSE Registering tensor: 809 for ONNX tensor: 809 TRT - VERBOSE Where_667 [Where] outputs: [809 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_668 [Expand] TRT - VERBOSE Searching for input: 789 TRT - VERBOSE Searching for input: 809 TRT - VERBOSE Expand_668 [Expand] inputs: [789 -> (1)[INT32]], [809 -> (2)[INT32]], TRT - VERBOSE Registering layer: 789 for ONNX node: 789 TRT - VERBOSE Registering layer: Expand_668 for ONNX node: Expand_668 TRT - VERBOSE Registering tensor: 810 for ONNX tensor: 810 TRT - VERBOSE Expand_668 [Expand] outputs: [810 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_670 [Unsqueeze] TRT - VERBOSE Searching for input: 810 TRT - VERBOSE Searching for input: 811 TRT - VERBOSE Unsqueeze_670 [Unsqueeze] inputs: [810 -> (3000, 1)[INT32]], [811 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_670 for ONNX node: Unsqueeze_670 TRT - VERBOSE Registering tensor: 812 for ONNX tensor: 812 TRT - VERBOSE Unsqueeze_670 [Unsqueeze] outputs: [812 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Concat_671 [Concat] TRT - VERBOSE Searching for input: 803 TRT - VERBOSE Searching for input: 812 TRT - VERBOSE Concat_671 [Concat] inputs: [803 -> (3000, 1, 1)[INT32]], [812 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Registering layer: Concat_671 for ONNX node: Concat_671 TRT - VERBOSE Registering tensor: 813 for ONNX tensor: 813 TRT - VERBOSE Concat_671 [Concat] outputs: [813 -> (3000, 1, 2)[INT32]], TRT - VERBOSE Parsing node: Concat_677 [Concat] TRT - VERBOSE Searching for input: 794 TRT - VERBOSE Searching for input: 818 TRT - VERBOSE Concat_677 [Concat] inputs: [794 -> (2)[INT32]], [818 -> (0)[INT32]], TRT - VERBOSE Registering layer: Concat_677 for ONNX node: Concat_677 TRT - VERBOSE Registering tensor: 819 for ONNX tensor: 819 TRT - VERBOSE Concat_677 [Concat] outputs: [819 -> (2)[INT32]], TRT - VERBOSE Parsing node: Reshape_678 [Reshape] TRT - VERBOSE Searching for input: 781 TRT - VERBOSE Searching for input: 819 TRT - VERBOSE Reshape_678 [Reshape] inputs: [781 -> (3000)[FLOAT]], [819 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_678 for ONNX node: Reshape_678 TRT - VERBOSE Registering tensor: 820 for ONNX tensor: 820 TRT - VERBOSE Reshape_678 [Reshape] outputs: [820 -> (3000, 1)[FLOAT]], TRT - VERBOSE Parsing node: Cast_679 [Cast] TRT - VERBOSE Searching for input: 820 TRT - VERBOSE Cast_679 [Cast] inputs: [820 -> (3000, 1)[FLOAT]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_679 for ONNX node: Cast_679 TRT - VERBOSE Registering tensor: 821 for ONNX tensor: 821 TRT - VERBOSE Cast_679 [Cast] outputs: [821 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: ScatterND_680 [ScatterND] TRT - VERBOSE Searching for input: 771 TRT - VERBOSE Searching for input: 813 TRT - VERBOSE Searching for input: 821 TRT - VERBOSE ScatterND_680 [ScatterND] inputs: [771 -> (3000, 2)[INT32]], [813 -> (3000, 1, 2)[INT32]], [821 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: ScatterND_680 for ONNX node: ScatterND_680 TRT - VERBOSE Registering tensor: 822 for ONNX tensor: 822 TRT - VERBOSE ScatterND_680 [ScatterND] outputs: [822 -> (3000, 2)[INT32]], TRT - VERBOSE Parsing node: Shape_681 [Shape] TRT - VERBOSE Searching for input: 459 TRT - VERBOSE Shape_681 [Shape] inputs: [459 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Registering layer: Shape_681 for ONNX node: Shape_681 TRT - VERBOSE Registering tensor: 823 for ONNX tensor: 823 TRT - VERBOSE Shape_681 [Shape] outputs: [823 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_683 [Gather] TRT - VERBOSE Searching for input: 823 TRT - VERBOSE Searching for input: 824 TRT - VERBOSE Gather_683 [Gather] inputs: [823 -> (4)[INT32]], [824 -> ()[INT32]], TRT - VERBOSE Registering layer: 824 for ONNX node: 824 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_683 for ONNX node: Gather_683 TRT - VERBOSE Registering tensor: 825 for ONNX tensor: 825 TRT - VERBOSE Gather_683 [Gather] outputs: [825 -> ()[INT32]], TRT - VERBOSE Parsing node: Div_684 [Div] TRT - VERBOSE Searching for input: 759 TRT - VERBOSE Searching for input: 825 TRT - VERBOSE Div_684 [Div] inputs: [759 -> (3000)[INT32]], [825 -> ()[INT32]], TRT - VERBOSE Registering layer: Div_684 for ONNX node: Div_684 TRT - VERBOSE Registering tensor: 826 for ONNX tensor: 826 TRT - VERBOSE Div_684 [Div] outputs: [826 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Mul_685 [Mul] TRT - VERBOSE Searching for input: 826 TRT - VERBOSE Searching for input: 825 TRT - VERBOSE Mul_685 [Mul] inputs: [826 -> (3000)[INT32]], [825 -> ()[INT32]], TRT - VERBOSE Registering layer: Mul_685 for ONNX node: Mul_685 TRT - VERBOSE Registering tensor: 827 for ONNX tensor: 827 TRT - VERBOSE Mul_685 [Mul] outputs: [827 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Sub_686 [Sub] TRT - VERBOSE Searching for input: 759 TRT - VERBOSE Searching for input: 827 TRT - VERBOSE Sub_686 [Sub] inputs: [759 -> (3000)[INT32]], [827 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Sub_686 for ONNX node: Sub_686 TRT - VERBOSE Registering tensor: 828 for ONNX tensor: 828 TRT - VERBOSE Sub_686 [Sub] outputs: [828 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Gather_688 [Gather] TRT - VERBOSE Searching for input: 822 TRT - VERBOSE Searching for input: 829 TRT - VERBOSE Gather_688 [Gather] inputs: [822 -> (3000, 2)[INT32]], [829 -> ()[INT32]], TRT - VERBOSE Registering layer: 829 for ONNX node: 829 TRT - VERBOSE Using Gather axis: 1 TRT - VERBOSE Registering layer: Gather_688 for ONNX node: Gather_688 TRT - VERBOSE Registering tensor: 830 for ONNX tensor: 830 TRT - VERBOSE Gather_688 [Gather] outputs: [830 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_689 [Shape] TRT - VERBOSE Searching for input: 830 TRT - VERBOSE Shape_689 [Shape] inputs: [830 -> (3000)[INT32]], TRT - VERBOSE Registering layer: Shape_689 for ONNX node: Shape_689 TRT - VERBOSE Registering tensor: 831 for ONNX tensor: 831 TRT - VERBOSE Shape_689 [Shape] outputs: [831 -> (1)[INT32]], TRT - VERBOSE Parsing node: Expand_690 [Expand] TRT - VERBOSE Searching for input: 828 TRT - VERBOSE Searching for input: 831 TRT - VERBOSE Expand_690 [Expand] inputs: [828 -> (3000)[INT32]], [831 -> (1)[INT32]], TRT - VERBOSE Registering layer: Expand_690 for ONNX node: Expand_690 TRT - VERBOSE Registering tensor: 832 for ONNX tensor: 832 TRT - VERBOSE Expand_690 [Expand] outputs: [832 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Shape_691 [Shape] TRT - VERBOSE Searching for input: 822 TRT - VERBOSE Shape_691 [Shape] inputs: [822 -> (3000, 2)[INT32]], TRT - VERBOSE Registering layer: Shape_691 for ONNX node: Shape_691 TRT - VERBOSE Registering tensor: 833 for ONNX tensor: 833 TRT - VERBOSE Shape_691 [Shape] outputs: [833 -> (2)[INT32]], TRT - VERBOSE Parsing node: Gather_693 [Gather] TRT - VERBOSE Searching for input: 833 TRT - VERBOSE Searching for input: 834 TRT - VERBOSE Gather_693 [Gather] inputs: [833 -> (2)[INT32]], [834 -> ()[INT32]], TRT - VERBOSE Registering layer: 834 for ONNX node: 834 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_693 for ONNX node: Gather_693 TRT - VERBOSE Registering tensor: 835 for ONNX tensor: 835 TRT - VERBOSE Gather_693 [Gather] outputs: [835 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_694 [Cast] TRT - VERBOSE Searching for input: 835 TRT - VERBOSE Cast_694 [Cast] inputs: [835 -> ()[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_694 for ONNX node: Cast_694 TRT - VERBOSE Registering tensor: 836 for ONNX tensor: 836 TRT - VERBOSE Cast_694 [Cast] outputs: [836 -> ()[INT32]], TRT - VERBOSE Parsing node: Range_697 [Range] TRT - VERBOSE Searching for input: 837 TRT - VERBOSE Searching for input: 836 TRT - VERBOSE Searching for input: 838 TRT - VERBOSE Range_697 [Range] inputs: [837 -> ()[INT32]], [836 -> ()[INT32]], [838 -> ()[INT32]], TRT - VERBOSE Registering layer: Range_697 for ONNX node: Range_697 TRT - VERBOSE Registering tensor: 839 for ONNX tensor: 839 TRT - VERBOSE Range_697 [Range] outputs: [839 -> (3000)[INT32]], TRT - VERBOSE Parsing node: Reshape_700 [Reshape] TRT - VERBOSE Searching for input: 839 TRT - VERBOSE Searching for input: 841 TRT - VERBOSE Reshape_700 [Reshape] inputs: [839 -> (3000)[INT32]], [841 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_700 for ONNX node: Reshape_700 TRT - VERBOSE Registering tensor: 842 for ONNX tensor: 842 TRT - VERBOSE Reshape_700 [Reshape] outputs: [842 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Add_702 [Add] TRT - VERBOSE Searching for input: 842 TRT - VERBOSE Searching for input: 843 TRT - VERBOSE Add_702 [Add] inputs: [842 -> (3000, 1)[INT32]], [843 -> (1)[INT32]], TRT - VERBOSE Registering layer: 843 for ONNX node: 843 TRT - VERBOSE Registering layer: Add_702 for ONNX node: Add_702 TRT - VERBOSE Registering tensor: 844 for ONNX tensor: 844 TRT - VERBOSE Add_702 [Add] outputs: [844 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Shape_703 [Shape] TRT - VERBOSE Searching for input: 844 TRT - VERBOSE Shape_703 [Shape] inputs: [844 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: Shape_703 for ONNX node: Shape_703 TRT - VERBOSE Registering tensor: 845 for ONNX tensor: 845 TRT - VERBOSE Shape_703 [Shape] outputs: [845 -> (2)[INT32]], TRT - VERBOSE Parsing node: Equal_708 [Equal] TRT - VERBOSE Searching for input: 845 TRT - VERBOSE Searching for input: 849 TRT - VERBOSE Equal_708 [Equal] inputs: [845 -> (2)[INT32]], [849 -> (2)[INT32]], TRT - VERBOSE Registering layer: 849 for ONNX node: 849 TRT - VERBOSE Registering layer: Equal_708 for ONNX node: Equal_708 TRT - VERBOSE Registering tensor: 850 for ONNX tensor: 850 TRT - VERBOSE Equal_708 [Equal] outputs: [850 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_709 [Where] TRT - VERBOSE Searching for input: 850 TRT - VERBOSE Searching for input: 847 TRT - VERBOSE Searching for input: 845 TRT - VERBOSE Where_709 [Where] inputs: [850 -> (2)[BOOL]], [847 -> (2)[INT32]], [845 -> (2)[INT32]], TRT - VERBOSE Registering layer: 847 for ONNX node: 847 TRT - VERBOSE Registering layer: Where_709 for ONNX node: Where_709 TRT - VERBOSE Registering tensor: 851 for ONNX tensor: 851 TRT - VERBOSE Where_709 [Where] outputs: [851 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_710 [Expand] TRT - VERBOSE Searching for input: 842 TRT - VERBOSE Searching for input: 851 TRT - VERBOSE Expand_710 [Expand] inputs: [842 -> (3000, 1)[INT32]], [851 -> (2)[INT32]], TRT - VERBOSE Registering layer: Expand_710 for ONNX node: Expand_710 TRT - VERBOSE Registering tensor: 852 for ONNX tensor: 852 TRT - VERBOSE Expand_710 [Expand] outputs: [852 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_712 [Unsqueeze] TRT - VERBOSE Searching for input: 852 TRT - VERBOSE Searching for input: 853 TRT - VERBOSE Unsqueeze_712 [Unsqueeze] inputs: [852 -> (3000, 1)[INT32]], [853 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_712 for ONNX node: Unsqueeze_712 TRT - VERBOSE Registering tensor: 854 for ONNX tensor: 854 TRT - VERBOSE Unsqueeze_712 [Unsqueeze] outputs: [854 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Equal_717 [Equal] TRT - VERBOSE Searching for input: 845 TRT - VERBOSE Searching for input: 858 TRT - VERBOSE Equal_717 [Equal] inputs: [845 -> (2)[INT32]], [858 -> (2)[INT32]], TRT - VERBOSE Registering layer: 858 for ONNX node: 858 TRT - VERBOSE Registering layer: Equal_717 for ONNX node: Equal_717 TRT - VERBOSE Registering tensor: 859 for ONNX tensor: 859 TRT - VERBOSE Equal_717 [Equal] outputs: [859 -> (2)[BOOL]], TRT - VERBOSE Parsing node: Where_718 [Where] TRT - VERBOSE Searching for input: 859 TRT - VERBOSE Searching for input: 856 TRT - VERBOSE Searching for input: 845 TRT - VERBOSE Where_718 [Where] inputs: [859 -> (2)[BOOL]], [856 -> (2)[INT32]], [845 -> (2)[INT32]], TRT - VERBOSE Registering layer: 856 for ONNX node: 856 TRT - VERBOSE Registering layer: Where_718 for ONNX node: Where_718 TRT - VERBOSE Registering tensor: 860 for ONNX tensor: 860 TRT - VERBOSE Where_718 [Where] outputs: [860 -> (2)[INT32]], TRT - VERBOSE Parsing node: Expand_719 [Expand] TRT - VERBOSE Searching for input: 840 TRT - VERBOSE Searching for input: 860 TRT - VERBOSE Expand_719 [Expand] inputs: [840 -> (1)[INT32]], [860 -> (2)[INT32]], TRT - VERBOSE Registering layer: 840 for ONNX node: 840 TRT - VERBOSE Registering layer: Expand_719 for ONNX node: Expand_719 TRT - VERBOSE Registering tensor: 861 for ONNX tensor: 861 TRT - VERBOSE Expand_719 [Expand] outputs: [861 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_721 [Unsqueeze] TRT - VERBOSE Searching for input: 861 TRT - VERBOSE Searching for input: 862 TRT - VERBOSE Unsqueeze_721 [Unsqueeze] inputs: [861 -> (3000, 1)[INT32]], [862 -> (1)[INT32]], TRT - VERBOSE Original shape: (3000, 1), unsqueezing to: (3000, 1, 1) TRT - VERBOSE Registering layer: Unsqueeze_721 for ONNX node: Unsqueeze_721 TRT - VERBOSE Registering tensor: 863 for ONNX tensor: 863 TRT - VERBOSE Unsqueeze_721 [Unsqueeze] outputs: [863 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Parsing node: Concat_722 [Concat] TRT - VERBOSE Searching for input: 854 TRT - VERBOSE Searching for input: 863 TRT - VERBOSE Concat_722 [Concat] inputs: [854 -> (3000, 1, 1)[INT32]], [863 -> (3000, 1, 1)[INT32]], TRT - VERBOSE Registering layer: Concat_722 for ONNX node: Concat_722 TRT - VERBOSE Registering tensor: 864 for ONNX tensor: 864 TRT - VERBOSE Concat_722 [Concat] outputs: [864 -> (3000, 1, 2)[INT32]], TRT - VERBOSE Parsing node: Concat_728 [Concat] TRT - VERBOSE Searching for input: 845 TRT - VERBOSE Searching for input: 869 TRT - VERBOSE Concat_728 [Concat] inputs: [845 -> (2)[INT32]], [869 -> (0)[INT32]], TRT - VERBOSE Registering layer: Concat_728 for ONNX node: Concat_728 TRT - VERBOSE Registering tensor: 870 for ONNX tensor: 870 TRT - VERBOSE Concat_728 [Concat] outputs: [870 -> (2)[INT32]], TRT - VERBOSE Parsing node: Reshape_729 [Reshape] TRT - VERBOSE Searching for input: 832 TRT - VERBOSE Searching for input: 870 TRT - VERBOSE Reshape_729 [Reshape] inputs: [832 -> (3000)[INT32]], [870 -> (2)[INT32]], TRT - VERBOSE Registering layer: Reshape_729 for ONNX node: Reshape_729 TRT - VERBOSE Registering tensor: 871 for ONNX tensor: 871 TRT - VERBOSE Reshape_729 [Reshape] outputs: [871 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: Cast_730 [Cast] TRT - VERBOSE Searching for input: 871 TRT - VERBOSE Cast_730 [Cast] inputs: [871 -> (3000, 1)[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_730 for ONNX node: Cast_730 TRT - VERBOSE Registering tensor: 872 for ONNX tensor: 872 TRT - VERBOSE Cast_730 [Cast] outputs: [872 -> (3000, 1)[INT32]], TRT - VERBOSE Parsing node: ScatterND_731 [ScatterND] TRT - VERBOSE Searching for input: 822 TRT - VERBOSE Searching for input: 864 TRT - VERBOSE Searching for input: 872 TRT - VERBOSE ScatterND_731 [ScatterND] inputs: [822 -> (3000, 2)[INT32]], [864 -> (3000, 1, 2)[INT32]], [872 -> (3000, 1)[INT32]], TRT - VERBOSE Registering layer: ScatterND_731 for ONNX node: ScatterND_731 TRT - VERBOSE Registering tensor: 873 for ONNX tensor: 873 TRT - VERBOSE ScatterND_731 [ScatterND] outputs: [873 -> (3000, 2)[INT32]], TRT - VERBOSE Parsing node: Concat_732 [Concat] TRT - VERBOSE Searching for input: 753 TRT - VERBOSE Searching for input: 873 TRT - VERBOSE Concat_732 [Concat] inputs: [753 -> (6000, 2)[INT32]], [873 -> (3000, 2)[INT32]], TRT - VERBOSE Registering layer: Concat_732 for ONNX node: Concat_732 TRT - VERBOSE Registering tensor: 874 for ONNX tensor: 874 TRT - VERBOSE Concat_732 [Concat] outputs: [874 -> (9000, 2)[INT32]], TRT - VERBOSE Parsing node: Concat_733 [Concat] TRT - VERBOSE Searching for input: 754 TRT - VERBOSE Searching for input: 758 TRT - VERBOSE Concat_733 [Concat] inputs: [754 -> (6000)[FLOAT]], [758 -> (3000)[FLOAT]], TRT - VERBOSE Registering layer: Concat_733 for ONNX node: Concat_733 TRT - VERBOSE Registering tensor: 875 for ONNX tensor: 875 TRT - VERBOSE Concat_733 [Concat] outputs: [875 -> (9000)[FLOAT]], TRT - VERBOSE Parsing node: Slice_738 [Slice] TRT - VERBOSE Searching for input: 874 TRT - VERBOSE Searching for input: 877 TRT - VERBOSE Searching for input: 878 TRT - VERBOSE Searching for input: 876 TRT - VERBOSE Searching for input: 879 TRT - VERBOSE Slice_738 [Slice] inputs: [874 -> (9000, 2)[INT32]], [877 -> (1)[INT32]], [878 -> (1)[INT32]], [876 -> (1)[INT32]], [879 -> (1)[INT32]], TRT - VERBOSE Registering layer: Slice_738 for ONNX node: Slice_738 TRT - VERBOSE Registering tensor: 880 for ONNX tensor: 880 TRT - VERBOSE Slice_738 [Slice] outputs: [880 -> (8000, 2)[INT32]], TRT - VERBOSE Parsing node: Slice_743 [Slice] TRT - VERBOSE Searching for input: 875 TRT - VERBOSE Searching for input: 882 TRT - VERBOSE Searching for input: 883 TRT - VERBOSE Searching for input: 881 TRT - VERBOSE Searching for input: 884 TRT - VERBOSE Slice_743 [Slice] inputs: [875 -> (9000)[FLOAT]], [882 -> (1)[INT32]], [883 -> (1)[INT32]], [881 -> (1)[INT32]], [884 -> (1)[INT32]], TRT - VERBOSE Registering layer: Slice_743 for ONNX node: Slice_743 TRT - VERBOSE Registering tensor: 885 for ONNX tensor: 885 TRT - VERBOSE Slice_743 [Slice] outputs: [885 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_745 [Unsqueeze] TRT - VERBOSE Searching for input: 880 TRT - VERBOSE Searching for input: 886 TRT - VERBOSE Unsqueeze_745 [Unsqueeze] inputs: [880 -> (8000, 2)[INT32]], [886 -> (1)[INT32]], TRT - VERBOSE Original shape: (8000, 2), unsqueezing to: (1, 8000, 2) TRT - VERBOSE Registering layer: Unsqueeze_745 for ONNX node: Unsqueeze_745 TRT - VERBOSE Registering tensor: 887 for ONNX tensor: 887 TRT - VERBOSE Unsqueeze_745 [Unsqueeze] outputs: [887 -> (1, 8000, 2)[INT32]], TRT - VERBOSE Parsing node: Concat_746 [Concat] TRT - VERBOSE Searching for input: 887 TRT - VERBOSE Concat_746 [Concat] inputs: [887 -> (1, 8000, 2)[INT32]], TRT - VERBOSE Registering layer: Concat_746 for ONNX node: Concat_746 TRT - VERBOSE Registering tensor: 888 for ONNX tensor: 888 TRT - VERBOSE Concat_746 [Concat] outputs: [888 -> (1, 8000, 2)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_748 [Unsqueeze] TRT - VERBOSE Searching for input: 885 TRT - VERBOSE Searching for input: 889 TRT - VERBOSE Unsqueeze_748 [Unsqueeze] inputs: [885 -> (8000)[FLOAT]], [889 -> (1)[INT32]], TRT - VERBOSE Original shape: (8000,), unsqueezing to: (1, 8000) TRT - VERBOSE Registering layer: Unsqueeze_748 for ONNX node: Unsqueeze_748 TRT - VERBOSE Registering tensor: 890 for ONNX tensor: 890 TRT - VERBOSE Unsqueeze_748 [Unsqueeze] outputs: [890 -> (1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Concat_749 [Concat] TRT - VERBOSE Searching for input: 890 TRT - VERBOSE Concat_749 [Concat] inputs: [890 -> (1, 8000)[FLOAT]], TRT - VERBOSE Registering layer: Concat_749 for ONNX node: Concat_749 TRT - VERBOSE Registering tensor: 891 for ONNX tensor: 891 TRT - VERBOSE Concat_749 [Concat] outputs: [891 -> (1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Cast_750 [Cast] TRT - VERBOSE Searching for input: 888 TRT - VERBOSE Cast_750 [Cast] inputs: [888 -> (1, 8000, 2)[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_750 for ONNX node: Cast_750 TRT - VERBOSE Registering tensor: 892 for ONNX tensor: 892 TRT - VERBOSE Cast_750 [Cast] outputs: [892 -> (1, 8000, 2)[INT32]], TRT - VERBOSE Parsing node: Conv_751 [Conv] TRT - VERBOSE Searching for input: 465 TRT - VERBOSE Searching for input: 435 TRT - VERBOSE Conv_751 [Conv] inputs: [465 -> (-1, 1, -1, -1)[FLOAT]], [435 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_751 for ONNX node: Conv_751 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 893 for ONNX tensor: 893 TRT - VERBOSE Conv_751 [Conv] outputs: [893 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_752 [Conv] TRT - VERBOSE Searching for input: 465 TRT - VERBOSE Searching for input: 437 TRT - VERBOSE Conv_752 [Conv] inputs: [465 -> (-1, 1, -1, -1)[FLOAT]], [437 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_752 for ONNX node: Conv_752 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 894 for ONNX tensor: 894 TRT - VERBOSE Conv_752 [Conv] outputs: [894 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_753 [Conv] TRT - VERBOSE Searching for input: 465 TRT - VERBOSE Searching for input: 439 TRT - VERBOSE Conv_753 [Conv] inputs: [465 -> (-1, 1, -1, -1)[FLOAT]], [439 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_753 for ONNX node: Conv_753 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 895 for ONNX tensor: 895 TRT - VERBOSE Conv_753 [Conv] outputs: [895 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_755 [Conv] TRT - VERBOSE Searching for input: 465 TRT - VERBOSE Searching for input: 896 TRT - VERBOSE Conv_755 [Conv] inputs: [465 -> (-1, 1, -1, -1)[FLOAT]], [896 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_755 for ONNX node: Conv_755 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 897 for ONNX tensor: 897 TRT - VERBOSE Conv_755 [Conv] outputs: [897 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Conv_757 [Conv] TRT - VERBOSE Searching for input: 465 TRT - VERBOSE Searching for input: 898 TRT - VERBOSE Conv_757 [Conv] inputs: [465 -> (-1, 1, -1, -1)[FLOAT]], [898 -> (1, 1, 3, 3)[FLOAT]], TRT - VERBOSE Convolution input dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering layer: Conv_757 for ONNX node: Conv_757 TRT - VERBOSE Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1 TRT - VERBOSE Convolution output dimensions: (-1, 1, -1, -1) TRT - VERBOSE Registering tensor: 899 for ONNX tensor: 899 TRT - VERBOSE Conv_757 [Conv] outputs: [899 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_758 [Mul] TRT - VERBOSE Searching for input: 893 TRT - VERBOSE Searching for input: 895 TRT - VERBOSE Mul_758 [Mul] inputs: [893 -> (-1, 1, -1, -1)[FLOAT]], [895 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_758 for ONNX node: Mul_758 TRT - VERBOSE Registering tensor: 900 for ONNX tensor: 900 TRT - VERBOSE Mul_758 [Mul] outputs: [900 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_759 [Mul] TRT - VERBOSE Searching for input: 894 TRT - VERBOSE Searching for input: 894 TRT - VERBOSE Mul_759 [Mul] inputs: [894 -> (-1, 1, -1, -1)[FLOAT]], [894 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_759 for ONNX node: Mul_759 TRT - VERBOSE Registering tensor: 901 for ONNX tensor: 901 TRT - VERBOSE Mul_759 [Mul] outputs: [901 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Sub_760 [Sub] TRT - VERBOSE Searching for input: 900 TRT - VERBOSE Searching for input: 901 TRT - VERBOSE Sub_760 [Sub] inputs: [900 -> (-1, 1, -1, -1)[FLOAT]], [901 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Sub_760 for ONNX node: Sub_760 TRT - VERBOSE Registering tensor: 902 for ONNX tensor: 902 TRT - VERBOSE Sub_760 [Sub] outputs: [902 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Div_761 [Div] TRT - VERBOSE Searching for input: 895 TRT - VERBOSE Searching for input: 902 TRT - VERBOSE Div_761 [Div] inputs: [895 -> (-1, 1, -1, -1)[FLOAT]], [902 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Div_761 for ONNX node: Div_761 TRT - VERBOSE Registering tensor: 903 for ONNX tensor: 903 TRT - VERBOSE Div_761 [Div] outputs: [903 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Equal_763 [Equal] TRT - VERBOSE Searching for input: 903 TRT - VERBOSE Searching for input: 904 TRT - VERBOSE Equal_763 [Equal] inputs: [903 -> (-1, 1, -1, -1)[FLOAT]], [904 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 904 for ONNX node: 904 TRT - VERBOSE Registering layer: Equal_763 for ONNX node: Equal_763 TRT - VERBOSE Registering tensor: 905 for ONNX tensor: 905 TRT - VERBOSE Equal_763 [Equal] outputs: [905 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_764 [Cast] TRT - VERBOSE Searching for input: 905 TRT - VERBOSE Cast_764 [Cast] inputs: [905 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_764 for ONNX node: Cast_764 TRT - VERBOSE Registering tensor: 906 for ONNX tensor: 906 TRT - VERBOSE Cast_764 [Cast] outputs: [906 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Where_766 [Where] TRT - VERBOSE Searching for input: 906 TRT - VERBOSE Searching for input: 907 TRT - VERBOSE Searching for input: 903 TRT - VERBOSE Where_766 [Where] inputs: [906 -> (-1, 1, -1, -1)[BOOL]], [907 -> ()[FLOAT]], [903 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: 907 for ONNX node: 907 TRT - VERBOSE Registering layer: Where_766 for ONNX node: Where_766 TRT - VERBOSE Registering tensor: 908 for ONNX tensor: 908 TRT - VERBOSE Where_766 [Where] outputs: [908 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Neg_767 [Neg] TRT - VERBOSE Searching for input: 894 TRT - VERBOSE Neg_767 [Neg] inputs: [894 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Neg_767 for ONNX node: Neg_767 TRT - VERBOSE Registering tensor: 909 for ONNX tensor: 909 TRT - VERBOSE Neg_767 [Neg] outputs: [909 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Div_768 [Div] TRT - VERBOSE Searching for input: 909 TRT - VERBOSE Searching for input: 902 TRT - VERBOSE Div_768 [Div] inputs: [909 -> (-1, 1, -1, -1)[FLOAT]], [902 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Div_768 for ONNX node: Div_768 TRT - VERBOSE Registering tensor: 910 for ONNX tensor: 910 TRT - VERBOSE Div_768 [Div] outputs: [910 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Equal_770 [Equal] TRT - VERBOSE Searching for input: 910 TRT - VERBOSE Searching for input: 911 TRT - VERBOSE Equal_770 [Equal] inputs: [910 -> (-1, 1, -1, -1)[FLOAT]], [911 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 911 for ONNX node: 911 TRT - VERBOSE Registering layer: Equal_770 for ONNX node: Equal_770 TRT - VERBOSE Registering tensor: 912 for ONNX tensor: 912 TRT - VERBOSE Equal_770 [Equal] outputs: [912 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_771 [Cast] TRT - VERBOSE Searching for input: 912 TRT - VERBOSE Cast_771 [Cast] inputs: [912 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_771 for ONNX node: Cast_771 TRT - VERBOSE Registering tensor: 913 for ONNX tensor: 913 TRT - VERBOSE Cast_771 [Cast] outputs: [913 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Where_773 [Where] TRT - VERBOSE Searching for input: 913 TRT - VERBOSE Searching for input: 914 TRT - VERBOSE Searching for input: 910 TRT - VERBOSE Where_773 [Where] inputs: [913 -> (-1, 1, -1, -1)[BOOL]], [914 -> ()[FLOAT]], [910 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: 914 for ONNX node: 914 TRT - VERBOSE Registering layer: Where_773 for ONNX node: Where_773 TRT - VERBOSE Registering tensor: 915 for ONNX tensor: 915 TRT - VERBOSE Where_773 [Where] outputs: [915 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Div_774 [Div] TRT - VERBOSE Searching for input: 893 TRT - VERBOSE Searching for input: 902 TRT - VERBOSE Div_774 [Div] inputs: [893 -> (-1, 1, -1, -1)[FLOAT]], [902 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Div_774 for ONNX node: Div_774 TRT - VERBOSE Registering tensor: 916 for ONNX tensor: 916 TRT - VERBOSE Div_774 [Div] outputs: [916 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Equal_776 [Equal] TRT - VERBOSE Searching for input: 916 TRT - VERBOSE Searching for input: 917 TRT - VERBOSE Equal_776 [Equal] inputs: [916 -> (-1, 1, -1, -1)[FLOAT]], [917 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 917 for ONNX node: 917 TRT - VERBOSE Registering layer: Equal_776 for ONNX node: Equal_776 TRT - VERBOSE Registering tensor: 918 for ONNX tensor: 918 TRT - VERBOSE Equal_776 [Equal] outputs: [918 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Cast_777 [Cast] TRT - VERBOSE Searching for input: 918 TRT - VERBOSE Cast_777 [Cast] inputs: [918 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Casting to type: bool TRT - VERBOSE Registering layer: Cast_777 for ONNX node: Cast_777 TRT - VERBOSE Registering tensor: 919 for ONNX tensor: 919 TRT - VERBOSE Cast_777 [Cast] outputs: [919 -> (-1, 1, -1, -1)[BOOL]], TRT - VERBOSE Parsing node: Where_779 [Where] TRT - VERBOSE Searching for input: 919 TRT - VERBOSE Searching for input: 920 TRT - VERBOSE Searching for input: 916 TRT - VERBOSE Where_779 [Where] inputs: [919 -> (-1, 1, -1, -1)[BOOL]], [920 -> ()[FLOAT]], [916 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: 920 for ONNX node: 920 TRT - VERBOSE Registering layer: Where_779 for ONNX node: Where_779 TRT - VERBOSE Registering tensor: 921 for ONNX tensor: 921 TRT - VERBOSE Where_779 [Where] outputs: [921 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_780 [Mul] TRT - VERBOSE Searching for input: 908 TRT - VERBOSE Searching for input: 897 TRT - VERBOSE Mul_780 [Mul] inputs: [908 -> (-1, 1, -1, -1)[FLOAT]], [897 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_780 for ONNX node: Mul_780 TRT - VERBOSE Registering tensor: 922 for ONNX tensor: 922 TRT - VERBOSE Mul_780 [Mul] outputs: [922 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_781 [Mul] TRT - VERBOSE Searching for input: 915 TRT - VERBOSE Searching for input: 899 TRT - VERBOSE Mul_781 [Mul] inputs: [915 -> (-1, 1, -1, -1)[FLOAT]], [899 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_781 for ONNX node: Mul_781 TRT - VERBOSE Registering tensor: 923 for ONNX tensor: 923 TRT - VERBOSE Mul_781 [Mul] outputs: [923 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Add_782 [Add] TRT - VERBOSE Searching for input: 922 TRT - VERBOSE Searching for input: 923 TRT - VERBOSE Add_782 [Add] inputs: [922 -> (-1, 1, -1, -1)[FLOAT]], [923 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Add_782 for ONNX node: Add_782 TRT - VERBOSE Registering tensor: 924 for ONNX tensor: 924 TRT - VERBOSE Add_782 [Add] outputs: [924 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Neg_783 [Neg] TRT - VERBOSE Searching for input: 924 TRT - VERBOSE Neg_783 [Neg] inputs: [924 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Neg_783 for ONNX node: Neg_783 TRT - VERBOSE Registering tensor: 925 for ONNX tensor: 925 TRT - VERBOSE Neg_783 [Neg] outputs: [925 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_784 [Mul] TRT - VERBOSE Searching for input: 915 TRT - VERBOSE Searching for input: 897 TRT - VERBOSE Mul_784 [Mul] inputs: [915 -> (-1, 1, -1, -1)[FLOAT]], [897 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_784 for ONNX node: Mul_784 TRT - VERBOSE Registering tensor: 926 for ONNX tensor: 926 TRT - VERBOSE Mul_784 [Mul] outputs: [926 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_785 [Mul] TRT - VERBOSE Searching for input: 921 TRT - VERBOSE Searching for input: 899 TRT - VERBOSE Mul_785 [Mul] inputs: [921 -> (-1, 1, -1, -1)[FLOAT]], [899 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Mul_785 for ONNX node: Mul_785 TRT - VERBOSE Registering tensor: 927 for ONNX tensor: 927 TRT - VERBOSE Mul_785 [Mul] outputs: [927 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Add_786 [Add] TRT - VERBOSE Searching for input: 926 TRT - VERBOSE Searching for input: 927 TRT - VERBOSE Add_786 [Add] inputs: [926 -> (-1, 1, -1, -1)[FLOAT]], [927 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Add_786 for ONNX node: Add_786 TRT - VERBOSE Registering tensor: 928 for ONNX tensor: 928 TRT - VERBOSE Add_786 [Add] outputs: [928 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Neg_787 [Neg] TRT - VERBOSE Searching for input: 928 TRT - VERBOSE Neg_787 [Neg] inputs: [928 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Neg_787 for ONNX node: Neg_787 TRT - VERBOSE Registering tensor: 929 for ONNX tensor: 929 TRT - VERBOSE Neg_787 [Neg] outputs: [929 -> (-1, 1, -1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_789 [Unsqueeze] TRT - VERBOSE Searching for input: 925 TRT - VERBOSE Searching for input: 930 TRT - VERBOSE Unsqueeze_789 [Unsqueeze] inputs: [925 -> (-1, 1, -1, -1)[FLOAT]], [930 -> (1)[INT32]], TRT - VERBOSE Original shape: (_, 1, _, _), unsqueezing to: (_, _, _, _, _) TRT - VERBOSE Registering layer: Unsqueeze_789 for ONNX node: Unsqueeze_789 TRT - VERBOSE Registering tensor: 931 for ONNX tensor: 931 TRT - VERBOSE Unsqueeze_789 [Unsqueeze] outputs: [931 -> (-1, 1, -1, -1, 1)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_791 [Unsqueeze] TRT - VERBOSE Searching for input: 929 TRT - VERBOSE Searching for input: 932 TRT - VERBOSE Unsqueeze_791 [Unsqueeze] inputs: [929 -> (-1, 1, -1, -1)[FLOAT]], [932 -> (1)[INT32]], TRT - VERBOSE Original shape: (_, 1, _, _), unsqueezing to: (_, _, _, _, _) TRT - VERBOSE Registering layer: Unsqueeze_791 for ONNX node: Unsqueeze_791 TRT - VERBOSE Registering tensor: 933 for ONNX tensor: 933 TRT - VERBOSE Unsqueeze_791 [Unsqueeze] outputs: [933 -> (-1, 1, -1, -1, 1)[FLOAT]], TRT - VERBOSE Parsing node: Concat_792 [Concat] TRT - VERBOSE Searching for input: 931 TRT - VERBOSE Searching for input: 933 TRT - VERBOSE Concat_792 [Concat] inputs: [931 -> (-1, 1, -1, -1, 1)[FLOAT]], [933 -> (-1, 1, -1, -1, 1)[FLOAT]], TRT - VERBOSE Registering layer: Concat_792 for ONNX node: Concat_792 TRT - VERBOSE Registering tensor: 934 for ONNX tensor: 934 TRT - VERBOSE Concat_792 [Concat] outputs: [934 -> (-1, 1, -1, -1, 2)[FLOAT]], TRT - VERBOSE Parsing node: Clip_793 [Clip] TRT - VERBOSE Searching for input: 934 TRT - VERBOSE Searching for input: 1225 TRT - VERBOSE Searching for input: 1226 TRT - VERBOSE Clip_793 [Clip] inputs: [934 -> (-1, 1, -1, -1, 2)[FLOAT]], [1225 -> ()[FLOAT]], [1226 -> ()[FLOAT]], TRT - VERBOSE Registering layer: Clip_793 for ONNX node: Clip_793 TRT - VERBOSE Registering tensor: 939 for ONNX tensor: 939 TRT - VERBOSE Clip_793 [Clip] outputs: [939 -> (-1, 1, -1, -1, 2)[FLOAT]], TRT - VERBOSE Parsing node: Gather_795 [Gather] TRT - VERBOSE Searching for input: 892 TRT - VERBOSE Searching for input: 940 TRT - VERBOSE Gather_795 [Gather] inputs: [892 -> (1, 8000, 2)[INT32]], [940 -> ()[INT32]], TRT - VERBOSE Registering layer: 940 for ONNX node: 940 TRT - VERBOSE Using Gather axis: 2 TRT - VERBOSE Registering layer: Gather_795 for ONNX node: Gather_795 TRT - VERBOSE Registering tensor: 941 for ONNX tensor: 941 TRT - VERBOSE Gather_795 [Gather] outputs: [941 -> (1, 8000)[INT32]], TRT - VERBOSE Parsing node: Gather_797 [Gather] TRT - VERBOSE Searching for input: 892 TRT - VERBOSE Searching for input: 942 TRT - VERBOSE Gather_797 [Gather] inputs: [892 -> (1, 8000, 2)[INT32]], [942 -> ()[INT32]], TRT - VERBOSE Registering layer: 942 for ONNX node: 942 TRT - VERBOSE Using Gather axis: 2 TRT - VERBOSE Registering layer: Gather_797 for ONNX node: Gather_797 TRT - VERBOSE Registering tensor: 943 for ONNX tensor: 943 TRT - VERBOSE Gather_797 [Gather] outputs: [943 -> (1, 8000)[INT32]], TRT - VERBOSE Parsing node: Shape_798 [Shape] TRT - VERBOSE Searching for input: 939 TRT - VERBOSE Shape_798 [Shape] inputs: [939 -> (-1, 1, -1, -1, 2)[FLOAT]], TRT - VERBOSE Registering layer: Shape_798 for ONNX node: Shape_798 TRT - VERBOSE Registering tensor: 944 for ONNX tensor: 944 TRT - VERBOSE Shape_798 [Shape] outputs: [944 -> (5)[INT32]], TRT - VERBOSE Parsing node: Gather_800 [Gather] TRT - VERBOSE Searching for input: 944 TRT - VERBOSE Searching for input: 945 TRT - VERBOSE Gather_800 [Gather] inputs: [944 -> (5)[INT32]], [945 -> (1)[INT32]], TRT - VERBOSE Registering layer: 945 for ONNX node: 945 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_800 for ONNX node: Gather_800 TRT - VERBOSE Registering tensor: 946 for ONNX tensor: 946 TRT - VERBOSE Gather_800 [Gather] outputs: [946 -> (1)[INT32]], TRT - VERBOSE Parsing node: Gather_802 [Gather] TRT - VERBOSE Searching for input: 944 TRT - VERBOSE Searching for input: 947 TRT - VERBOSE Gather_802 [Gather] inputs: [944 -> (5)[INT32]], [947 -> (1)[INT32]], TRT - VERBOSE Registering layer: 947 for ONNX node: 947 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_802 for ONNX node: Gather_802 TRT - VERBOSE Registering tensor: 948 for ONNX tensor: 948 TRT - VERBOSE Gather_802 [Gather] outputs: [948 -> (1)[INT32]], TRT - VERBOSE Parsing node: Gather_804 [Gather] TRT - VERBOSE Searching for input: 944 TRT - VERBOSE Searching for input: 949 TRT - VERBOSE Gather_804 [Gather] inputs: [944 -> (5)[INT32]], [949 -> (1)[INT32]], TRT - VERBOSE Registering layer: 949 for ONNX node: 949 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_804 for ONNX node: Gather_804 TRT - VERBOSE Registering tensor: 950 for ONNX tensor: 950 TRT - VERBOSE Gather_804 [Gather] outputs: [950 -> (1)[INT32]], TRT - VERBOSE Parsing node: Gather_806 [Gather] TRT - VERBOSE Searching for input: 944 TRT - VERBOSE Searching for input: 951 TRT - VERBOSE Gather_806 [Gather] inputs: [944 -> (5)[INT32]], [951 -> (1)[INT32]], TRT - VERBOSE Registering layer: 951 for ONNX node: 951 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_806 for ONNX node: Gather_806 TRT - VERBOSE Registering tensor: 952 for ONNX tensor: 952 TRT - VERBOSE Gather_806 [Gather] outputs: [952 -> (1)[INT32]], TRT - VERBOSE Parsing node: Transpose_807 [Transpose] TRT - VERBOSE Searching for input: 939 TRT - VERBOSE Transpose_807 [Transpose] inputs: [939 -> (-1, 1, -1, -1, 2)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_807 for ONNX node: Transpose_807 TRT - VERBOSE Registering tensor: 953 for ONNX tensor: 953 TRT - VERBOSE Transpose_807 [Transpose] outputs: [953 -> (-1, -1, -1, 1, 2)[FLOAT]], TRT - VERBOSE Parsing node: Flatten_808 [Flatten] TRT - VERBOSE Searching for input: 953 TRT - VERBOSE Flatten_808 [Flatten] inputs: [953 -> (-1, -1, -1, 1, 2)[FLOAT]], TRT - VERBOSE Registering layer: Flatten_808 for ONNX node: Flatten_808 TRT - VERBOSE Registering tensor: 954 for ONNX tensor: 954 TRT - VERBOSE Flatten_808 [Flatten] outputs: [954 -> (-1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_809 [Mul] TRT - VERBOSE Searching for input: 941 TRT - VERBOSE Searching for input: 950 TRT - VERBOSE Mul_809 [Mul] inputs: [941 -> (1, 8000)[INT32]], [950 -> (1)[INT32]], TRT - VERBOSE Registering layer: Mul_809 for ONNX node: Mul_809 TRT - VERBOSE Registering tensor: 955 for ONNX tensor: 955 TRT - VERBOSE Mul_809 [Mul] outputs: [955 -> (1, 8000)[INT32]], TRT - VERBOSE Parsing node: Add_810 [Add] TRT - VERBOSE Searching for input: 943 TRT - VERBOSE Searching for input: 955 TRT - VERBOSE Add_810 [Add] inputs: [943 -> (1, 8000)[INT32]], [955 -> (1, 8000)[INT32]], TRT - VERBOSE Registering layer: Add_810 for ONNX node: Add_810 TRT - VERBOSE Registering tensor: 956 for ONNX tensor: 956 TRT - VERBOSE Add_810 [Add] outputs: [956 -> (1, 8000)[INT32]], TRT - VERBOSE Parsing node: Gather_811 [Gather] TRT - VERBOSE Searching for input: 954 TRT - VERBOSE Searching for input: 956 TRT - VERBOSE Gather_811 [Gather] inputs: [954 -> (-1, -1)[FLOAT]], [956 -> (1, 8000)[INT32]], TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_811 for ONNX node: Gather_811 TRT - VERBOSE Registering tensor: 957 for ONNX tensor: 957 TRT - VERBOSE Gather_811 [Gather] outputs: [957 -> (1, 8000, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_812 [Shape] TRT - VERBOSE Searching for input: 956 TRT - VERBOSE Shape_812 [Shape] inputs: [956 -> (1, 8000)[INT32]], TRT - VERBOSE Registering layer: Shape_812 for ONNX node: Shape_812 TRT - VERBOSE Registering tensor: 958 for ONNX tensor: 958 TRT - VERBOSE Shape_812 [Shape] outputs: [958 -> (2)[INT32]], TRT - VERBOSE Parsing node: Concat_814 [Concat] TRT - VERBOSE Searching for input: 959 TRT - VERBOSE Searching for input: 946 TRT - VERBOSE Searching for input: 948 TRT - VERBOSE Searching for input: 952 TRT - VERBOSE Concat_814 [Concat] inputs: [959 -> (1)[INT32]], [946 -> (1)[INT32]], [948 -> (1)[INT32]], [952 -> (1)[INT32]], TRT - VERBOSE Registering layer: 959 for ONNX node: 959 TRT - VERBOSE Registering layer: Concat_814 for ONNX node: Concat_814 TRT - VERBOSE Registering tensor: 960 for ONNX tensor: 960 TRT - VERBOSE Concat_814 [Concat] outputs: [960 -> (4)[INT32]], TRT - VERBOSE Parsing node: Reshape_815 [Reshape] TRT - VERBOSE Searching for input: 957 TRT - VERBOSE Searching for input: 960 TRT - VERBOSE Reshape_815 [Reshape] inputs: [957 -> (1, 8000, -1)[FLOAT]], [960 -> (4)[INT32]], TRT - VERBOSE Registering layer: Reshape_815 for ONNX node: Reshape_815 TRT - VERBOSE Registering tensor: 961 for ONNX tensor: 961 TRT - VERBOSE Reshape_815 [Reshape] outputs: [961 -> (-1, -1, 1, 2)[FLOAT]], TRT - VERBOSE Parsing node: Transpose_816 [Transpose] TRT - VERBOSE Searching for input: 961 TRT - VERBOSE Transpose_816 [Transpose] inputs: [961 -> (-1, -1, 1, 2)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_816 for ONNX node: Transpose_816 TRT - VERBOSE Registering tensor: 962 for ONNX tensor: 962 TRT - VERBOSE Transpose_816 [Transpose] outputs: [962 -> (-1, 1, -1, 2)[FLOAT]], TRT - VERBOSE Parsing node: Concat_817 [Concat] TRT - VERBOSE Searching for input: 946 TRT - VERBOSE Searching for input: 948 TRT - VERBOSE Searching for input: 958 TRT - VERBOSE Searching for input: 952 TRT - VERBOSE Concat_817 [Concat] inputs: [946 -> (1)[INT32]], [948 -> (1)[INT32]], [958 -> (2)[INT32]], [952 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_817 for ONNX node: Concat_817 TRT - VERBOSE Registering tensor: 963 for ONNX tensor: 963 TRT - VERBOSE Concat_817 [Concat] outputs: [963 -> (5)[INT32]], TRT - VERBOSE Parsing node: Reshape_818 [Reshape] TRT - VERBOSE Searching for input: 962 TRT - VERBOSE Searching for input: 963 TRT - VERBOSE Reshape_818 [Reshape] inputs: [962 -> (-1, 1, -1, 2)[FLOAT]], [963 -> (5)[INT32]], TRT - VERBOSE Registering layer: Reshape_818 for ONNX node: Reshape_818 TRT - VERBOSE Registering tensor: 964 for ONNX tensor: 964 TRT - VERBOSE Reshape_818 [Reshape] outputs: [964 -> (-1, 1, 1, 8000, 2)[FLOAT]], TRT - VERBOSE Parsing node: Shape_819 [Shape] TRT - VERBOSE Searching for input: 964 TRT - VERBOSE Shape_819 [Shape] inputs: [964 -> (-1, 1, 1, 8000, 2)[FLOAT]], TRT - VERBOSE Registering layer: Shape_819 for ONNX node: Shape_819 TRT - VERBOSE Registering tensor: 965 for ONNX tensor: 965 TRT - VERBOSE Shape_819 [Shape] outputs: [965 -> (5)[INT32]], TRT - VERBOSE Parsing node: Gather_821 [Gather] TRT - VERBOSE Searching for input: 965 TRT - VERBOSE Searching for input: 966 TRT - VERBOSE Gather_821 [Gather] inputs: [965 -> (5)[INT32]], [966 -> ()[INT32]], TRT - VERBOSE Registering layer: 966 for ONNX node: 966 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_821 for ONNX node: Gather_821 TRT - VERBOSE Registering tensor: 967 for ONNX tensor: 967 TRT - VERBOSE Gather_821 [Gather] outputs: [967 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_822 [Shape] TRT - VERBOSE Searching for input: 964 TRT - VERBOSE Shape_822 [Shape] inputs: [964 -> (-1, 1, 1, 8000, 2)[FLOAT]], TRT - VERBOSE Registering layer: Shape_822 for ONNX node: Shape_822 TRT - VERBOSE Registering tensor: 968 for ONNX tensor: 968 TRT - VERBOSE Shape_822 [Shape] outputs: [968 -> (5)[INT32]], TRT - VERBOSE Parsing node: Gather_824 [Gather] TRT - VERBOSE Searching for input: 968 TRT - VERBOSE Searching for input: 969 TRT - VERBOSE Gather_824 [Gather] inputs: [968 -> (5)[INT32]], [969 -> ()[INT32]], TRT - VERBOSE Registering layer: 969 for ONNX node: 969 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_824 for ONNX node: Gather_824 TRT - VERBOSE Registering tensor: 970 for ONNX tensor: 970 TRT - VERBOSE Gather_824 [Gather] outputs: [970 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_825 [Shape] TRT - VERBOSE Searching for input: 964 TRT - VERBOSE Shape_825 [Shape] inputs: [964 -> (-1, 1, 1, 8000, 2)[FLOAT]], TRT - VERBOSE Registering layer: Shape_825 for ONNX node: Shape_825 TRT - VERBOSE Registering tensor: 971 for ONNX tensor: 971 TRT - VERBOSE Shape_825 [Shape] outputs: [971 -> (5)[INT32]], TRT - VERBOSE Parsing node: Gather_827 [Gather] TRT - VERBOSE Searching for input: 971 TRT - VERBOSE Searching for input: 972 TRT - VERBOSE Gather_827 [Gather] inputs: [971 -> (5)[INT32]], [972 -> ()[INT32]], TRT - VERBOSE Registering layer: 972 for ONNX node: 972 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_827 for ONNX node: Gather_827 TRT - VERBOSE Registering tensor: 973 for ONNX tensor: 973 TRT - VERBOSE Gather_827 [Gather] outputs: [973 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_829 [Unsqueeze] TRT - VERBOSE Searching for input: 967 TRT - VERBOSE Searching for input: 974 TRT - VERBOSE Unsqueeze_829 [Unsqueeze] inputs: [967 -> ()[INT32]], [974 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_829 for ONNX node: Unsqueeze_829 TRT - VERBOSE Registering tensor: 975 for ONNX tensor: 975 TRT - VERBOSE Unsqueeze_829 [Unsqueeze] outputs: [975 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_831 [Unsqueeze] TRT - VERBOSE Searching for input: 970 TRT - VERBOSE Searching for input: 976 TRT - VERBOSE Unsqueeze_831 [Unsqueeze] inputs: [970 -> ()[INT32]], [976 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_831 for ONNX node: Unsqueeze_831 TRT - VERBOSE Registering tensor: 977 for ONNX tensor: 977 TRT - VERBOSE Unsqueeze_831 [Unsqueeze] outputs: [977 -> (1)[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_833 [Unsqueeze] TRT - VERBOSE Searching for input: 973 TRT - VERBOSE Searching for input: 978 TRT - VERBOSE Unsqueeze_833 [Unsqueeze] inputs: [973 -> ()[INT32]], [978 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_833 for ONNX node: Unsqueeze_833 TRT - VERBOSE Registering tensor: 979 for ONNX tensor: 979 TRT - VERBOSE Unsqueeze_833 [Unsqueeze] outputs: [979 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_834 [Concat] TRT - VERBOSE Searching for input: 975 TRT - VERBOSE Searching for input: 977 TRT - VERBOSE Searching for input: 979 TRT - VERBOSE Concat_834 [Concat] inputs: [975 -> (1)[INT32]], [977 -> (1)[INT32]], [979 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_834 for ONNX node: Concat_834 TRT - VERBOSE Registering tensor: 980 for ONNX tensor: 980 TRT - VERBOSE Concat_834 [Concat] outputs: [980 -> (3)[INT32]], TRT - VERBOSE Parsing node: Reshape_835 [Reshape] TRT - VERBOSE Searching for input: 964 TRT - VERBOSE Searching for input: 980 TRT - VERBOSE Reshape_835 [Reshape] inputs: [964 -> (-1, 1, 1, 8000, 2)[FLOAT]], [980 -> (3)[INT32]], TRT - VERBOSE Registering layer: Reshape_835 for ONNX node: Reshape_835 TRT - VERBOSE Registering tensor: 981 for ONNX tensor: 981 TRT - VERBOSE Reshape_835 [Reshape] outputs: [981 -> (-1, 8000, 2)[FLOAT]], TRT - VERBOSE Parsing node: Cast_836 [Cast] TRT - VERBOSE Searching for input: 892 TRT - VERBOSE Cast_836 [Cast] inputs: [892 -> (1, 8000, 2)[INT32]], TRT - VERBOSE Casting to type: float32 TRT - VERBOSE Registering layer: Cast_836 for ONNX node: Cast_836 TRT - VERBOSE Registering tensor: 982 for ONNX tensor: 982 TRT - VERBOSE Cast_836 [Cast] outputs: [982 -> (1, 8000, 2)[FLOAT]], TRT - VERBOSE Parsing node: Add_837 [Add] TRT - VERBOSE Searching for input: 982 TRT - VERBOSE Searching for input: 981 TRT - VERBOSE Add_837 [Add] inputs: [982 -> (1, 8000, 2)[FLOAT]], [981 -> (-1, 8000, 2)[FLOAT]], TRT - VERBOSE Registering layer: Add_837 for ONNX node: Add_837 TRT - VERBOSE Registering tensor: 983 for ONNX tensor: 983 TRT - VERBOSE Add_837 [Add] outputs: [983 -> (-1, 8000, 2)[FLOAT]], TRT - VERBOSE Parsing node: Transpose_838 [Transpose] TRT - VERBOSE Searching for input: 891 TRT - VERBOSE Transpose_838 [Transpose] inputs: [891 -> (1, 8000)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_838 for ONNX node: Transpose_838 TRT - VERBOSE Registering tensor: scores_344 for ONNX tensor: scores TRT - VERBOSE Transpose_838 [Transpose] outputs: [scores -> (8000, 1)[FLOAT]], TRT - VERBOSE Parsing node: Div_839 [Div] TRT - VERBOSE Searching for input: 983 TRT - VERBOSE Searching for input: 1227 TRT - VERBOSE Div_839 [Div] inputs: [983 -> (-1, 8000, 2)[FLOAT]], [1227 -> ()[FLOAT]], TRT - VERBOSE Registering layer: 1227 for ONNX node: 1227 TRT - VERBOSE Registering layer: Div_839 for ONNX node: Div_839 TRT - VERBOSE Registering tensor: 987 for ONNX tensor: 987 TRT - VERBOSE Div_839 [Div] outputs: [987 -> (-1, 8000, 2)[FLOAT]], TRT - VERBOSE Parsing node: Shape_840 [Shape] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Shape_840 [Shape] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_840 for ONNX node: Shape_840 TRT - VERBOSE Registering tensor: 988 for ONNX tensor: 988 TRT - VERBOSE Shape_840 [Shape] outputs: [988 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_842 [Gather] TRT - VERBOSE Searching for input: 988 TRT - VERBOSE Searching for input: 989 TRT - VERBOSE Gather_842 [Gather] inputs: [988 -> (4)[INT32]], [989 -> ()[INT32]], TRT - VERBOSE Registering layer: 989 for ONNX node: 989 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_842 for ONNX node: Gather_842 TRT - VERBOSE Registering tensor: 990 for ONNX tensor: 990 TRT - VERBOSE Gather_842 [Gather] outputs: [990 -> ()[INT32]], TRT - VERBOSE Parsing node: Shape_843 [Shape] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Shape_843 [Shape] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_843 for ONNX node: Shape_843 TRT - VERBOSE Registering tensor: 991 for ONNX tensor: 991 TRT - VERBOSE Shape_843 [Shape] outputs: [991 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_845 [Gather] TRT - VERBOSE Searching for input: 991 TRT - VERBOSE Searching for input: 992 TRT - VERBOSE Gather_845 [Gather] inputs: [991 -> (4)[INT32]], [992 -> ()[INT32]], TRT - VERBOSE Registering layer: 992 for ONNX node: 992 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_845 for ONNX node: Gather_845 TRT - VERBOSE Registering tensor: 993 for ONNX tensor: 993 TRT - VERBOSE Gather_845 [Gather] outputs: [993 -> ()[INT32]], TRT - VERBOSE Parsing node: Gather_847 [Gather] TRT - VERBOSE Searching for input: 987 TRT - VERBOSE Searching for input: 994 TRT - VERBOSE Gather_847 [Gather] inputs: [987 -> (-1, 8000, 2)[FLOAT]], [994 -> ()[INT32]], TRT - VERBOSE Registering layer: 994 for ONNX node: 994 TRT - VERBOSE Using Gather axis: 2 TRT - VERBOSE Registering layer: Gather_847 for ONNX node: Gather_847 TRT - VERBOSE Registering tensor: 995 for ONNX tensor: 995 TRT - VERBOSE Gather_847 [Gather] outputs: [995 -> (-1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Shape_848 [Shape] TRT - VERBOSE Searching for input: 987 TRT - VERBOSE Shape_848 [Shape] inputs: [987 -> (-1, 8000, 2)[FLOAT]], TRT - VERBOSE Registering layer: Shape_848 for ONNX node: Shape_848 TRT - VERBOSE Registering tensor: 996 for ONNX tensor: 996 TRT - VERBOSE Shape_848 [Shape] outputs: [996 -> (3)[INT32]], TRT - VERBOSE Parsing node: Gather_850 [Gather] TRT - VERBOSE Searching for input: 996 TRT - VERBOSE Searching for input: 997 TRT - VERBOSE Gather_850 [Gather] inputs: [996 -> (3)[INT32]], [997 -> ()[INT32]], TRT - VERBOSE Registering layer: 997 for ONNX node: 997 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_850 for ONNX node: Gather_850 TRT - VERBOSE Registering tensor: 998 for ONNX tensor: 998 TRT - VERBOSE Gather_850 [Gather] outputs: [998 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_852 [Unsqueeze] TRT - VERBOSE Searching for input: 998 TRT - VERBOSE Searching for input: 999 TRT - VERBOSE Unsqueeze_852 [Unsqueeze] inputs: [998 -> ()[INT32]], [999 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_852 for ONNX node: Unsqueeze_852 TRT - VERBOSE Registering tensor: 1000 for ONNX tensor: 1000 TRT - VERBOSE Unsqueeze_852 [Unsqueeze] outputs: [1000 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_853 [Concat] TRT - VERBOSE Searching for input: 1000 TRT - VERBOSE Concat_853 [Concat] inputs: [1000 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_853 for ONNX node: Concat_853 TRT - VERBOSE Registering tensor: 1001 for ONNX tensor: 1001 TRT - VERBOSE Concat_853 [Concat] outputs: [1001 -> (1)[INT32]], TRT - VERBOSE Parsing node: Reshape_854 [Reshape] TRT - VERBOSE Searching for input: 995 TRT - VERBOSE Searching for input: 1001 TRT - VERBOSE Reshape_854 [Reshape] inputs: [995 -> (-1, 8000)[FLOAT]], [1001 -> (1)[INT32]], TRT - VERBOSE Registering layer: Reshape_854 for ONNX node: Reshape_854 TRT - VERBOSE Registering tensor: 1002 for ONNX tensor: 1002 TRT - VERBOSE Reshape_854 [Reshape] outputs: [1002 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Gather_856 [Gather] TRT - VERBOSE Searching for input: 987 TRT - VERBOSE Searching for input: 1003 TRT - VERBOSE Gather_856 [Gather] inputs: [987 -> (-1, 8000, 2)[FLOAT]], [1003 -> ()[INT32]], TRT - VERBOSE Registering layer: 1003 for ONNX node: 1003 TRT - VERBOSE Using Gather axis: 2 TRT - VERBOSE Registering layer: Gather_856 for ONNX node: Gather_856 TRT - VERBOSE Registering tensor: 1004 for ONNX tensor: 1004 TRT - VERBOSE Gather_856 [Gather] outputs: [1004 -> (-1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Shape_857 [Shape] TRT - VERBOSE Searching for input: 987 TRT - VERBOSE Shape_857 [Shape] inputs: [987 -> (-1, 8000, 2)[FLOAT]], TRT - VERBOSE Registering layer: Shape_857 for ONNX node: Shape_857 TRT - VERBOSE Registering tensor: 1005 for ONNX tensor: 1005 TRT - VERBOSE Shape_857 [Shape] outputs: [1005 -> (3)[INT32]], TRT - VERBOSE Parsing node: Gather_859 [Gather] TRT - VERBOSE Searching for input: 1005 TRT - VERBOSE Searching for input: 1006 TRT - VERBOSE Gather_859 [Gather] inputs: [1005 -> (3)[INT32]], [1006 -> ()[INT32]], TRT - VERBOSE Registering layer: 1006 for ONNX node: 1006 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_859 for ONNX node: Gather_859 TRT - VERBOSE Registering tensor: 1007 for ONNX tensor: 1007 TRT - VERBOSE Gather_859 [Gather] outputs: [1007 -> ()[INT32]], TRT - VERBOSE Parsing node: Unsqueeze_861 [Unsqueeze] TRT - VERBOSE Searching for input: 1007 TRT - VERBOSE Searching for input: 1008 TRT - VERBOSE Unsqueeze_861 [Unsqueeze] inputs: [1007 -> ()[INT32]], [1008 -> (1)[INT32]], TRT - VERBOSE Original shape: (), unsqueezing to: (1,) TRT - VERBOSE Registering layer: Unsqueeze_861 for ONNX node: Unsqueeze_861 TRT - VERBOSE Registering tensor: 1009 for ONNX tensor: 1009 TRT - VERBOSE Unsqueeze_861 [Unsqueeze] outputs: [1009 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_862 [Concat] TRT - VERBOSE Searching for input: 1009 TRT - VERBOSE Concat_862 [Concat] inputs: [1009 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_862 for ONNX node: Concat_862 TRT - VERBOSE Registering tensor: 1010 for ONNX tensor: 1010 TRT - VERBOSE Concat_862 [Concat] outputs: [1010 -> (1)[INT32]], TRT - VERBOSE Parsing node: Reshape_863 [Reshape] TRT - VERBOSE Searching for input: 1004 TRT - VERBOSE Searching for input: 1010 TRT - VERBOSE Reshape_863 [Reshape] inputs: [1004 -> (-1, 8000)[FLOAT]], [1010 -> (1)[INT32]], TRT - VERBOSE Registering layer: Reshape_863 for ONNX node: Reshape_863 TRT - VERBOSE Registering tensor: 1011 for ONNX tensor: 1011 TRT - VERBOSE Reshape_863 [Reshape] outputs: [1011 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Floor_864 [Floor] TRT - VERBOSE Searching for input: 1002 TRT - VERBOSE Floor_864 [Floor] inputs: [1002 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: Floor_864 for ONNX node: Floor_864 TRT - VERBOSE Registering tensor: 1012 for ONNX tensor: 1012 TRT - VERBOSE Floor_864 [Floor] outputs: [1012 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Cast_865 [Cast] TRT - VERBOSE Searching for input: 1012 TRT - VERBOSE Cast_865 [Cast] inputs: [1012 -> (8000)[FLOAT]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_865 for ONNX node: Cast_865 TRT - VERBOSE Registering tensor: 1013 for ONNX tensor: 1013 TRT - VERBOSE Cast_865 [Cast] outputs: [1013 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Sub_867 [Sub] TRT - VERBOSE Searching for input: 990 TRT - VERBOSE Searching for input: 1014 TRT - VERBOSE Sub_867 [Sub] inputs: [990 -> ()[INT32]], [1014 -> ()[INT32]], TRT - VERBOSE Registering layer: 1014 for ONNX node: 1014 TRT - VERBOSE Registering layer: Sub_867 for ONNX node: Sub_867 TRT - VERBOSE Registering tensor: 1015 for ONNX tensor: 1015 TRT - VERBOSE Sub_867 [Sub] outputs: [1015 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_868 [Cast] TRT - VERBOSE Searching for input: 1015 TRT - VERBOSE Cast_868 [Cast] inputs: [1015 -> ()[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_868 for ONNX node: Cast_868 TRT - VERBOSE Registering tensor: 1018 for ONNX tensor: 1018 TRT - VERBOSE Cast_868 [Cast] outputs: [1018 -> ()[INT32]], TRT - VERBOSE Parsing node: Clip_869 [Clip] TRT - VERBOSE Searching for input: 1013 TRT - VERBOSE Searching for input: 1228 TRT - VERBOSE Searching for input: 1018 TRT - VERBOSE Clip_869 [Clip] inputs: [1013 -> (8000)[INT32]], [1228 -> ()[INT32]], [1018 -> ()[INT32]], TRT - VERBOSE Registering layer: 1228 for ONNX node: 1228 TRT - VERBOSE Registering tensor: 1019 for ONNX tensor: 1019 TRT - VERBOSE Clip_869 [Clip] outputs: [1019 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Ceil_870 [Ceil] TRT - VERBOSE Searching for input: 1002 TRT - VERBOSE Ceil_870 [Ceil] inputs: [1002 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: Ceil_870 for ONNX node: Ceil_870 TRT - VERBOSE Registering tensor: 1020 for ONNX tensor: 1020 TRT - VERBOSE Ceil_870 [Ceil] outputs: [1020 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Cast_871 [Cast] TRT - VERBOSE Searching for input: 1020 TRT - VERBOSE Cast_871 [Cast] inputs: [1020 -> (8000)[FLOAT]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_871 for ONNX node: Cast_871 TRT - VERBOSE Registering tensor: 1021 for ONNX tensor: 1021 TRT - VERBOSE Cast_871 [Cast] outputs: [1021 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Sub_873 [Sub] TRT - VERBOSE Searching for input: 990 TRT - VERBOSE Searching for input: 1022 TRT - VERBOSE Sub_873 [Sub] inputs: [990 -> ()[INT32]], [1022 -> ()[INT32]], TRT - VERBOSE Registering layer: 1022 for ONNX node: 1022 TRT - VERBOSE Registering layer: Sub_873 for ONNX node: Sub_873 TRT - VERBOSE Registering tensor: 1023 for ONNX tensor: 1023 TRT - VERBOSE Sub_873 [Sub] outputs: [1023 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_874 [Cast] TRT - VERBOSE Searching for input: 1023 TRT - VERBOSE Cast_874 [Cast] inputs: [1023 -> ()[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_874 for ONNX node: Cast_874 TRT - VERBOSE Registering tensor: 1026 for ONNX tensor: 1026 TRT - VERBOSE Cast_874 [Cast] outputs: [1026 -> ()[INT32]], TRT - VERBOSE Parsing node: Clip_875 [Clip] TRT - VERBOSE Searching for input: 1021 TRT - VERBOSE Searching for input: 1229 TRT - VERBOSE Searching for input: 1026 TRT - VERBOSE Clip_875 [Clip] inputs: [1021 -> (8000)[INT32]], [1229 -> ()[INT32]], [1026 -> ()[INT32]], TRT - VERBOSE Registering layer: 1229 for ONNX node: 1229 TRT - VERBOSE Registering tensor: 1027 for ONNX tensor: 1027 TRT - VERBOSE Clip_875 [Clip] outputs: [1027 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Floor_876 [Floor] TRT - VERBOSE Searching for input: 1011 TRT - VERBOSE Floor_876 [Floor] inputs: [1011 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: Floor_876 for ONNX node: Floor_876 TRT - VERBOSE Registering tensor: 1028 for ONNX tensor: 1028 TRT - VERBOSE Floor_876 [Floor] outputs: [1028 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Cast_877 [Cast] TRT - VERBOSE Searching for input: 1028 TRT - VERBOSE Cast_877 [Cast] inputs: [1028 -> (8000)[FLOAT]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_877 for ONNX node: Cast_877 TRT - VERBOSE Registering tensor: 1029 for ONNX tensor: 1029 TRT - VERBOSE Cast_877 [Cast] outputs: [1029 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Sub_879 [Sub] TRT - VERBOSE Searching for input: 993 TRT - VERBOSE Searching for input: 1030 TRT - VERBOSE Sub_879 [Sub] inputs: [993 -> ()[INT32]], [1030 -> ()[INT32]], TRT - VERBOSE Registering layer: 1030 for ONNX node: 1030 TRT - VERBOSE Registering layer: Sub_879 for ONNX node: Sub_879 TRT - VERBOSE Registering tensor: 1031 for ONNX tensor: 1031 TRT - VERBOSE Sub_879 [Sub] outputs: [1031 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_880 [Cast] TRT - VERBOSE Searching for input: 1031 TRT - VERBOSE Cast_880 [Cast] inputs: [1031 -> ()[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_880 for ONNX node: Cast_880 TRT - VERBOSE Registering tensor: 1034 for ONNX tensor: 1034 TRT - VERBOSE Cast_880 [Cast] outputs: [1034 -> ()[INT32]], TRT - VERBOSE Parsing node: Clip_881 [Clip] TRT - VERBOSE Searching for input: 1029 TRT - VERBOSE Searching for input: 1230 TRT - VERBOSE Searching for input: 1034 TRT - VERBOSE Clip_881 [Clip] inputs: [1029 -> (8000)[INT32]], [1230 -> ()[INT32]], [1034 -> ()[INT32]], TRT - VERBOSE Registering layer: 1230 for ONNX node: 1230 TRT - VERBOSE Registering tensor: 1035 for ONNX tensor: 1035 TRT - VERBOSE Clip_881 [Clip] outputs: [1035 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Ceil_882 [Ceil] TRT - VERBOSE Searching for input: 1011 TRT - VERBOSE Ceil_882 [Ceil] inputs: [1011 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: Ceil_882 for ONNX node: Ceil_882 TRT - VERBOSE Registering tensor: 1036 for ONNX tensor: 1036 TRT - VERBOSE Ceil_882 [Ceil] outputs: [1036 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Cast_883 [Cast] TRT - VERBOSE Searching for input: 1036 TRT - VERBOSE Cast_883 [Cast] inputs: [1036 -> (8000)[FLOAT]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_883 for ONNX node: Cast_883 TRT - VERBOSE Registering tensor: 1037 for ONNX tensor: 1037 TRT - VERBOSE Cast_883 [Cast] outputs: [1037 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Sub_885 [Sub] TRT - VERBOSE Searching for input: 993 TRT - VERBOSE Searching for input: 1038 TRT - VERBOSE Sub_885 [Sub] inputs: [993 -> ()[INT32]], [1038 -> ()[INT32]], TRT - VERBOSE Registering layer: 1038 for ONNX node: 1038 TRT - VERBOSE Registering layer: Sub_885 for ONNX node: Sub_885 TRT - VERBOSE Registering tensor: 1039 for ONNX tensor: 1039 TRT - VERBOSE Sub_885 [Sub] outputs: [1039 -> ()[INT32]], TRT - VERBOSE Parsing node: Cast_886 [Cast] TRT - VERBOSE Searching for input: 1039 TRT - VERBOSE Cast_886 [Cast] inputs: [1039 -> ()[INT32]], TRT - VERBOSE Casting to type: int32 TRT - VERBOSE Registering layer: Cast_886 for ONNX node: Cast_886 TRT - VERBOSE Registering tensor: 1042 for ONNX tensor: 1042 TRT - VERBOSE Cast_886 [Cast] outputs: [1042 -> ()[INT32]], TRT - VERBOSE Parsing node: Clip_887 [Clip] TRT - VERBOSE Searching for input: 1037 TRT - VERBOSE Searching for input: 1231 TRT - VERBOSE Searching for input: 1042 TRT - VERBOSE Clip_887 [Clip] inputs: [1037 -> (8000)[INT32]], [1231 -> ()[INT32]], [1042 -> ()[INT32]], TRT - VERBOSE Registering layer: 1231 for ONNX node: 1231 TRT - VERBOSE Registering tensor: 1043 for ONNX tensor: 1043 TRT - VERBOSE Clip_887 [Clip] outputs: [1043 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Cast_888 [Cast] TRT - VERBOSE Searching for input: 1019 TRT - VERBOSE Cast_888 [Cast] inputs: [1019 -> (8000)[INT32]], TRT - VERBOSE Casting to type: float32 TRT - VERBOSE Registering layer: Cast_888 for ONNX node: Cast_888 TRT - VERBOSE Registering tensor: 1044 for ONNX tensor: 1044 TRT - VERBOSE Cast_888 [Cast] outputs: [1044 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Sub_889 [Sub] TRT - VERBOSE Searching for input: 1002 TRT - VERBOSE Searching for input: 1044 TRT - VERBOSE Sub_889 [Sub] inputs: [1002 -> (8000)[FLOAT]], [1044 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: Sub_889 for ONNX node: Sub_889 TRT - VERBOSE Registering tensor: 1045 for ONNX tensor: 1045 TRT - VERBOSE Sub_889 [Sub] outputs: [1045 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Cast_890 [Cast] TRT - VERBOSE Searching for input: 1035 TRT - VERBOSE Cast_890 [Cast] inputs: [1035 -> (8000)[INT32]], TRT - VERBOSE Casting to type: float32 TRT - VERBOSE Registering layer: Cast_890 for ONNX node: Cast_890 TRT - VERBOSE Registering tensor: 1046 for ONNX tensor: 1046 TRT - VERBOSE Cast_890 [Cast] outputs: [1046 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Sub_891 [Sub] TRT - VERBOSE Searching for input: 1011 TRT - VERBOSE Searching for input: 1046 TRT - VERBOSE Sub_891 [Sub] inputs: [1011 -> (8000)[FLOAT]], [1046 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: Sub_891 for ONNX node: Sub_891 TRT - VERBOSE Registering tensor: 1047 for ONNX tensor: 1047 TRT - VERBOSE Sub_891 [Sub] outputs: [1047 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Sub_893 [Sub] TRT - VERBOSE Searching for input: 1048 TRT - VERBOSE Searching for input: 1045 TRT - VERBOSE Sub_893 [Sub] inputs: [1048 -> ()[FLOAT]], [1045 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: 1048 for ONNX node: 1048 TRT - VERBOSE Registering layer: Sub_893 for ONNX node: Sub_893 TRT - VERBOSE Registering tensor: 1049 for ONNX tensor: 1049 TRT - VERBOSE Sub_893 [Sub] outputs: [1049 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Sub_895 [Sub] TRT - VERBOSE Searching for input: 1050 TRT - VERBOSE Searching for input: 1047 TRT - VERBOSE Sub_895 [Sub] inputs: [1050 -> ()[FLOAT]], [1047 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: 1050 for ONNX node: 1050 TRT - VERBOSE Registering layer: Sub_895 for ONNX node: Sub_895 TRT - VERBOSE Registering tensor: 1051 for ONNX tensor: 1051 TRT - VERBOSE Sub_895 [Sub] outputs: [1051 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Mul_896 [Mul] TRT - VERBOSE Searching for input: 1049 TRT - VERBOSE Searching for input: 1051 TRT - VERBOSE Mul_896 [Mul] inputs: [1049 -> (8000)[FLOAT]], [1051 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: Mul_896 for ONNX node: Mul_896 TRT - VERBOSE Registering tensor: 1052 for ONNX tensor: 1052 TRT - VERBOSE Mul_896 [Mul] outputs: [1052 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Sub_898 [Sub] TRT - VERBOSE Searching for input: 1053 TRT - VERBOSE Searching for input: 1045 TRT - VERBOSE Sub_898 [Sub] inputs: [1053 -> ()[FLOAT]], [1045 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: 1053 for ONNX node: 1053 TRT - VERBOSE Registering layer: Sub_898 for ONNX node: Sub_898 TRT - VERBOSE Registering tensor: 1054 for ONNX tensor: 1054 TRT - VERBOSE Sub_898 [Sub] outputs: [1054 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Mul_899 [Mul] TRT - VERBOSE Searching for input: 1054 TRT - VERBOSE Searching for input: 1047 TRT - VERBOSE Mul_899 [Mul] inputs: [1054 -> (8000)[FLOAT]], [1047 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: Mul_899 for ONNX node: Mul_899 TRT - VERBOSE Registering tensor: 1055 for ONNX tensor: 1055 TRT - VERBOSE Mul_899 [Mul] outputs: [1055 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Sub_901 [Sub] TRT - VERBOSE Searching for input: 1056 TRT - VERBOSE Searching for input: 1047 TRT - VERBOSE Sub_901 [Sub] inputs: [1056 -> ()[FLOAT]], [1047 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: 1056 for ONNX node: 1056 TRT - VERBOSE Registering layer: Sub_901 for ONNX node: Sub_901 TRT - VERBOSE Registering tensor: 1057 for ONNX tensor: 1057 TRT - VERBOSE Sub_901 [Sub] outputs: [1057 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Mul_902 [Mul] TRT - VERBOSE Searching for input: 1045 TRT - VERBOSE Searching for input: 1057 TRT - VERBOSE Mul_902 [Mul] inputs: [1045 -> (8000)[FLOAT]], [1057 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: Mul_902 for ONNX node: Mul_902 TRT - VERBOSE Registering tensor: 1058 for ONNX tensor: 1058 TRT - VERBOSE Mul_902 [Mul] outputs: [1058 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Mul_903 [Mul] TRT - VERBOSE Searching for input: 1045 TRT - VERBOSE Searching for input: 1047 TRT - VERBOSE Mul_903 [Mul] inputs: [1045 -> (8000)[FLOAT]], [1047 -> (8000)[FLOAT]], TRT - VERBOSE Registering layer: Mul_903 for ONNX node: Mul_903 TRT - VERBOSE Registering tensor: 1059 for ONNX tensor: 1059 TRT - VERBOSE Mul_903 [Mul] outputs: [1059 -> (8000)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_905 [Unsqueeze] TRT - VERBOSE Searching for input: 1052 TRT - VERBOSE Searching for input: 1060 TRT - VERBOSE Unsqueeze_905 [Unsqueeze] inputs: [1052 -> (8000)[FLOAT]], [1060 -> (1)[INT32]], TRT - VERBOSE Original shape: (8000,), unsqueezing to: (1, 8000) TRT - VERBOSE Registering layer: Unsqueeze_905 for ONNX node: Unsqueeze_905 TRT - VERBOSE Registering tensor: 1061 for ONNX tensor: 1061 TRT - VERBOSE Unsqueeze_905 [Unsqueeze] outputs: [1061 -> (1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_907 [Unsqueeze] TRT - VERBOSE Searching for input: 1061 TRT - VERBOSE Searching for input: 1062 TRT - VERBOSE Unsqueeze_907 [Unsqueeze] inputs: [1061 -> (1, 8000)[FLOAT]], [1062 -> (1)[INT32]], TRT - VERBOSE Original shape: (1, 8000), unsqueezing to: (1, 1, 8000) TRT - VERBOSE Registering layer: Unsqueeze_907 for ONNX node: Unsqueeze_907 TRT - VERBOSE Registering tensor: 1063 for ONNX tensor: 1063 TRT - VERBOSE Unsqueeze_907 [Unsqueeze] outputs: [1063 -> (1, 1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_909 [Unsqueeze] TRT - VERBOSE Searching for input: 1055 TRT - VERBOSE Searching for input: 1064 TRT - VERBOSE Unsqueeze_909 [Unsqueeze] inputs: [1055 -> (8000)[FLOAT]], [1064 -> (1)[INT32]], TRT - VERBOSE Original shape: (8000,), unsqueezing to: (1, 8000) TRT - VERBOSE Registering layer: Unsqueeze_909 for ONNX node: Unsqueeze_909 TRT - VERBOSE Registering tensor: 1065 for ONNX tensor: 1065 TRT - VERBOSE Unsqueeze_909 [Unsqueeze] outputs: [1065 -> (1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_911 [Unsqueeze] TRT - VERBOSE Searching for input: 1065 TRT - VERBOSE Searching for input: 1066 TRT - VERBOSE Unsqueeze_911 [Unsqueeze] inputs: [1065 -> (1, 8000)[FLOAT]], [1066 -> (1)[INT32]], TRT - VERBOSE Original shape: (1, 8000), unsqueezing to: (1, 1, 8000) TRT - VERBOSE Registering layer: Unsqueeze_911 for ONNX node: Unsqueeze_911 TRT - VERBOSE Registering tensor: 1067 for ONNX tensor: 1067 TRT - VERBOSE Unsqueeze_911 [Unsqueeze] outputs: [1067 -> (1, 1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_913 [Unsqueeze] TRT - VERBOSE Searching for input: 1058 TRT - VERBOSE Searching for input: 1068 TRT - VERBOSE Unsqueeze_913 [Unsqueeze] inputs: [1058 -> (8000)[FLOAT]], [1068 -> (1)[INT32]], TRT - VERBOSE Original shape: (8000,), unsqueezing to: (1, 8000) TRT - VERBOSE Registering layer: Unsqueeze_913 for ONNX node: Unsqueeze_913 TRT - VERBOSE Registering tensor: 1069 for ONNX tensor: 1069 TRT - VERBOSE Unsqueeze_913 [Unsqueeze] outputs: [1069 -> (1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_915 [Unsqueeze] TRT - VERBOSE Searching for input: 1069 TRT - VERBOSE Searching for input: 1070 TRT - VERBOSE Unsqueeze_915 [Unsqueeze] inputs: [1069 -> (1, 8000)[FLOAT]], [1070 -> (1)[INT32]], TRT - VERBOSE Original shape: (1, 8000), unsqueezing to: (1, 1, 8000) TRT - VERBOSE Registering layer: Unsqueeze_915 for ONNX node: Unsqueeze_915 TRT - VERBOSE Registering tensor: 1071 for ONNX tensor: 1071 TRT - VERBOSE Unsqueeze_915 [Unsqueeze] outputs: [1071 -> (1, 1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_917 [Unsqueeze] TRT - VERBOSE Searching for input: 1059 TRT - VERBOSE Searching for input: 1072 TRT - VERBOSE Unsqueeze_917 [Unsqueeze] inputs: [1059 -> (8000)[FLOAT]], [1072 -> (1)[INT32]], TRT - VERBOSE Original shape: (8000,), unsqueezing to: (1, 8000) TRT - VERBOSE Registering layer: Unsqueeze_917 for ONNX node: Unsqueeze_917 TRT - VERBOSE Registering tensor: 1073 for ONNX tensor: 1073 TRT - VERBOSE Unsqueeze_917 [Unsqueeze] outputs: [1073 -> (1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Unsqueeze_919 [Unsqueeze] TRT - VERBOSE Searching for input: 1073 TRT - VERBOSE Searching for input: 1074 TRT - VERBOSE Unsqueeze_919 [Unsqueeze] inputs: [1073 -> (1, 8000)[FLOAT]], [1074 -> (1)[INT32]], TRT - VERBOSE Original shape: (1, 8000), unsqueezing to: (1, 1, 8000) TRT - VERBOSE Registering layer: Unsqueeze_919 for ONNX node: Unsqueeze_919 TRT - VERBOSE Registering tensor: 1075 for ONNX tensor: 1075 TRT - VERBOSE Unsqueeze_919 [Unsqueeze] outputs: [1075 -> (1, 1, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Shape_920 [Shape] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Shape_920 [Shape] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_920 for ONNX node: Shape_920 TRT - VERBOSE Registering tensor: 1076 for ONNX tensor: 1076 TRT - VERBOSE Shape_920 [Shape] outputs: [1076 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_922 [Gather] TRT - VERBOSE Searching for input: 1076 TRT - VERBOSE Searching for input: 1077 TRT - VERBOSE Gather_922 [Gather] inputs: [1076 -> (4)[INT32]], [1077 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1077 for ONNX node: 1077 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_922 for ONNX node: Gather_922 TRT - VERBOSE Registering tensor: 1078 for ONNX tensor: 1078 TRT - VERBOSE Gather_922 [Gather] outputs: [1078 -> (1)[INT32]], TRT - VERBOSE Parsing node: Gather_926 [Gather] TRT - VERBOSE Searching for input: 1076 TRT - VERBOSE Searching for input: 1081 TRT - VERBOSE Gather_926 [Gather] inputs: [1076 -> (4)[INT32]], [1081 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1081 for ONNX node: 1081 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_926 for ONNX node: Gather_926 TRT - VERBOSE Registering tensor: 1082 for ONNX tensor: 1082 TRT - VERBOSE Gather_926 [Gather] outputs: [1082 -> (1)[INT32]], TRT - VERBOSE Parsing node: Transpose_927 [Transpose] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Transpose_927 [Transpose] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_927 for ONNX node: Transpose_927 TRT - VERBOSE Registering tensor: 1083 for ONNX tensor: 1083 TRT - VERBOSE Transpose_927 [Transpose] outputs: [1083 -> (-1, -1, -1, 128)[FLOAT]], TRT - VERBOSE Parsing node: Flatten_928 [Flatten] TRT - VERBOSE Searching for input: 1083 TRT - VERBOSE Flatten_928 [Flatten] inputs: [1083 -> (-1, -1, -1, 128)[FLOAT]], TRT - VERBOSE Registering layer: Flatten_928 for ONNX node: Flatten_928 TRT - VERBOSE Registering tensor: 1084 for ONNX tensor: 1084 TRT - VERBOSE Flatten_928 [Flatten] outputs: [1084 -> (-1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_929 [Mul] TRT - VERBOSE Searching for input: 1019 TRT - VERBOSE Searching for input: 1082 TRT - VERBOSE Mul_929 [Mul] inputs: [1019 -> (8000)[INT32]], [1082 -> (1)[INT32]], TRT - VERBOSE Registering layer: Mul_929 for ONNX node: Mul_929 TRT - VERBOSE Registering tensor: 1085 for ONNX tensor: 1085 TRT - VERBOSE Mul_929 [Mul] outputs: [1085 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Add_930 [Add] TRT - VERBOSE Searching for input: 1035 TRT - VERBOSE Searching for input: 1085 TRT - VERBOSE Add_930 [Add] inputs: [1035 -> (8000)[INT32]], [1085 -> (8000)[INT32]], TRT - VERBOSE Registering layer: Add_930 for ONNX node: Add_930 TRT - VERBOSE Registering tensor: 1086 for ONNX tensor: 1086 TRT - VERBOSE Add_930 [Add] outputs: [1086 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Gather_931 [Gather] TRT - VERBOSE Searching for input: 1084 TRT - VERBOSE Searching for input: 1086 TRT - VERBOSE Gather_931 [Gather] inputs: [1084 -> (-1, -1)[FLOAT]], [1086 -> (8000)[INT32]], TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_931 for ONNX node: Gather_931 TRT - VERBOSE Registering tensor: 1087 for ONNX tensor: 1087 TRT - VERBOSE Gather_931 [Gather] outputs: [1087 -> (8000, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_932 [Shape] TRT - VERBOSE Searching for input: 1086 TRT - VERBOSE Shape_932 [Shape] inputs: [1086 -> (8000)[INT32]], TRT - VERBOSE Registering layer: Shape_932 for ONNX node: Shape_932 TRT - VERBOSE Registering tensor: 1088 for ONNX tensor: 1088 TRT - VERBOSE Shape_932 [Shape] outputs: [1088 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_934 [Concat] TRT - VERBOSE Searching for input: 1089 TRT - VERBOSE Searching for input: 1078 TRT - VERBOSE Searching for input: 1080 TRT - VERBOSE Concat_934 [Concat] inputs: [1089 -> (1)[INT32]], [1078 -> (1)[INT32]], [1080 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1089 for ONNX node: 1089 TRT - VERBOSE Registering layer: 1080 for ONNX node: 1080 TRT - VERBOSE Registering layer: Concat_934 for ONNX node: Concat_934 TRT - VERBOSE Registering tensor: 1090 for ONNX tensor: 1090 TRT - VERBOSE Concat_934 [Concat] outputs: [1090 -> (3)[INT32]], TRT - VERBOSE Parsing node: Reshape_935 [Reshape] TRT - VERBOSE Searching for input: 1087 TRT - VERBOSE Searching for input: 1090 TRT - VERBOSE Reshape_935 [Reshape] inputs: [1087 -> (8000, -1)[FLOAT]], [1090 -> (3)[INT32]], TRT - VERBOSE Registering layer: Reshape_935 for ONNX node: Reshape_935 TRT - VERBOSE Registering tensor: 1091 for ONNX tensor: 1091 TRT - VERBOSE Reshape_935 [Reshape] outputs: [1091 -> (-1, -1, 128)[FLOAT]], TRT - VERBOSE Parsing node: Transpose_936 [Transpose] TRT - VERBOSE Searching for input: 1091 TRT - VERBOSE Transpose_936 [Transpose] inputs: [1091 -> (-1, -1, 128)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_936 for ONNX node: Transpose_936 TRT - VERBOSE Registering tensor: 1092 for ONNX tensor: 1092 TRT - VERBOSE Transpose_936 [Transpose] outputs: [1092 -> (-1, 128, -1)[FLOAT]], TRT - VERBOSE Parsing node: Concat_937 [Concat] TRT - VERBOSE Searching for input: 1078 TRT - VERBOSE Searching for input: 1080 TRT - VERBOSE Searching for input: 1088 TRT - VERBOSE Concat_937 [Concat] inputs: [1078 -> (1)[INT32]], [1080 -> (1)[INT32]], [1088 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_937 for ONNX node: Concat_937 TRT - VERBOSE Registering tensor: 1093 for ONNX tensor: 1093 TRT - VERBOSE Concat_937 [Concat] outputs: [1093 -> (3)[INT32]], TRT - VERBOSE Parsing node: Reshape_938 [Reshape] TRT - VERBOSE Searching for input: 1092 TRT - VERBOSE Searching for input: 1093 TRT - VERBOSE Reshape_938 [Reshape] inputs: [1092 -> (-1, 128, -1)[FLOAT]], [1093 -> (3)[INT32]], TRT - VERBOSE Registering layer: Reshape_938 for ONNX node: Reshape_938 TRT - VERBOSE Registering tensor: 1094 for ONNX tensor: 1094 TRT - VERBOSE Reshape_938 [Reshape] outputs: [1094 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Mul_939 [Mul] TRT - VERBOSE Searching for input: 1063 TRT - VERBOSE Searching for input: 1094 TRT - VERBOSE Mul_939 [Mul] inputs: [1063 -> (1, 1, 8000)[FLOAT]], [1094 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Registering layer: Mul_939 for ONNX node: Mul_939 TRT - VERBOSE Registering tensor: 1095 for ONNX tensor: 1095 TRT - VERBOSE Mul_939 [Mul] outputs: [1095 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Shape_940 [Shape] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Shape_940 [Shape] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_940 for ONNX node: Shape_940 TRT - VERBOSE Registering tensor: 1096 for ONNX tensor: 1096 TRT - VERBOSE Shape_940 [Shape] outputs: [1096 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_942 [Gather] TRT - VERBOSE Searching for input: 1096 TRT - VERBOSE Searching for input: 1097 TRT - VERBOSE Gather_942 [Gather] inputs: [1096 -> (4)[INT32]], [1097 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1097 for ONNX node: 1097 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_942 for ONNX node: Gather_942 TRT - VERBOSE Registering tensor: 1098 for ONNX tensor: 1098 TRT - VERBOSE Gather_942 [Gather] outputs: [1098 -> (1)[INT32]], TRT - VERBOSE Parsing node: Gather_946 [Gather] TRT - VERBOSE Searching for input: 1096 TRT - VERBOSE Searching for input: 1101 TRT - VERBOSE Gather_946 [Gather] inputs: [1096 -> (4)[INT32]], [1101 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1101 for ONNX node: 1101 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_946 for ONNX node: Gather_946 TRT - VERBOSE Registering tensor: 1102 for ONNX tensor: 1102 TRT - VERBOSE Gather_946 [Gather] outputs: [1102 -> (1)[INT32]], TRT - VERBOSE Parsing node: Transpose_947 [Transpose] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Transpose_947 [Transpose] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_947 for ONNX node: Transpose_947 TRT - VERBOSE Registering tensor: 1103 for ONNX tensor: 1103 TRT - VERBOSE Transpose_947 [Transpose] outputs: [1103 -> (-1, -1, -1, 128)[FLOAT]], TRT - VERBOSE Parsing node: Flatten_948 [Flatten] TRT - VERBOSE Searching for input: 1103 TRT - VERBOSE Flatten_948 [Flatten] inputs: [1103 -> (-1, -1, -1, 128)[FLOAT]], TRT - VERBOSE Registering layer: Flatten_948 for ONNX node: Flatten_948 TRT - VERBOSE Registering tensor: 1104 for ONNX tensor: 1104 TRT - VERBOSE Flatten_948 [Flatten] outputs: [1104 -> (-1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_949 [Mul] TRT - VERBOSE Searching for input: 1019 TRT - VERBOSE Searching for input: 1102 TRT - VERBOSE Mul_949 [Mul] inputs: [1019 -> (8000)[INT32]], [1102 -> (1)[INT32]], TRT - VERBOSE Registering layer: Mul_949 for ONNX node: Mul_949 TRT - VERBOSE Registering tensor: 1105 for ONNX tensor: 1105 TRT - VERBOSE Mul_949 [Mul] outputs: [1105 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Add_950 [Add] TRT - VERBOSE Searching for input: 1043 TRT - VERBOSE Searching for input: 1105 TRT - VERBOSE Add_950 [Add] inputs: [1043 -> (8000)[INT32]], [1105 -> (8000)[INT32]], TRT - VERBOSE Registering layer: Add_950 for ONNX node: Add_950 TRT - VERBOSE Registering tensor: 1106 for ONNX tensor: 1106 TRT - VERBOSE Add_950 [Add] outputs: [1106 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Gather_951 [Gather] TRT - VERBOSE Searching for input: 1104 TRT - VERBOSE Searching for input: 1106 TRT - VERBOSE Gather_951 [Gather] inputs: [1104 -> (-1, -1)[FLOAT]], [1106 -> (8000)[INT32]], TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_951 for ONNX node: Gather_951 TRT - VERBOSE Registering tensor: 1107 for ONNX tensor: 1107 TRT - VERBOSE Gather_951 [Gather] outputs: [1107 -> (8000, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_952 [Shape] TRT - VERBOSE Searching for input: 1106 TRT - VERBOSE Shape_952 [Shape] inputs: [1106 -> (8000)[INT32]], TRT - VERBOSE Registering layer: Shape_952 for ONNX node: Shape_952 TRT - VERBOSE Registering tensor: 1108 for ONNX tensor: 1108 TRT - VERBOSE Shape_952 [Shape] outputs: [1108 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_954 [Concat] TRT - VERBOSE Searching for input: 1109 TRT - VERBOSE Searching for input: 1098 TRT - VERBOSE Searching for input: 1100 TRT - VERBOSE Concat_954 [Concat] inputs: [1109 -> (1)[INT32]], [1098 -> (1)[INT32]], [1100 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1109 for ONNX node: 1109 TRT - VERBOSE Registering layer: 1100 for ONNX node: 1100 TRT - VERBOSE Registering layer: Concat_954 for ONNX node: Concat_954 TRT - VERBOSE Registering tensor: 1110 for ONNX tensor: 1110 TRT - VERBOSE Concat_954 [Concat] outputs: [1110 -> (3)[INT32]], TRT - VERBOSE Parsing node: Reshape_955 [Reshape] TRT - VERBOSE Searching for input: 1107 TRT - VERBOSE Searching for input: 1110 TRT - VERBOSE Reshape_955 [Reshape] inputs: [1107 -> (8000, -1)[FLOAT]], [1110 -> (3)[INT32]], TRT - VERBOSE Registering layer: Reshape_955 for ONNX node: Reshape_955 TRT - VERBOSE Registering tensor: 1111 for ONNX tensor: 1111 TRT - VERBOSE Reshape_955 [Reshape] outputs: [1111 -> (-1, -1, 128)[FLOAT]], TRT - VERBOSE Parsing node: Transpose_956 [Transpose] TRT - VERBOSE Searching for input: 1111 TRT - VERBOSE Transpose_956 [Transpose] inputs: [1111 -> (-1, -1, 128)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_956 for ONNX node: Transpose_956 TRT - VERBOSE Registering tensor: 1112 for ONNX tensor: 1112 TRT - VERBOSE Transpose_956 [Transpose] outputs: [1112 -> (-1, 128, -1)[FLOAT]], TRT - VERBOSE Parsing node: Concat_957 [Concat] TRT - VERBOSE Searching for input: 1098 TRT - VERBOSE Searching for input: 1100 TRT - VERBOSE Searching for input: 1108 TRT - VERBOSE Concat_957 [Concat] inputs: [1098 -> (1)[INT32]], [1100 -> (1)[INT32]], [1108 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_957 for ONNX node: Concat_957 TRT - VERBOSE Registering tensor: 1113 for ONNX tensor: 1113 TRT - VERBOSE Concat_957 [Concat] outputs: [1113 -> (3)[INT32]], TRT - VERBOSE Parsing node: Reshape_958 [Reshape] TRT - VERBOSE Searching for input: 1112 TRT - VERBOSE Searching for input: 1113 TRT - VERBOSE Reshape_958 [Reshape] inputs: [1112 -> (-1, 128, -1)[FLOAT]], [1113 -> (3)[INT32]], TRT - VERBOSE Registering layer: Reshape_958 for ONNX node: Reshape_958 TRT - VERBOSE Registering tensor: 1114 for ONNX tensor: 1114 TRT - VERBOSE Reshape_958 [Reshape] outputs: [1114 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Mul_959 [Mul] TRT - VERBOSE Searching for input: 1067 TRT - VERBOSE Searching for input: 1114 TRT - VERBOSE Mul_959 [Mul] inputs: [1067 -> (1, 1, 8000)[FLOAT]], [1114 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Registering layer: Mul_959 for ONNX node: Mul_959 TRT - VERBOSE Registering tensor: 1115 for ONNX tensor: 1115 TRT - VERBOSE Mul_959 [Mul] outputs: [1115 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Add_960 [Add] TRT - VERBOSE Searching for input: 1095 TRT - VERBOSE Searching for input: 1115 TRT - VERBOSE Add_960 [Add] inputs: [1095 -> (-1, 128, 8000)[FLOAT]], [1115 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Registering layer: Add_960 for ONNX node: Add_960 TRT - VERBOSE Registering tensor: 1116 for ONNX tensor: 1116 TRT - VERBOSE Add_960 [Add] outputs: [1116 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Shape_961 [Shape] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Shape_961 [Shape] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_961 for ONNX node: Shape_961 TRT - VERBOSE Registering tensor: 1117 for ONNX tensor: 1117 TRT - VERBOSE Shape_961 [Shape] outputs: [1117 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_963 [Gather] TRT - VERBOSE Searching for input: 1117 TRT - VERBOSE Searching for input: 1118 TRT - VERBOSE Gather_963 [Gather] inputs: [1117 -> (4)[INT32]], [1118 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1118 for ONNX node: 1118 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_963 for ONNX node: Gather_963 TRT - VERBOSE Registering tensor: 1119 for ONNX tensor: 1119 TRT - VERBOSE Gather_963 [Gather] outputs: [1119 -> (1)[INT32]], TRT - VERBOSE Parsing node: Gather_967 [Gather] TRT - VERBOSE Searching for input: 1117 TRT - VERBOSE Searching for input: 1122 TRT - VERBOSE Gather_967 [Gather] inputs: [1117 -> (4)[INT32]], [1122 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1122 for ONNX node: 1122 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_967 for ONNX node: Gather_967 TRT - VERBOSE Registering tensor: 1123 for ONNX tensor: 1123 TRT - VERBOSE Gather_967 [Gather] outputs: [1123 -> (1)[INT32]], TRT - VERBOSE Parsing node: Transpose_968 [Transpose] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Transpose_968 [Transpose] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_968 for ONNX node: Transpose_968 TRT - VERBOSE Registering tensor: 1124 for ONNX tensor: 1124 TRT - VERBOSE Transpose_968 [Transpose] outputs: [1124 -> (-1, -1, -1, 128)[FLOAT]], TRT - VERBOSE Parsing node: Flatten_969 [Flatten] TRT - VERBOSE Searching for input: 1124 TRT - VERBOSE Flatten_969 [Flatten] inputs: [1124 -> (-1, -1, -1, 128)[FLOAT]], TRT - VERBOSE Registering layer: Flatten_969 for ONNX node: Flatten_969 TRT - VERBOSE Registering tensor: 1125 for ONNX tensor: 1125 TRT - VERBOSE Flatten_969 [Flatten] outputs: [1125 -> (-1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_970 [Mul] TRT - VERBOSE Searching for input: 1027 TRT - VERBOSE Searching for input: 1123 TRT - VERBOSE Mul_970 [Mul] inputs: [1027 -> (8000)[INT32]], [1123 -> (1)[INT32]], TRT - VERBOSE Registering layer: Mul_970 for ONNX node: Mul_970 TRT - VERBOSE Registering tensor: 1126 for ONNX tensor: 1126 TRT - VERBOSE Mul_970 [Mul] outputs: [1126 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Add_971 [Add] TRT - VERBOSE Searching for input: 1035 TRT - VERBOSE Searching for input: 1126 TRT - VERBOSE Add_971 [Add] inputs: [1035 -> (8000)[INT32]], [1126 -> (8000)[INT32]], TRT - VERBOSE Registering layer: Add_971 for ONNX node: Add_971 TRT - VERBOSE Registering tensor: 1127 for ONNX tensor: 1127 TRT - VERBOSE Add_971 [Add] outputs: [1127 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Gather_972 [Gather] TRT - VERBOSE Searching for input: 1125 TRT - VERBOSE Searching for input: 1127 TRT - VERBOSE Gather_972 [Gather] inputs: [1125 -> (-1, -1)[FLOAT]], [1127 -> (8000)[INT32]], TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_972 for ONNX node: Gather_972 TRT - VERBOSE Registering tensor: 1128 for ONNX tensor: 1128 TRT - VERBOSE Gather_972 [Gather] outputs: [1128 -> (8000, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_973 [Shape] TRT - VERBOSE Searching for input: 1127 TRT - VERBOSE Shape_973 [Shape] inputs: [1127 -> (8000)[INT32]], TRT - VERBOSE Registering layer: Shape_973 for ONNX node: Shape_973 TRT - VERBOSE Registering tensor: 1129 for ONNX tensor: 1129 TRT - VERBOSE Shape_973 [Shape] outputs: [1129 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_975 [Concat] TRT - VERBOSE Searching for input: 1130 TRT - VERBOSE Searching for input: 1119 TRT - VERBOSE Searching for input: 1121 TRT - VERBOSE Concat_975 [Concat] inputs: [1130 -> (1)[INT32]], [1119 -> (1)[INT32]], [1121 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1130 for ONNX node: 1130 TRT - VERBOSE Registering layer: 1121 for ONNX node: 1121 TRT - VERBOSE Registering layer: Concat_975 for ONNX node: Concat_975 TRT - VERBOSE Registering tensor: 1131 for ONNX tensor: 1131 TRT - VERBOSE Concat_975 [Concat] outputs: [1131 -> (3)[INT32]], TRT - VERBOSE Parsing node: Reshape_976 [Reshape] TRT - VERBOSE Searching for input: 1128 TRT - VERBOSE Searching for input: 1131 TRT - VERBOSE Reshape_976 [Reshape] inputs: [1128 -> (8000, -1)[FLOAT]], [1131 -> (3)[INT32]], TRT - VERBOSE Registering layer: Reshape_976 for ONNX node: Reshape_976 TRT - VERBOSE Registering tensor: 1132 for ONNX tensor: 1132 TRT - VERBOSE Reshape_976 [Reshape] outputs: [1132 -> (-1, -1, 128)[FLOAT]], TRT - VERBOSE Parsing node: Transpose_977 [Transpose] TRT - VERBOSE Searching for input: 1132 TRT - VERBOSE Transpose_977 [Transpose] inputs: [1132 -> (-1, -1, 128)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_977 for ONNX node: Transpose_977 TRT - VERBOSE Registering tensor: 1133 for ONNX tensor: 1133 TRT - VERBOSE Transpose_977 [Transpose] outputs: [1133 -> (-1, 128, -1)[FLOAT]], TRT - VERBOSE Parsing node: Concat_978 [Concat] TRT - VERBOSE Searching for input: 1119 TRT - VERBOSE Searching for input: 1121 TRT - VERBOSE Searching for input: 1129 TRT - VERBOSE Concat_978 [Concat] inputs: [1119 -> (1)[INT32]], [1121 -> (1)[INT32]], [1129 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_978 for ONNX node: Concat_978 TRT - VERBOSE Registering tensor: 1134 for ONNX tensor: 1134 TRT - VERBOSE Concat_978 [Concat] outputs: [1134 -> (3)[INT32]], TRT - VERBOSE Parsing node: Reshape_979 [Reshape] TRT - VERBOSE Searching for input: 1133 TRT - VERBOSE Searching for input: 1134 TRT - VERBOSE Reshape_979 [Reshape] inputs: [1133 -> (-1, 128, -1)[FLOAT]], [1134 -> (3)[INT32]], TRT - VERBOSE Registering layer: Reshape_979 for ONNX node: Reshape_979 TRT - VERBOSE Registering tensor: 1135 for ONNX tensor: 1135 TRT - VERBOSE Reshape_979 [Reshape] outputs: [1135 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Mul_980 [Mul] TRT - VERBOSE Searching for input: 1071 TRT - VERBOSE Searching for input: 1135 TRT - VERBOSE Mul_980 [Mul] inputs: [1071 -> (1, 1, 8000)[FLOAT]], [1135 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Registering layer: Mul_980 for ONNX node: Mul_980 TRT - VERBOSE Registering tensor: 1136 for ONNX tensor: 1136 TRT - VERBOSE Mul_980 [Mul] outputs: [1136 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Add_981 [Add] TRT - VERBOSE Searching for input: 1116 TRT - VERBOSE Searching for input: 1136 TRT - VERBOSE Add_981 [Add] inputs: [1116 -> (-1, 128, 8000)[FLOAT]], [1136 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Registering layer: Add_981 for ONNX node: Add_981 TRT - VERBOSE Registering tensor: 1137 for ONNX tensor: 1137 TRT - VERBOSE Add_981 [Add] outputs: [1137 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Shape_982 [Shape] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Shape_982 [Shape] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Shape_982 for ONNX node: Shape_982 TRT - VERBOSE Registering tensor: 1138 for ONNX tensor: 1138 TRT - VERBOSE Shape_982 [Shape] outputs: [1138 -> (4)[INT32]], TRT - VERBOSE Parsing node: Gather_984 [Gather] TRT - VERBOSE Searching for input: 1138 TRT - VERBOSE Searching for input: 1139 TRT - VERBOSE Gather_984 [Gather] inputs: [1138 -> (4)[INT32]], [1139 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1139 for ONNX node: 1139 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_984 for ONNX node: Gather_984 TRT - VERBOSE Registering tensor: 1140 for ONNX tensor: 1140 TRT - VERBOSE Gather_984 [Gather] outputs: [1140 -> (1)[INT32]], TRT - VERBOSE Parsing node: Gather_988 [Gather] TRT - VERBOSE Searching for input: 1138 TRT - VERBOSE Searching for input: 1143 TRT - VERBOSE Gather_988 [Gather] inputs: [1138 -> (4)[INT32]], [1143 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1143 for ONNX node: 1143 TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_988 for ONNX node: Gather_988 TRT - VERBOSE Registering tensor: 1144 for ONNX tensor: 1144 TRT - VERBOSE Gather_988 [Gather] outputs: [1144 -> (1)[INT32]], TRT - VERBOSE Parsing node: Transpose_989 [Transpose] TRT - VERBOSE Searching for input: 80 TRT - VERBOSE Transpose_989 [Transpose] inputs: [80 -> (-1, 128, -1, -1)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_989 for ONNX node: Transpose_989 TRT - VERBOSE Registering tensor: 1145 for ONNX tensor: 1145 TRT - VERBOSE Transpose_989 [Transpose] outputs: [1145 -> (-1, -1, -1, 128)[FLOAT]], TRT - VERBOSE Parsing node: Flatten_990 [Flatten] TRT - VERBOSE Searching for input: 1145 TRT - VERBOSE Flatten_990 [Flatten] inputs: [1145 -> (-1, -1, -1, 128)[FLOAT]], TRT - VERBOSE Registering layer: Flatten_990 for ONNX node: Flatten_990 TRT - VERBOSE Registering tensor: 1146 for ONNX tensor: 1146 TRT - VERBOSE Flatten_990 [Flatten] outputs: [1146 -> (-1, -1)[FLOAT]], TRT - VERBOSE Parsing node: Mul_991 [Mul] TRT - VERBOSE Searching for input: 1027 TRT - VERBOSE Searching for input: 1144 TRT - VERBOSE Mul_991 [Mul] inputs: [1027 -> (8000)[INT32]], [1144 -> (1)[INT32]], TRT - VERBOSE Registering layer: Mul_991 for ONNX node: Mul_991 TRT - VERBOSE Registering tensor: 1147 for ONNX tensor: 1147 TRT - VERBOSE Mul_991 [Mul] outputs: [1147 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Add_992 [Add] TRT - VERBOSE Searching for input: 1043 TRT - VERBOSE Searching for input: 1147 TRT - VERBOSE Add_992 [Add] inputs: [1043 -> (8000)[INT32]], [1147 -> (8000)[INT32]], TRT - VERBOSE Registering layer: Add_992 for ONNX node: Add_992 TRT - VERBOSE Registering tensor: 1148 for ONNX tensor: 1148 TRT - VERBOSE Add_992 [Add] outputs: [1148 -> (8000)[INT32]], TRT - VERBOSE Parsing node: Gather_993 [Gather] TRT - VERBOSE Searching for input: 1146 TRT - VERBOSE Searching for input: 1148 TRT - VERBOSE Gather_993 [Gather] inputs: [1146 -> (-1, -1)[FLOAT]], [1148 -> (8000)[INT32]], TRT - VERBOSE Using Gather axis: 0 TRT - VERBOSE Registering layer: Gather_993 for ONNX node: Gather_993 TRT - VERBOSE Registering tensor: 1149 for ONNX tensor: 1149 TRT - VERBOSE Gather_993 [Gather] outputs: [1149 -> (8000, -1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_994 [Shape] TRT - VERBOSE Searching for input: 1148 TRT - VERBOSE Shape_994 [Shape] inputs: [1148 -> (8000)[INT32]], TRT - VERBOSE Registering layer: Shape_994 for ONNX node: Shape_994 TRT - VERBOSE Registering tensor: 1150 for ONNX tensor: 1150 TRT - VERBOSE Shape_994 [Shape] outputs: [1150 -> (1)[INT32]], TRT - VERBOSE Parsing node: Concat_996 [Concat] TRT - VERBOSE Searching for input: 1151 TRT - VERBOSE Searching for input: 1140 TRT - VERBOSE Searching for input: 1142 TRT - VERBOSE Concat_996 [Concat] inputs: [1151 -> (1)[INT32]], [1140 -> (1)[INT32]], [1142 -> (1)[INT32]], TRT - VERBOSE Registering layer: 1151 for ONNX node: 1151 TRT - VERBOSE Registering layer: 1142 for ONNX node: 1142 TRT - VERBOSE Registering layer: Concat_996 for ONNX node: Concat_996 TRT - VERBOSE Registering tensor: 1152 for ONNX tensor: 1152 TRT - VERBOSE Concat_996 [Concat] outputs: [1152 -> (3)[INT32]], TRT - VERBOSE Parsing node: Reshape_997 [Reshape] TRT - VERBOSE Searching for input: 1149 TRT - VERBOSE Searching for input: 1152 TRT - VERBOSE Reshape_997 [Reshape] inputs: [1149 -> (8000, -1)[FLOAT]], [1152 -> (3)[INT32]], TRT - VERBOSE Registering layer: Reshape_997 for ONNX node: Reshape_997 TRT - VERBOSE Registering tensor: 1153 for ONNX tensor: 1153 TRT - VERBOSE Reshape_997 [Reshape] outputs: [1153 -> (-1, -1, 128)[FLOAT]], TRT - VERBOSE Parsing node: Transpose_998 [Transpose] TRT - VERBOSE Searching for input: 1153 TRT - VERBOSE Transpose_998 [Transpose] inputs: [1153 -> (-1, -1, 128)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_998 for ONNX node: Transpose_998 TRT - VERBOSE Registering tensor: 1154 for ONNX tensor: 1154 TRT - VERBOSE Transpose_998 [Transpose] outputs: [1154 -> (-1, 128, -1)[FLOAT]], TRT - VERBOSE Parsing node: Concat_999 [Concat] TRT - VERBOSE Searching for input: 1140 TRT - VERBOSE Searching for input: 1142 TRT - VERBOSE Searching for input: 1150 TRT - VERBOSE Concat_999 [Concat] inputs: [1140 -> (1)[INT32]], [1142 -> (1)[INT32]], [1150 -> (1)[INT32]], TRT - VERBOSE Registering layer: Concat_999 for ONNX node: Concat_999 TRT - VERBOSE Registering tensor: 1155 for ONNX tensor: 1155 TRT - VERBOSE Concat_999 [Concat] outputs: [1155 -> (3)[INT32]], TRT - VERBOSE Parsing node: Reshape_1000 [Reshape] TRT - VERBOSE Searching for input: 1154 TRT - VERBOSE Searching for input: 1155 TRT - VERBOSE Reshape_1000 [Reshape] inputs: [1154 -> (-1, 128, -1)[FLOAT]], [1155 -> (3)[INT32]], TRT - VERBOSE Registering layer: Reshape_1000 for ONNX node: Reshape_1000 TRT - VERBOSE Registering tensor: 1156 for ONNX tensor: 1156 TRT - VERBOSE Reshape_1000 [Reshape] outputs: [1156 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Mul_1001 [Mul] TRT - VERBOSE Searching for input: 1075 TRT - VERBOSE Searching for input: 1156 TRT - VERBOSE Mul_1001 [Mul] inputs: [1075 -> (1, 1, 8000)[FLOAT]], [1156 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Registering layer: Mul_1001 for ONNX node: Mul_1001 TRT - VERBOSE Registering tensor: 1157 for ONNX tensor: 1157 TRT - VERBOSE Mul_1001 [Mul] outputs: [1157 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Add_1002 [Add] TRT - VERBOSE Searching for input: 1137 TRT - VERBOSE Searching for input: 1157 TRT - VERBOSE Add_1002 [Add] inputs: [1137 -> (-1, 128, 8000)[FLOAT]], [1157 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Registering layer: Add_1002 for ONNX node: Add_1002 TRT - VERBOSE Registering tensor: 1158 for ONNX tensor: 1158 TRT - VERBOSE Add_1002 [Add] outputs: [1158 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Parsing node: Transpose_1003 [Transpose] TRT - VERBOSE Searching for input: 1158 TRT - VERBOSE Transpose_1003 [Transpose] inputs: [1158 -> (-1, 128, 8000)[FLOAT]], TRT - VERBOSE Registering layer: Transpose_1003 for ONNX node: Transpose_1003 TRT - VERBOSE Registering tensor: 1159 for ONNX tensor: 1159 TRT - VERBOSE Transpose_1003 [Transpose] outputs: [1159 -> (-1, 8000, 128)[FLOAT]], TRT - VERBOSE Parsing node: ReduceL2_1004 [ReduceL2] TRT - VERBOSE Searching for input: 1159 TRT - VERBOSE ReduceL2_1004 [ReduceL2] inputs: [1159 -> (-1, 8000, 128)[FLOAT]], TRT - VERBOSE Registering layer: ReduceL2_1004 for ONNX node: ReduceL2_1004 TRT - VERBOSE Registering layer: ReduceL2_1004_361 for ONNX node: ReduceL2_1004 TRT - VERBOSE Registering tensor: 1160 for ONNX tensor: 1160 TRT - VERBOSE ReduceL2_1004 [ReduceL2] outputs: [1160 -> (-1, 8000, 1)[FLOAT]], TRT - VERBOSE Parsing node: Clip_1005 [Clip] TRT - VERBOSE Searching for input: 1160 TRT - VERBOSE Searching for input: 1232 TRT - VERBOSE Clip_1005 [Clip] inputs: [1160 -> (-1, 8000, 1)[FLOAT]], [1232 -> ()[FLOAT]], [optional input, not set], TRT - VERBOSE Registering layer: 1232 for ONNX node: 1232 TRT - VERBOSE Registering tensor: 1164 for ONNX tensor: 1164 TRT - VERBOSE Clip_1005 [Clip] outputs: [1164 -> (-1, 8000, 1)[FLOAT]], TRT - VERBOSE Parsing node: Shape_1006 [Shape] TRT - VERBOSE Searching for input: 1159 TRT - VERBOSE Shape_1006 [Shape] inputs: [1159 -> (-1, 8000, 128)[FLOAT]], TRT - VERBOSE Registering layer: Shape_1006 for ONNX node: Shape_1006 TRT - VERBOSE Registering tensor: 1165 for ONNX tensor: 1165 TRT - VERBOSE Shape_1006 [Shape] outputs: [1165 -> (3)[INT32]], TRT - VERBOSE Parsing node: Expand_1007 [Expand] TRT - VERBOSE Searching for input: 1164 TRT - VERBOSE Searching for input: 1165 TRT - VERBOSE Expand_1007 [Expand] inputs: [1164 -> (-1, 8000, 1)[FLOAT]], [1165 -> (3)[INT32]], TRT - VERBOSE Registering layer: Expand_1007 for ONNX node: Expand_1007 TRT - VERBOSE Registering tensor: 1166 for ONNX tensor: 1166 TRT - VERBOSE Expand_1007 [Expand] outputs: [1166 -> (-1, 8000, 128)[FLOAT]], TRT - VERBOSE Parsing node: Div_1008 [Div] TRT - VERBOSE Searching for input: 1159 TRT - VERBOSE Searching for input: 1166 TRT - VERBOSE Div_1008 [Div] inputs: [1159 -> (-1, 8000, 128)[FLOAT]], [1166 -> (-1, 8000, 128)[FLOAT]], TRT - VERBOSE Registering layer: Div_1008 for ONNX node: Div_1008 TRT - VERBOSE Registering tensor: descs_365 for ONNX tensor: descs TRT - VERBOSE Div_1008 [Div] outputs: [descs -> (-1, 8000, 128)[FLOAT]], TRT - VERBOSE Parsing node: Gather_1010 [Gather] TRT - VERBOSE Searching for input: 983 TRT - VERBOSE Searching for input: 1168 TRT - VERBOSE Gather_1010 [Gather] inputs: [983 -> (-1, 8000, 2)[FLOAT]], [1168 -> (2)[INT32]], TRT - VERBOSE Registering layer: 1168 for ONNX node: 1168 TRT - VERBOSE Using Gather axis: 2 TRT - VERBOSE Registering layer: Gather_1010 for ONNX node: Gather_1010 TRT - VERBOSE Registering tensor: kpts_366 for ONNX tensor: kpts TRT - VERBOSE Gather_1010 [Gather] outputs: [kpts -> (-1, 8000, 2)[FLOAT]], TRT - VERBOSE Marking descs_365 as output: descs TRT - VERBOSE Marking kpts_366 as output: kpts TRT - VERBOSE Marking scores_344 as output: scores Completed Onnx file parsing TensorRT model parse report: Model parsing OK! Network Description Input 'input' with shape (-1, -1, -1, -1) and dtype DataType.FLOAT Output 'descs' with shape (-1, 8000, 128) and dtype DataType.FLOAT Output 'kpts' with shape (-1, 8000, 2) and dtype DataType.FLOAT Output 'scores' with shape (8000, 1) and dtype DataType.FLOAT =============================================================== Beginning Trt engine building Start model optimization... TRT - VERBOSE Applying generic optimizations to the graph for inference. TRT - VERBOSE Original: 446 layers TRT - VERBOSE After dead-layer removal: 446 layers TRT - VERBOSE Running: ConstShuffleFusion on (Unnamed Layer* 33) [Constant] TRT - VERBOSE ConstShuffleFusion: Fusing (Unnamed Layer* 33) [Constant] with (Unnamed Layer* 34) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 95 TRT - VERBOSE ConstShuffleFusion: Fusing 95 with (Unnamed Layer* 38) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 178 TRT - VERBOSE ConstShuffleFusion: Fusing 178 with (Unnamed Layer* 85) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 181 TRT - VERBOSE ConstShuffleFusion: Fusing 181 with (Unnamed Layer* 89) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 263 TRT - VERBOSE ConstShuffleFusion: Fusing 263 with (Unnamed Layer* 136) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 266 TRT - VERBOSE ConstShuffleFusion: Fusing 266 with (Unnamed Layer* 140) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 348 TRT - VERBOSE ConstShuffleFusion: Fusing 348 with (Unnamed Layer* 187) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 357 TRT - VERBOSE ConstShuffleFusion: Fusing 357 with (Unnamed Layer* 197) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on (Unnamed Layer* 214) [Constant] TRT - VERBOSE ConstShuffleFusion: Fusing (Unnamed Layer* 214) [Constant] with (Unnamed Layer* 215) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 445 TRT - VERBOSE ConstShuffleFusion: Fusing 445 with (Unnamed Layer* 242) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 450 TRT - VERBOSE ConstShuffleFusion: Fusing 450 with (Unnamed Layer* 252) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 461 TRT - VERBOSE ConstShuffleFusion: Fusing 461 with (Unnamed Layer* 264) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 464 TRT - VERBOSE ConstShuffleFusion: Fusing 464 with (Unnamed Layer* 268) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 511 TRT - VERBOSE ConstShuffleFusion: Fusing 511 with (Unnamed Layer* 351) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 562 TRT - VERBOSE ConstShuffleFusion: Fusing 562 with (Unnamed Layer* 417) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 596 TRT - VERBOSE ConstShuffleFusion: Fusing 596 with (Unnamed Layer* 448) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 649 TRT - VERBOSE ConstShuffleFusion: Fusing 649 with (Unnamed Layer* 529) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 700 TRT - VERBOSE ConstShuffleFusion: Fusing 700 with (Unnamed Layer* 595) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 734 TRT - VERBOSE ConstShuffleFusion: Fusing 734 with (Unnamed Layer* 626) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 789 TRT - VERBOSE ConstShuffleFusion: Fusing 789 with (Unnamed Layer* 709) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 840 TRT - VERBOSE ConstShuffleFusion: Fusing 840 with (Unnamed Layer* 775) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 904 TRT - VERBOSE ConstShuffleFusion: Fusing 904 with (Unnamed Layer* 809) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 907 TRT - VERBOSE ConstShuffleFusion: Fusing 907 with (Unnamed Layer* 813) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 911 TRT - VERBOSE ConstShuffleFusion: Fusing 911 with (Unnamed Layer* 818) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 914 TRT - VERBOSE ConstShuffleFusion: Fusing 914 with (Unnamed Layer* 822) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 917 TRT - VERBOSE ConstShuffleFusion: Fusing 917 with (Unnamed Layer* 826) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 920 TRT - VERBOSE ConstShuffleFusion: Fusing 920 with (Unnamed Layer* 830) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 1227 TRT - VERBOSE ConstShuffleFusion: Fusing 1227 with (Unnamed Layer* 909) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 1048 TRT - VERBOSE ConstShuffleFusion: Fusing 1048 with (Unnamed Layer* 978) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 1050 TRT - VERBOSE ConstShuffleFusion: Fusing 1050 with (Unnamed Layer* 981) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 1053 TRT - VERBOSE ConstShuffleFusion: Fusing 1053 with (Unnamed Layer* 985) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 1056 TRT - VERBOSE ConstShuffleFusion: Fusing 1056 with (Unnamed Layer* 989) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on 1232 TRT - VERBOSE ConstShuffleFusion: Fusing 1232 with (Unnamed Layer* 1130) [Shuffle] TRT - VERBOSE Running: ConstShuffleFusion on (Unnamed Layer* 1129) [Constant] TRT - VERBOSE ConstShuffleFusion: Fusing (Unnamed Layer* 1129) [Constant] with (Unnamed Layer* 1131) [Shuffle] TRT - VERBOSE Running: ShuffleShuffleFusion on Transpose_927 TRT - VERBOSE ShuffleShuffleFusion: Fusing Transpose_927 with Flatten_928 TRT - VERBOSE Running: ShuffleShuffleFusion on Transpose_947 TRT - VERBOSE ShuffleShuffleFusion: Fusing Transpose_947 with Flatten_948 TRT - VERBOSE Running: ShuffleShuffleFusion on Transpose_968 TRT - VERBOSE ShuffleShuffleFusion: Fusing Transpose_968 with Flatten_969 TRT - VERBOSE Running: ShuffleShuffleFusion on Transpose_989 TRT - VERBOSE ShuffleShuffleFusion: Fusing Transpose_989 with Flatten_990 TRT - VERBOSE Running: ShuffleShuffleFusion on Transpose_807 TRT - VERBOSE ShuffleShuffleFusion: Fusing Transpose_807 with Flatten_808 TRT - VERBOSE Running: ShuffleErasure on Reshape_485 TRT - VERBOSE Removing Reshape_485 TRT - VERBOSE Running: ShuffleErasure on Reshape_616 TRT - VERBOSE Removing Reshape_616 TRT - VERBOSE Running: ShuffleShuffleFusion on Reshape_815 TRT - VERBOSE ShuffleShuffleFusion: Fusing Reshape_815 with Transpose_816 TRT - VERBOSE Running: ShuffleShuffleFusion on Reshape_818 TRT - VERBOSE ShuffleShuffleFusion: Fusing Reshape_818 with Reshape_835 TRT - VERBOSE Running: ShuffleShuffleFusion on Reshape_935 TRT - VERBOSE ShuffleShuffleFusion: Fusing Reshape_935 with Transpose_936 TRT - VERBOSE Running: ShuffleShuffleFusion on Reshape_935 + Transpose_936 TRT - VERBOSE ShuffleShuffleFusion: Fusing Reshape_935 + Transpose_936 with Reshape_938 TRT - VERBOSE Running: ShuffleShuffleFusion on Reshape_955 TRT - VERBOSE ShuffleShuffleFusion: Fusing Reshape_955 with Transpose_956 TRT - VERBOSE Running: ShuffleShuffleFusion on Reshape_955 + Transpose_956 TRT - VERBOSE ShuffleShuffleFusion: Fusing Reshape_955 + Transpose_956 with Reshape_958 TRT - VERBOSE Running: ShuffleShuffleFusion on Reshape_976 TRT - VERBOSE ShuffleShuffleFusion: Fusing Reshape_976 with Transpose_977 TRT - VERBOSE Running: ShuffleShuffleFusion on Reshape_976 + Transpose_977 TRT - VERBOSE ShuffleShuffleFusion: Fusing Reshape_976 + Transpose_977 with Reshape_979 TRT - VERBOSE Running: ShuffleShuffleFusion on Reshape_997 TRT - VERBOSE ShuffleShuffleFusion: Fusing Reshape_997 with Transpose_998 TRT - VERBOSE Running: ShuffleShuffleFusion on Reshape_997 + Transpose_998 TRT - VERBOSE ShuffleShuffleFusion: Fusing Reshape_997 + Transpose_998 with Reshape_1000 TRT - VERBOSE Running: ShuffleShuffleFusion on Unsqueeze_917 TRT - VERBOSE ShuffleShuffleFusion: Fusing Unsqueeze_917 with Unsqueeze_919 TRT - VERBOSE Running: ShuffleShuffleFusion on Unsqueeze_909 TRT - VERBOSE ShuffleShuffleFusion: Fusing Unsqueeze_909 with Unsqueeze_911 TRT - VERBOSE Running: ShuffleShuffleFusion on Unsqueeze_905 TRT - VERBOSE ShuffleShuffleFusion: Fusing Unsqueeze_905 with Unsqueeze_907 TRT - VERBOSE Running: ShuffleShuffleFusion on Unsqueeze_913 TRT - VERBOSE ShuffleShuffleFusion: Fusing Unsqueeze_913 with Unsqueeze_915 TRT - VERBOSE After Myelin optimization: 97 layers TRT - VERBOSE Applying ScaleNodes fusions. TRT - VERBOSE Running: ConstEltFusion on 348 + (Unnamed Layer* 187) [Shuffle] TRT - VERBOSE ConstEltFusion: Fusing 348 + (Unnamed Layer* 187) [Shuffle] with Mul_252 TRT - VERBOSE Running: ConstEltFusion on 263 + (Unnamed Layer* 136) [Shuffle] TRT - VERBOSE ConstEltFusion: Fusing 263 + (Unnamed Layer* 136) [Shuffle] with Mul_181 TRT - VERBOSE Running: ConstEltFusion on 178 + (Unnamed Layer* 85) [Shuffle] TRT - VERBOSE ConstEltFusion: Fusing 178 + (Unnamed Layer* 85) [Shuffle] with Mul_110 TRT - VERBOSE After scale fusion: 94 layers TRT - VERBOSE Running: ConvReluFusion on Conv_6 TRT - VERBOSE ConvReluFusion: Fusing Conv_6 with Relu_7 TRT - VERBOSE Running: ScaleActivationFusion on BatchNormalization_11 TRT - VERBOSE ScaleActivationFusion: Fusing BatchNormalization_11 with Relu_12 TRT - VERBOSE Running: ConvReluFusion on Conv_13 TRT - VERBOSE ConvReluFusion: Fusing Conv_13 with Relu_14 TRT - VERBOSE Running: ScaleActivationFusion on BatchNormalization_18 TRT - VERBOSE ScaleActivationFusion: Fusing BatchNormalization_18 with Relu_19 TRT - VERBOSE Running: ConvReluFusion on Conv_20 TRT - VERBOSE ConvReluFusion: Fusing Conv_20 with Relu_21 TRT - VERBOSE Running: ConvReluFusion on Conv_22 TRT - VERBOSE ConvReluFusion: Fusing Conv_22 with Relu_23 TRT - VERBOSE Running: ConvReluFusion on Conv_24 TRT - VERBOSE ConvReluFusion: Fusing Conv_24 with Relu_25 TRT - VERBOSE Running: ConvReluFusion on Conv_26 TRT - VERBOSE ConvReluFusion: Fusing Conv_26 with Relu_27 TRT - VERBOSE Running: ActivationToPointwiseConversion on Softplus_235 TRT - VERBOSE Swap the layer type of Softplus_235 from ACTIVATION to POINTWISE TRT - VERBOSE Running: ActivationToPointwiseConversion on Softplus_233 TRT - VERBOSE Swap the layer type of Softplus_233 from ACTIVATION to POINTWISE TRT - VERBOSE Running: ActivationToPointwiseConversion on Softplus_164 TRT - VERBOSE Swap the layer type of Softplus_164 from ACTIVATION to POINTWISE TRT - VERBOSE Running: ActivationToPointwiseConversion on Softplus_162 TRT - VERBOSE Swap the layer type of Softplus_162 from ACTIVATION to POINTWISE TRT - VERBOSE Running: ActivationToPointwiseConversion on Softplus_93 TRT - VERBOSE Swap the layer type of Softplus_93 from ACTIVATION to POINTWISE TRT - VERBOSE Running: ActivationToPointwiseConversion on Softplus_91 TRT - VERBOSE Swap the layer type of Softplus_91 from ACTIVATION to POINTWISE TRT - VERBOSE Running: ActivationToPointwiseConversion on Clip_793 TRT - VERBOSE Swap the layer type of Clip_793 from ACTIVATION to POINTWISE TRT - VERBOSE After dupe layer removal: 86 layers TRT - VERBOSE After final dead-layer removal: 86 layers TRT - VERBOSE After tensor merging: 86 layers TRT - VERBOSE Running: PointWiseFusion on 266 + (Unnamed Layer* 140) [Shuffle] TRT - VERBOSE PointWiseFusion: Fusing 266 + (Unnamed Layer* 140) [Shuffle] with Div_184 TRT - VERBOSE Running: PointWiseFusion on 181 + (Unnamed Layer* 89) [Shuffle] TRT - VERBOSE PointWiseFusion: Fusing 181 + (Unnamed Layer* 89) [Shuffle] with Div_113 TRT - VERBOSE Running: PointWiseFusion on 95 + (Unnamed Layer* 38) [Shuffle] TRT - VERBOSE PointWiseFusion: Fusing 95 + (Unnamed Layer* 38) [Shuffle] with Div_41 TRT - VERBOSE Running: PointWiseFusion on Sub_234 TRT - VERBOSE PointWiseFusion: Fusing Sub_234 with PWN(Softplus_235) TRT - VERBOSE Running: PointWiseFusion on PWN(Sub_234, PWN(Softplus_235)) TRT - VERBOSE PointWiseFusion: Fusing PWN(Sub_234, PWN(Softplus_235)) with Mul_236 TRT - VERBOSE Running: PointWiseFusion on Sub_232 TRT - VERBOSE PointWiseFusion: Fusing Sub_232 with PWN(Softplus_233) TRT - VERBOSE Running: PointWiseFusion on PWN(Sub_232, PWN(Softplus_233)) TRT - VERBOSE PointWiseFusion: Fusing PWN(Sub_232, PWN(Softplus_233)) with PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236) TRT - VERBOSE Running: PointWiseFusion on 348 + (Unnamed Layer* 187) [Shuffle] + Mul_252 TRT - VERBOSE PointWiseFusion: Fusing 348 + (Unnamed Layer* 187) [Shuffle] + Mul_252 with Add_253 TRT - VERBOSE Running: PointWiseFusion on Sub_163 TRT - VERBOSE PointWiseFusion: Fusing Sub_163 with PWN(Softplus_164) TRT - VERBOSE Running: PointWiseFusion on PWN(Sub_163, PWN(Softplus_164)) TRT - VERBOSE PointWiseFusion: Fusing PWN(Sub_163, PWN(Softplus_164)) with Mul_165 TRT - VERBOSE Running: PointWiseFusion on Sub_161 TRT - VERBOSE PointWiseFusion: Fusing Sub_161 with PWN(Softplus_162) TRT - VERBOSE Running: PointWiseFusion on PWN(Sub_161, PWN(Softplus_162)) TRT - VERBOSE PointWiseFusion: Fusing PWN(Sub_161, PWN(Softplus_162)) with PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165) TRT - VERBOSE Running: PointWiseFusion on 263 + (Unnamed Layer* 136) [Shuffle] + Mul_181 TRT - VERBOSE PointWiseFusion: Fusing 263 + (Unnamed Layer* 136) [Shuffle] + Mul_181 with Add_182 TRT - VERBOSE Running: PointWiseFusion on Sub_92 TRT - VERBOSE PointWiseFusion: Fusing Sub_92 with PWN(Softplus_93) TRT - VERBOSE Running: PointWiseFusion on PWN(Sub_92, PWN(Softplus_93)) TRT - VERBOSE PointWiseFusion: Fusing PWN(Sub_92, PWN(Softplus_93)) with Mul_94 TRT - VERBOSE Running: PointWiseFusion on Sub_90 TRT - VERBOSE PointWiseFusion: Fusing Sub_90 with PWN(Softplus_91) TRT - VERBOSE Running: PointWiseFusion on PWN(Sub_90, PWN(Softplus_91)) TRT - VERBOSE PointWiseFusion: Fusing PWN(Sub_90, PWN(Softplus_91)) with PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94) TRT - VERBOSE Running: PointWiseFusion on 178 + (Unnamed Layer* 85) [Shuffle] + Mul_110 TRT - VERBOSE PointWiseFusion: Fusing 178 + (Unnamed Layer* 85) [Shuffle] + Mul_110 with Add_111 TRT - VERBOSE Running: PointWiseFusion on PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111) TRT - VERBOSE PointWiseFusion: Fusing PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111) with PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182) TRT - VERBOSE Running: PointWiseFusion on PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)) TRT - VERBOSE PointWiseFusion: Fusing PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)) with PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253) TRT - VERBOSE After vertical fusions: 66 layers TRT - VERBOSE After dupe layer removal: 66 layers TRT - VERBOSE After final dead-layer removal: 66 layers TRT - VERBOSE After tensor merging: 66 layers TRT - VERBOSE After slice removal: 66 layers TRT - VERBOSE After concat removal: 66 layers TRT - VERBOSE Trying to split Reshape and strided tensor TRT - VERBOSE Graph construction and optimization completed in 0.0777248 seconds. TRT - VERBOSE Using cublasLt as a tactic source TRT - INFO [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +1, GPU +8, now: CPU 8642, GPU 1403 (MiB) TRT - VERBOSE Using cuDNN as a tactic source TRT - INFO [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 8642, GPU 1411 (MiB) TRT - WARNING TensorRT was linked against cuDNN 8.4.1 but loaded cuDNN 8.0.4 TRT - INFO Local timing cache in use. Profiling results in this builder pass will not be stored. TRT - VERBOSE Constructing optimization profile number 0 [1/1]. TRT - VERBOSE Reserving memory for host IO tensors. Host: 0 bytes TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 94) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00966431 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.020064 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00812927 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00812927 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 94) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 2.01796 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.258256 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.95189 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.258256 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 94) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.04384 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0284391 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0366176 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0284391 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 3 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,3) where E0=(* 3 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(input -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0253722 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0264312 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0253501 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0253501 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(44 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.23424 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.375605 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.235285 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.23424 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(44 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.934037 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.493184 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.849749 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.493184 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 45) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.235184 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.389024 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.350955 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.235184 TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 45) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.51774 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.387669 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.7654 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.387669 TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 45) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.21762 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.540341 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.05053 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.540341 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 45) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.19597 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.317125 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.854411 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.317125 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 45) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 2.33039 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.299008 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 2.33985 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.299008 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 45) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 2.84587 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.909056 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 2.84412 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.909056 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(45 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.855744 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.316528 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.847232 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.316528 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(45 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.205083 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.303547 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.202037 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.202037 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(45 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.467808 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 6.47646 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.468395 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.467808 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(45 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.475797 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 12.8553 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.472405 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.472405 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(54 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.119022 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.158905 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.115929 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.115929 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(54 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.430603 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.154891 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.430539 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.154891 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 55) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.114837 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.15946 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.115474 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.114837 TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 55) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.838315 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.159797 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.797739 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.159797 TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 55) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.528928 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.255008 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.518389 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.255008 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 55) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.429984 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.1609 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.434859 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.1609 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 55) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.2233 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.148988 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.24571 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.148988 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 55) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.971147 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.260373 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.981675 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.260373 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(55 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.430347 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.154443 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.433653 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.154443 TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(55 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.102957 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.154599 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.106443 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.102957 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(55 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.239669 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 3.21856 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.239312 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.239312 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(55 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.240357 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 3.19539 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.240331 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.240331 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(64 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0717141 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0862587 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0721557 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0717141 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(64 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0794816 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0878587 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0793643 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0793643 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 80) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0726827 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0840747 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0729877 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0726827 TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 80) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.113099 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0811627 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.113134 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0811627 TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 80) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.307456 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.130148 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.266261 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.130148 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 80) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0797099 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.08732 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0795712 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0795712 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 80) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.407685 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0791104 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.313168 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0791104 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 80) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.380363 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.13573 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.378699 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.13573 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(80 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.140228 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.07888 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.113326 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.07888 TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(80 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.275317 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.131552 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.268608 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.131552 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(80 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.391851 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0788971 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.314437 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0788971 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(80 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.377515 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.135321 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.379808 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.135321 TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(80 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0770624 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.112256 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0765227 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0765227 TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(80 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0559253 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0797099 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0547749 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0547749 TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(80 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.363008 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.187307 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.359915 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.187307 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(80 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.121621 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.55983 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.123132 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.121621 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(80 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.128228 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.56992 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.13045 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.128228 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(80 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.15861 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.58027 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.159612 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.15861 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 267) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0771221 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.117093 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0861813 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0771221 TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 267) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.054301 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0789867 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0556876 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.054301 TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 267) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.363317 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.138571 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.674592 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.138571 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 267) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.121824 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.54146 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.122852 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.121824 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 267) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.164324 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.58754 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.129888 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.129888 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 267) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.158432 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.79039 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.15894 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.158432 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 326) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00714644 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0214267 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00501114 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00501114 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 326) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.105675 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0262539 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.105667 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0262539 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 326) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00642777 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0132952 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00612616 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00612616 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(291 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0538819 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0546712 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.054083 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0538819 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(291 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.219397 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.58468 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.257541 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.219397 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 3) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 3) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 3) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 3) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 314) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0566809 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0568836 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0583431 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0566809 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 3) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 3) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 3) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 3) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(314 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0570702 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0574382 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0572711 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0570702 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 3) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 3) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 3) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 3) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(314 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0578702 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0567876 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0565707 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0565707 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(315 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.054973 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.054659 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0542095 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0542095 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(315 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 13.1969 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.60387 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 12.9873 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 1.60387 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(315 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 12.9699 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.55874 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 13.1686 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 1.55874 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(315 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.216427 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.57901 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.216528 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.216427 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00686694 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0207147 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00749795 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00686694 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.105869 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0272706 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.105749 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0272706 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00761173 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0228601 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00683407 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00683407 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0081946 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0141907 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0103299 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0081946 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.105939 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0240076 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.107221 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0240076 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00660518 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0189191 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00669312 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00660518 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00591401 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.023594 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00746296 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00591401 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00640825 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0238556 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00822036 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00640825 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0073491 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0721707 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00741689 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0073491 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00609338 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.024259 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00585151 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00585151 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00557884 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0229056 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00659995 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00557884 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(326 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.102229 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 1.06425 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.103232 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.102229 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(55 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.786507 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.148309 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.787808 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.148309 TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(55 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.519029 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.254944 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.528117 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.254944 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(55 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.22351 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.142859 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.20707 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.142859 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(55 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.968021 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.257931 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.969163 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.257931 TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(55 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.03295 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.263339 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.978965 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.263339 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(55 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.896235 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 3.08575 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.891563 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.891563 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 182) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.427552 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.155676 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.43008 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.155676 TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 182) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.103856 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.148132 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.105475 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.103856 TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 182) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.960331 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.266736 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.963637 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.266736 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 182) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.237157 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 3.2017 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.237435 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.237157 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 182) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.241355 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 3.2146 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.241227 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.241227 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 182) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.889237 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 3.19973 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.884032 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.884032 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 241) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00762594 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0193647 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0083448 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00762594 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 241) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.409323 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0589245 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.408672 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0589245 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 241) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00768679 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0234048 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00879467 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00768679 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(206 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.101645 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.102045 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.102243 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.101645 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(206 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.434859 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 3.06721 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.427691 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.427691 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 5) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 5) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 5) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 5) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 229) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.107771 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.107403 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.109944 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.107403 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 5) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 5) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 5) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 5) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(229 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.108283 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.109584 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.108557 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.108283 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 5) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 5) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 5) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 5) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(229 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.107107 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.107187 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.109125 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.107107 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(230 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.102837 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.104213 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.103557 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.102837 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(230 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 26.0091 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 3.21862 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 26.2352 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 3.21862 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(230 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 26.205 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 2.93335 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 25.9797 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 2.93335 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(230 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.431499 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 3.2107 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.430763 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.430763 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00912231 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0208251 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00636662 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00636662 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.411403 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0600462 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.411616 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0600462 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00892407 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0185712 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.010112 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00892407 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00674624 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0214113 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00807924 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00674624 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.408608 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0608284 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.409376 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0608284 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0134012 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0198306 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0137387 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0134012 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.013088 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.059584 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0131943 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.013088 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0131856 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0590916 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0163134 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0131856 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0222747 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.240117 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.021184 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.021184 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00979992 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0598258 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0111604 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00979992 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00967467 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0576871 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00713623 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00713623 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.407328 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 3.16621 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.408917 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.407328 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(45 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.5558 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.350208 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.53778 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.350208 TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(45 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.05741 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.493568 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.05197 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.493568 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(45 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 2.39889 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.310283 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 2.3305 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.310283 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(45 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 2.72303 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.912373 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 2.83131 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.912373 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(45 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 2.8603 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.916192 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 2.80569 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.916192 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(45 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.85058 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 13.4465 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.8546 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 1.85058 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 96) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.847968 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.308917 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.857696 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.308917 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 96) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.409291 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.306795 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.201216 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.201216 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 96) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 2.83307 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.916309 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 2.58322 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.916309 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 96) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.623435 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 6.51193 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.688128 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.623435 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 96) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.471723 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 12.9431 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.480053 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.471723 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 96) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.77715 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 12.4427 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.76211 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 1.76211 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(120 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.197056 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.200917 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.200075 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.197056 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(120 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.847968 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 7.01316 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.848523 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.847968 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) -> Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 143) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.208965 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.208213 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.211013 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.208213 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) -> Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(143 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.205541 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.20512 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.208464 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.20512 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(143 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.206731 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.210309 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.205291 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.205291 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(145 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.197659 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.200475 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.200725 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.197659 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(145 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 50.0731 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 6.46684 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 50.3242 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 6.46684 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(145 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 49.8361 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 5.97799 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 50.4329 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 5.97799 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(145 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.854272 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 6.59931 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.856053 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.854272 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00917766 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0173931 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00935319 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00917766 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.61724 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.204976 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.78514 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.204976 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0369504 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0272697 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0367584 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0272697 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00825236 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0179178 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.013143 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00825236 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.61619 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.204037 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.61621 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.204037 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0661938 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0278729 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0661564 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0278729 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0329018 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.212603 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0332315 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0329018 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0332781 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.209088 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0332247 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0332247 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0860853 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.939712 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.086272 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0860853 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0216127 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.209088 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0215533 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0215533 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.021258 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.210139 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.021188 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.021188 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(156 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.85078 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 13.4217 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.61853 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 1.61853 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 350) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00763006 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0201079 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0106993 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00763006 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 350) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.61444 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.196267 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.607 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.196267 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 350) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0664569 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0280516 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.06624 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0280516 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 350) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0373796 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.201472 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0342539 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0342539 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 350) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0331093 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.210603 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0363339 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0331093 TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 350) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0848667 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.941397 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0864987 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0848667 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 350) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0242461 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.212603 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0197641 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0197641 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 350) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.021692 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.210475 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0233024 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.021692 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 350) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.67508 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 12.9823 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.62528 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 1.62528 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) -> Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 434) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0117506 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0189487 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00781271 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00781271 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) -> Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(434 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00737878 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0156112 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00992157 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00737878 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(434 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00712329 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0200464 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00767879 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00712329 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) -> Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) -> Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) -> Float((* (+ (# 2 (SHAPE input)) -10) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 380) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00902688 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0208107 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0085522 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0085522 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) -> Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 380) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.49094 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.194251 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.48903 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.194251 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) -> Float(1:4,(* (+ (# 2 (SHAPE input)) -10) E0),E0,1) where E0=(+ (# 3 (SHAPE input)) -10) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 380) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0343627 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0285316 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0346976 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0285316 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) -> Float((* (+ (# 2 (SHAPE input)) -10) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0084096 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0179335 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00790127 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00790127 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) -> Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.49426 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.198005 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.4997 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.198005 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) -> Float(1:4,(* (+ (# 2 (SHAPE input)) -10) E0),E0,1) where E0=(+ (# 3 (SHAPE input)) -10) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0354635 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.025993 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0341845 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.025993 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (# 2 (SHAPE input)) -10) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00767055 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0167125 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0089047 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00767055 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (# 2 (SHAPE input)) -10) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) -> Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.48965 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.183973 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.49356 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.183973 TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (# 2 (SHAPE input)) -10) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) -> Float(1:4,(* (+ (# 2 (SHAPE input)) -10) E0),E0,1) where E0=(+ (# 3 (SHAPE input)) -10) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0616836 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0312621 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.06144 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0312621 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0309673 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.197643 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0318022 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0309673 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) -> Float((* (+ (# 2 (SHAPE input)) -10) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0312834 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.197792 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0312931 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0312834 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) -> Float(1:4,(* (+ (# 2 (SHAPE input)) -10) E0),E0,1) where E0=(+ (# 3 (SHAPE input)) -10) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0798464 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.875744 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.080544 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0798464 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (# 2 (SHAPE input)) -10) E0),E0,1) where E0=(+ (# 3 (SHAPE input)) -10) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0200565 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.24384 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0202993 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0200565 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (# 2 (SHAPE input)) -10) E0),E0,1) where E0=(+ (# 3 (SHAPE input)) -10) -> Float((* (+ (# 2 (SHAPE input)) -10) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0197233 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.196619 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0204875 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0197233 TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (# 2 (SHAPE input)) -10) E0),E0,1) where E0=(+ (# 3 (SHAPE input)) -10) -> Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(380 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.54965 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 11.7824 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.50179 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 1.50179 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (# 2 (SHAPE input)) -10) E0),1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (# 2 (SHAPE input)) -10) E0),E0,1) where E0=(+ (# 3 (SHAPE input)) -10) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (# 2 (SHAPE input)) (# 3 (SHAPE input))),(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) -> Float(E1,E1,1,E0,(# 2 (SHAPE input))) where E0=(* 2 (# 2 (SHAPE input))) E1=(* (# 3 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 934) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0213593 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0291324 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0215147 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0213593 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) -> Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE input)) 32)) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 934) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.033952 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0337995 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0330938 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0330938 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) -> Float((* (# 2 (SHAPE input)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat( -> 934) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0698304 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0440453 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0694933 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0440453 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) -> Float(E1,E1,1,E0,(# 2 (SHAPE input))) where E0=(* 2 (# 2 (SHAPE input))) E1=(* (# 3 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0221167 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0288169 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0208493 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0208493 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) -> Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE input)) 32)) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0326264 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0297076 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0328766 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0297076 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) -> Float((* (# 2 (SHAPE input)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0692459 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0371781 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0699243 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0371781 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,1,E0,(# 2 (SHAPE input))) where E0=(* 2 (# 2 (SHAPE input))) E1=(* (# 3 (SHAPE input)) E0) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0269612 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0319709 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0270933 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0269612 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,1,E0,(# 2 (SHAPE input))) where E0=(* 2 (# 2 (SHAPE input))) E1=(* (# 3 (SHAPE input)) E0) -> Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE input)) 32)) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0414839 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0284924 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.041485 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0284924 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,1,E0,(# 2 (SHAPE input))) where E0=(* 2 (# 2 (SHAPE input))) E1=(* (# 3 (SHAPE input)) E0) -> Float((* (# 2 (SHAPE input)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0908693 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0407028 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.09128 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0407028 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE input)) 32)) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0234233 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0284569 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0217407 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0217407 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE input)) 32)) -> Float(E1,E1,1,E0,(# 2 (SHAPE input))) where E0=(* 2 (# 2 (SHAPE input))) E1=(* (# 3 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0184488 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.027792 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0182316 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0182316 TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE input)) 32)) -> Float((* (# 2 (SHAPE input)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0862293 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0402927 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0867413 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0402927 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0356032 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.402869 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.035824 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0356032 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) -> Float(E1,E1,1,E0,(# 2 (SHAPE input))) where E0=(* 2 (# 2 (SHAPE input))) E1=(* (# 3 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0364128 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.415872 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0371496 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0364128 TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) -> Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE input)) 32)) *************** TRT - VERBOSE --------------- Timing Runner: Optimizer Reformat(934 -> ) (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.037728 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.425909 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0375396 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0375396 TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(1:4,(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0),E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,1,E0,(# 2 (SHAPE input))) where E0=(* 2 (# 2 (SHAPE input))) E1=(* (# 3 (SHAPE input)) E0) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE input)) 32)) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) E0),1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE *************** Autotuning Reformat: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing reformatting costs TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: -> Int32(1), Int32(1), Int32(1), Int32(1), Int32(), Int32(1), Int32(), Int32(), Int32(1), Int32(), Int32(), Int32(), Int32() *************** TRT - VERBOSE --------------- Timing Runner: [HostToDeviceCopy] (ShapeHostToDevice) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.122528 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.122528 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: ShapeHostToDevice Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: -> Float(1,1,1,1) *************** TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(1,1,1,1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: ConstantOfShape_39 (Padding) TRT - VERBOSE Padding has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: ConstantOfShape_39 (Slice) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00640584 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00640584 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 3 E0),E0,(# 3 (SHAPE input)),1) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Conv_6 + Relu_7 (CudaDepthwiseConvolution) TRT - VERBOSE CudaDepthwiseConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_6 + Relu_7 (FusedConvActConvolution) TRT - VERBOSE FusedConvActConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_6 + Relu_7 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.536363 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.531755 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.692181 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 3.07268 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.613024 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 0.539669 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.531829 TRT - VERBOSE Tactic: 0x000000000000003a Time: 0.710272 TRT - VERBOSE Tactic: 0x000000000000003d Time: 2.87372 TRT - VERBOSE Tactic: 0x000000000000003e Time: 0.611744 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 0.531755 TRT - VERBOSE --------------- Timing Runner: Conv_6 + Relu_7 (CaskConvolution) TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 0.285579 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Tactic: 0x268494f0a1c83de3 Time: 0.214064 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 0.171349 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 0.283797 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 0.410571 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 0.15003 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.234123 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 0.268 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 0.145753 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 0.396629 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 0.388437 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 0.664992 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 0.561323 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.149568 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.134482 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 0.570176 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 1.00976 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 0.238171 TRT - VERBOSE Fastest Tactic: 0xc939b7b0a4d5a05f Time: 0.134482 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE *************** Autotuning format combination: Float((* (# 2 (SHAPE input)) E0),1,E0,3) -> Float((* (# 2 (SHAPE input)) E1),1,E1,32) where E0=(* 3 (# 3 (SHAPE input))) E1=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Conv_6 + Relu_7 (CaskConvolution) TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 0.694955 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 0.314069 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 0.655211 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 0.34816 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 0.595285 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 0.360704 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 0.312491 TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 0.609291 TRT - VERBOSE Fastest Tactic: 0xb132670a7750e065 Time: 0.312491 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xb132670a7750e065 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E0,(# 3 (SHAPE input)),1) -> Float(E1,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) E1=(* 32 E0) *************** TRT - VERBOSE --------------- Timing Runner: Conv_8 (CudaDepthwiseConvolution) TRT - VERBOSE CudaDepthwiseConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_8 (FusedConvActConvolution) TRT - VERBOSE FusedConvActConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_8 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.99856 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.848949 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 2.11085 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 6.13781 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.445621 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 1.00079 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.848416 TRT - VERBOSE Tactic: 0x000000000000003a Time: 2.10006 TRT - VERBOSE Tactic: 0x000000000000003d Time: 6.0904 TRT - VERBOSE Tactic: 0x000000000000003e Time: 0.439765 TRT - VERBOSE Fastest Tactic: 0x000000000000003e Time: 0.439765 TRT - VERBOSE --------------- Timing Runner: Conv_8 (CaskConvolution) TRT - VERBOSE Conv_8 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 1.64288 TRT - VERBOSE Conv_8 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Tactic: 0x268494f0a1c83de3 Time: 0.4488 TRT - VERBOSE Conv_8 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 0.841899 TRT - VERBOSE Conv_8 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 1.63635 TRT - VERBOSE Conv_8 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 1.81491 TRT - VERBOSE Conv_8 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 0.85632 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 1.16878 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 1.42107 TRT - VERBOSE Conv_8 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 0.874923 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 1.41862 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 1.45266 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 2.63212 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 2.22759 TRT - VERBOSE Conv_8 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.586923 TRT - VERBOSE Conv_8 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.517461 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 2.35882 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 4.60537 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 1.2432 TRT - VERBOSE Fastest Tactic: 0x268494f0a1c83de3 Time: 0.4488 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003e TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,32) -> Float(E1,1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: Conv_8 (CaskConvolution) TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 2.45009 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 1.26828 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 1.3695 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 1.00651 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 1.88202 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 1.01099 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 1.2681 TRT - VERBOSE Conv_8 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 1.88211 TRT - VERBOSE Fastest Tactic: 0x43334a9c8840c773 Time: 1.00651 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x43334a9c8840c773 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E0,(# 3 (SHAPE input)),1) -> Float(E1,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) E1=(* 32 E0) *************** TRT - VERBOSE --------------- Timing Runner: BatchNormalization_11 + Relu_12 (Scale) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.1972 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.1972 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,32) -> Float(E1,1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: BatchNormalization_11 + Relu_12 (Scale) TRT - VERBOSE Scale has no valid tactics for this config, skipping TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) -> Float((* 64 E2),E2,E1,1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) E1=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E2=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E1) *************** TRT - VERBOSE --------------- Timing Runner: Conv_13 + Relu_14 (CudaDepthwiseConvolution) TRT - VERBOSE CudaDepthwiseConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_13 + Relu_14 (FusedConvActConvolution) TRT - VERBOSE FusedConvActConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_13 + Relu_14 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.738197 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.448512 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 1.06254 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 10.3543 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 0.730987 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.445781 TRT - VERBOSE Tactic: 0x000000000000003a Time: 1.08071 TRT - VERBOSE Tactic: 0x000000000000003d Time: 10.3242 TRT - VERBOSE Fastest Tactic: 0x0000000000000039 Time: 0.445781 TRT - VERBOSE --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 0.423275 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 0.237051 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 0.421301 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 0.46464 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 0.239403 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.331888 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 0.384523 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 0.240533 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 0.368235 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 0.380117 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 0.671424 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 0.92592 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.323856 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.285248 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 0.695563 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 1.247 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 0.335531 TRT - VERBOSE Fastest Tactic: 0x27728c886a448c5a Time: 0.237051 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x27728c886a448c5a TRT - VERBOSE *************** Autotuning format combination: Float((* (# 2 (SHAPE input)) E0),1,E0,32) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E1),1,E1,64) where E0=(* 32 (# 3 (SHAPE input))) E1=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) *************** TRT - VERBOSE --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 0.619029 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 0.370005 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 0.443371 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 0.314917 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 0.493568 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 0.313819 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 0.36928 TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 0.496352 TRT - VERBOSE Fastest Tactic: 0x963db12d24e61b80 Time: 0.313819 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x963db12d24e61b80 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1,E0,1) -> Float(E2,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) E2=(* 64 E1) *************** TRT - VERBOSE --------------- Timing Runner: Conv_15 (CudaDepthwiseConvolution) TRT - VERBOSE CudaDepthwiseConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_15 (FusedConvActConvolution) TRT - VERBOSE FusedConvActConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_15 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.986315 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.986645 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 1.5401 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 5.66131 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.354987 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 0.986741 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.98656 TRT - VERBOSE Tactic: 0x000000000000003a Time: 1.54419 TRT - VERBOSE Tactic: 0x000000000000003d Time: 5.63346 TRT - VERBOSE Tactic: 0x000000000000003e Time: 0.356928 TRT - VERBOSE Fastest Tactic: 0x0000000000000006 Time: 0.354987 TRT - VERBOSE --------------- Timing Runner: Conv_15 (CaskConvolution) TRT - VERBOSE Conv_15 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 0.809643 TRT - VERBOSE Conv_15 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Tactic: 0x268494f0a1c83de3 Time: 0.346699 TRT - VERBOSE Conv_15 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 0.428448 TRT - VERBOSE Conv_15 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 0.805963 TRT - VERBOSE Conv_15 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 0.857685 TRT - VERBOSE Conv_15 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 0.441643 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.604341 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 0.708715 TRT - VERBOSE Conv_15 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 0.447051 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 0.589813 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 0.610293 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 1.11617 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 1.1005 TRT - VERBOSE Conv_15 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.561835 TRT - VERBOSE Conv_15 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.503947 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 1.14014 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 2.10108 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 0.605045 TRT - VERBOSE Fastest Tactic: 0x268494f0a1c83de3 Time: 0.346699 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,64) -> Float(E1,1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Conv_15 (CaskConvolution) TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 1.00896 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 0.955445 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 0.674816 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 0.516096 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 0.941952 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 0.51792 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 0.668277 TRT - VERBOSE Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 0.943915 TRT - VERBOSE Fastest Tactic: 0x43334a9c8840c773 Time: 0.516096 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x43334a9c8840c773 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1,E0,1) -> Float(E2,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) E2=(* 64 E1) *************** TRT - VERBOSE --------------- Timing Runner: BatchNormalization_18 + Relu_19 (Scale) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.102493 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.102493 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,64) -> Float(E1,1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: BatchNormalization_18 + Relu_19 (Scale) TRT - VERBOSE Scale has no valid tactics for this config, skipping TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 64 E1),E1,E0,1) -> Float((* 128 E3),E3,E2,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) E2=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E3=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E2) *************** TRT - VERBOSE --------------- Timing Runner: Conv_20 + Relu_21 (CudaDepthwiseConvolution) TRT - VERBOSE CudaDepthwiseConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_20 + Relu_21 (FusedConvActConvolution) TRT - VERBOSE FusedConvActConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_20 + Relu_21 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.619285 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.337355 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.798379 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 10.7348 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 0.617088 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.339413 TRT - VERBOSE Tactic: 0x000000000000003a Time: 0.803648 TRT - VERBOSE Tactic: 0x000000000000003d Time: 10.7555 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 0.337355 TRT - VERBOSE --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 0.254443 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 0.226491 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 0.254885 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 0.27016 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 0.234048 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.320944 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 0.380565 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 0.238213 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 0.34288 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 0.343339 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 0.370005 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 0.34112 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.31744 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.314395 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 0.350144 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 0.623979 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 0.321941 TRT - VERBOSE Fastest Tactic: 0x27728c886a448c5a Time: 0.226491 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x27728c886a448c5a TRT - VERBOSE *************** Autotuning format combination: Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0),1,E0,64) -> Float((* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E1),1,E1,128) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) E1=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) *************** TRT - VERBOSE --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 0.406187 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 0.343019 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 0.373973 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 0.270651 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 0.273472 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 0.271696 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 0.342016 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 0.274133 TRT - VERBOSE Fastest Tactic: 0x43334a9c8840c773 Time: 0.270651 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x43334a9c8840c773 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1,E0,1) -> Float(E2,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) E2=(* 128 E1) *************** TRT - VERBOSE --------------- Timing Runner: Conv_22 + Relu_23 (CudaDepthwiseConvolution) TRT - VERBOSE CudaDepthwiseConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_22 + Relu_23 (FusedConvActConvolution) TRT - VERBOSE FusedConvActConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_22 + Relu_23 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.794091 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.584779 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 1.04598 TRT - VERBOSE Tactic: 0x0000000000000004 skipped. Scratch requested: 8725266432, available: 1073741824 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 6.80073 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.416853 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 0.795467 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.586443 TRT - VERBOSE Tactic: 0x000000000000003a Time: 1.04516 TRT - VERBOSE Tactic: 0x000000000000003c skipped. Scratch requested: 8725266432, available: 1073741824 TRT - VERBOSE Tactic: 0x000000000000003d Time: 7.41715 TRT - VERBOSE Tactic: 0x000000000000003e Time: 0.414379 TRT - INFO Some tactics do not have sufficient workspace memory to run. Increasing workspace size will enable more tactics, please check verbose output for requested sizes. TRT - VERBOSE Fastest Tactic: 0x000000000000003e Time: 0.414379 TRT - VERBOSE Setting workspace to 8725266432enables more tactics for profiling TRT - VERBOSE --------------- Timing Runner: Conv_22 + Relu_23 (CaskConvolution) TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 0.487392 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Tactic: 0x268494f0a1c83de3 Time: 0.301397 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 0.425653 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 0.483509 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 0.506827 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 0.447499 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.597056 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 0.720117 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 0.451723 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 0.603477 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 0.644405 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 0.643147 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 0.633355 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.564299 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.698859 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 0.608939 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 1.11521 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 0.675584 TRT - VERBOSE Fastest Tactic: 0x268494f0a1c83de3 Time: 0.301397 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,128) -> Float(E1,1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Conv_22 + Relu_23 (CaskConvolution) TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 0.719531 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 0.658229 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 0.855381 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 0.501781 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 0.504576 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 0.5024 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 0.658027 TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 0.505813 TRT - VERBOSE Fastest Tactic: 0x43334a9c8840c773 Time: 0.501781 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x43334a9c8840c773 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1,E0,1) -> Float(E2,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) E2=(* 128 E1) *************** TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,128) -> Float(E1,1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1,E0,1) -> Float(E2,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) E2=(* 128 E1) *************** TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,128) -> Float(E1,1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1,E0,1) -> Float(E2,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) E2=(* 128 E1) *************** TRT - VERBOSE --------------- Timing Runner: Conv_28 (CudaDepthwiseConvolution) TRT - VERBOSE CudaDepthwiseConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_28 (FusedConvActConvolution) TRT - VERBOSE FusedConvActConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_28 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.695499 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.485696 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 1.02138 TRT - VERBOSE Tactic: 0x0000000000000004 skipped. Scratch requested: 8725266432, available: 1073741824 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 6.69936 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.319792 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 0.695467 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.521557 TRT - VERBOSE Tactic: 0x000000000000003a Time: 0.955797 TRT - VERBOSE Tactic: 0x000000000000003c skipped. Scratch requested: 8725266432, available: 1073741824 TRT - VERBOSE Tactic: 0x000000000000003d Time: 6.70928 TRT - VERBOSE Tactic: 0x000000000000003e Time: 0.323931 TRT - VERBOSE Fastest Tactic: 0x0000000000000006 Time: 0.319792 TRT - VERBOSE Setting workspace to 8725266432enables more tactics for profiling TRT - VERBOSE --------------- Timing Runner: Conv_28 (CaskConvolution) TRT - VERBOSE Conv_28 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 0.488789 TRT - VERBOSE Conv_28 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Tactic: 0x268494f0a1c83de3 Time: 0.299424 TRT - VERBOSE Conv_28 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 0.425931 TRT - VERBOSE Conv_28 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 0.535744 TRT - VERBOSE Conv_28 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 0.506923 TRT - VERBOSE Conv_28 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 0.444416 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.597013 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 0.720779 TRT - VERBOSE Conv_28 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 0.452608 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 0.627221 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 0.644224 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 0.643755 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 0.617131 TRT - VERBOSE Conv_28 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.5632 TRT - VERBOSE Conv_28 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.576352 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 0.625301 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 1.11479 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 0.596277 TRT - VERBOSE Fastest Tactic: 0x268494f0a1c83de3 Time: 0.299424 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,128) -> Float(E1,1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Conv_28 (CaskConvolution) TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 0.717493 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 0.658656 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 0.617547 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 0.502421 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 0.504491 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 0.500832 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 0.656939 TRT - VERBOSE Conv_28 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 0.504768 TRT - VERBOSE Fastest Tactic: 0x963db12d24e61b80 Time: 0.500832 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x963db12d24e61b80 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1,E0,1) -> Float(E2,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) E2=(* 128 E1) *************** TRT - VERBOSE --------------- Timing Runner: PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0567698 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.0548251 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.0534568 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.0551558 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.0848613 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.0534857 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.0618116 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0556053 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.0548922 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.0551756 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.055421 TRT - VERBOSE Fastest Tactic: 0x0000000000000002 Time: 0.0534568 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,128) -> Float(E1,1,E0,128) where E0=(MUL_ADD 128 (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 128) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0550811 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.0550811 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.053632 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.0547322 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.0564071 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.0537935 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.0560036 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0556978 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.0543832 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.0537691 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.0550491 TRT - VERBOSE Fastest Tactic: 0x0000000000000002 Time: 0.053632 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1:32,E0,1) -> Float(E2,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) E2=(* 4 E1) *************** TRT - VERBOSE --------------- Timing Runner: PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000018 Time: 0.0539398 TRT - VERBOSE Tactic: 0x0000000000000019 Time: 0.0565849 TRT - VERBOSE Tactic: 0x000000000000001a Time: 0.054848 TRT - VERBOSE Tactic: 0x000000000000001b Time: 0.0564124 TRT - VERBOSE Tactic: 0x000000000000001f Time: 0.0537112 TRT - VERBOSE Fastest Tactic: 0x000000000000001f Time: 0.0537112 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E1,E0,1) -> Float(1:4,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 2.97097 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 3.53597 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 3.19402 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 4.14987 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 3.8589 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 3.45488 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 5.07497 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 5.19331 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 4.49473 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 4.42027 TRT - VERBOSE Tactic: 0x000000000000000a Time: 1.96159 TRT - VERBOSE Tactic: 0x000000000000000b Time: 2.18896 TRT - VERBOSE Tactic: 0x000000000000000c Time: 2.13258 TRT - VERBOSE Tactic: 0x000000000000000d Time: 2.48987 TRT - VERBOSE Tactic: 0x000000000000000e Time: 2.65216 TRT - VERBOSE Tactic: 0x000000000000000f Time: 2.19076 TRT - VERBOSE Tactic: 0x0000000000000010 Time: 3.23877 TRT - VERBOSE Tactic: 0x0000000000000011 Time: 3.24637 TRT - VERBOSE Tactic: 0x0000000000000012 Time: 2.83788 TRT - VERBOSE Tactic: 0x0000000000000013 Time: 2.36291 TRT - VERBOSE Tactic: 0x0000000000000014 Time: 1.36333 TRT - VERBOSE Tactic: 0x0000000000000015 Time: 1.51623 TRT - VERBOSE Tactic: 0x0000000000000016 Time: 2.08315 TRT - VERBOSE Tactic: 0x0000000000000017 Time: 2.69657 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.195275 TRT - VERBOSE Tactic: 0x000000000000001d Time: 0.196912 TRT - VERBOSE Tactic: 0x000000000000001e Time: 0.206085 TRT - VERBOSE Fastest Tactic: 0x000000000000001c Time: 0.195275 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 128 E1),E1,E0,1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: ReduceMean_231 (Reduce) TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.0347723 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0390519 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.0389037 TRT - VERBOSE Fastest Tactic: 0x0000000000000005 Time: 0.0347723 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000005 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 128 E1),E1,E0,1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_205 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0539642 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.104077 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0539642 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float((* E2 E0),1,E0,128) -> Float((* E2 E3),1,E3,1) where E0=(MUL_ADD 128 E1 128) E1=(CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) E2=(+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E3=(+ E1 1) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_205 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.08852 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 1.84761 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.08852 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float((* 4 E1),E1:32,E0,1) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_205 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 15.7637 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 1.84661 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 1.84661 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E5,E5,E4,1) where E0=(+ E2 1) E1=(* (+ E3 1) E0) E2=(CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) E3=(CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) E4=(+ E2 3) E5=(* (+ E3 3) E4) *************** TRT - VERBOSE --------------- Timing Runner: Pad_219 (Padding) TRT - VERBOSE Padding has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Pad_219 (Slice) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0577351 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0577351 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E5,E5,E4,1) where E0=(+ E2 3) E1=(* (+ E3 3) E0) E2=(CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) E3=(CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) E4=(+ E2 1) E5=(* (+ E3 1) E4) *************** TRT - VERBOSE --------------- Timing Runner: Conv_220 (CudaDepthwiseConvolution) TRT - VERBOSE Tactic: 0xffffffffffffffff Time: 0.0685973 TRT - VERBOSE Fastest Tactic: 0xffffffffffffffff Time: 0.0685973 TRT - VERBOSE --------------- Timing Runner: Conv_220 (FusedConvActConvolution) TRT - VERBOSE FusedConvActConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_220 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0625831 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.063344 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.0774357 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 1.43881 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.475136 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 1.82346 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 0.0621831 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.0643253 TRT - VERBOSE Tactic: 0x000000000000003a Time: 0.0771925 TRT - VERBOSE Tactic: 0x000000000000003c Time: 1.41918 TRT - VERBOSE Tactic: 0x000000000000003d Time: 0.473248 TRT - VERBOSE Tactic: 0x000000000000003e Time: 1.8234 TRT - VERBOSE Fastest Tactic: 0x0000000000000038 Time: 0.0621831 TRT - VERBOSE --------------- Timing Runner: Conv_220 (CaskConvolution) TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d TRT - VERBOSE Tactic: 0x18597bd4a7d0164d Time: 1.89359 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 2.01545 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d TRT - VERBOSE Tactic: 0x25eed4cfa195d49d Time: 0.432597 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Tactic: 0x268494f0a1c83de3 Time: 1.7882 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 1.01484 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 1.8903 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 2.85401 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 0.895979 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 1.55563 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c TRT - VERBOSE Tactic: 0x7e29bdfccd92c42c Time: 0.878432 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 2.15813 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 0.912107 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 2.60789 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 2.34611 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 3.50151 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 3.56284 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.560469 TRT - VERBOSE Conv_220 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.380235 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 4.0109 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 6.4921 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 1.37881 TRT - VERBOSE Fastest Tactic: 0xc939b7b0a4d5a05f Time: 0.380235 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000038 TRT - VERBOSE *************** Autotuning format combination: Float((* (+ E2 3) E0),1,E0,1) -> Float((* (+ E2 1) E3),1,E3,1) where E0=(+ E1 3) E1=(CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) E2=(CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) E3=(+ E1 1) *************** TRT - VERBOSE --------------- Timing Runner: Conv_220 (CaskConvolution) TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 5.50109 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 2.40336 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 2.87066 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 2.65156 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 5.16461 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 2.50527 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 2.41926 TRT - VERBOSE Conv_220 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 5.20944 TRT - VERBOSE Fastest Tactic: 0x2595402367cdee5c Time: 2.40336 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2595402367cdee5c TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float((* 128 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_230 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0542857 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.10248 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0542857 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float((* E2 E0),1,E0,1) -> Float((* E2 E3),1,E3,128) where E0=(+ E1 1) E1=(CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) E2=(+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E3=(MUL_ADD 128 E1 128) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_230 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.185584 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.167221 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 0.167221 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1:32,E0,1) -> Float((* 4 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_230 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.335115 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 1.60293 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.335115 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1,E0,1), Float(E2,E1,E0,1), Float(E1,E1,E0,1) -> Float(E2,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) E2=(* 128 E1) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0775659 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.0780629 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.0777877 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.0794645 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.0793109 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.0777579 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.0791957 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0794773 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.0789973 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.0783659 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.0773888 TRT - VERBOSE Fastest Tactic: 0x000000000000001c Time: 0.0773888 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,128), Float(E1,1,E0,128), Float((* E3 E4),1,E4,1) -> Float(E1,1,E0,128) where E0=(MUL_ADD 128 E2 128) E1=(* E3 E0) E2=(CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) E3=(+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E4=(+ E2 1) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0771477 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.0793237 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.0783616 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.077888 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.0786496 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.0794005 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.0780629 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0784747 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.102976 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.0775552 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.0795584 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0771477 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1:32,E0,1), Float(E2,E1:32,E0,1), Float(E1,E1:32,E0,1) -> Float(E2,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) E2=(* 4 E1) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000018 Time: 0.0837173 TRT - VERBOSE Tactic: 0x0000000000000019 Time: 0.083704 TRT - VERBOSE Tactic: 0x000000000000001a Time: 0.0866347 TRT - VERBOSE Tactic: 0x000000000000001b Time: 0.0827029 TRT - VERBOSE Tactic: 0x000000000000001f Time: 0.0833867 TRT - VERBOSE Fastest Tactic: 0x000000000000001b Time: 0.0827029 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E1,E0,1), Float(1:4,E1,E0,1), Float(1:4,E1,E0,1) -> Float(1:4,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 3.2974 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 3.66604 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 6.53596 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 4.21887 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 3.71253 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 4.02432 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 5.57765 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 4.51276 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 4.41692 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 4.78369 TRT - VERBOSE Tactic: 0x000000000000000a Time: 1.96403 TRT - VERBOSE Tactic: 0x000000000000000b Time: 2.64783 TRT - VERBOSE Tactic: 0x000000000000000c Time: 2.53952 TRT - VERBOSE Tactic: 0x000000000000000d Time: 3.11159 TRT - VERBOSE Tactic: 0x000000000000000e Time: 3.40566 TRT - VERBOSE Tactic: 0x000000000000000f Time: 3.52734 TRT - VERBOSE Tactic: 0x0000000000000010 Time: 3.96453 TRT - VERBOSE Tactic: 0x0000000000000011 Time: 4.45167 TRT - VERBOSE Tactic: 0x0000000000000012 Time: 5.08996 TRT - VERBOSE Tactic: 0x0000000000000013 Time: 2.91069 TRT - VERBOSE Tactic: 0x0000000000000014 Time: 1.52702 TRT - VERBOSE Tactic: 0x0000000000000015 Time: 1.84021 TRT - VERBOSE Tactic: 0x0000000000000016 Time: 2.62895 TRT - VERBOSE Tactic: 0x0000000000000017 Time: 3.10629 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.367259 TRT - VERBOSE Tactic: 0x000000000000001d Time: 0.293925 TRT - VERBOSE Tactic: 0x000000000000001e Time: 0.298155 TRT - VERBOSE Fastest Tactic: 0x000000000000001d Time: 0.293925 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 128 E1),E1,E0,1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: ReduceMax_237 (Reduce) TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.030431 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0617956 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.0396729 TRT - VERBOSE Fastest Tactic: 0x0000000000000005 Time: 0.030431 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000005 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E2,E2,(# 3 (SHAPE input)),1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) E2=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Resize_250 (Resize) TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.0109289 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 0.0109289 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1,E0,1) -> Float(E2,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) E2=(* 64 E1) *************** TRT - VERBOSE --------------- Timing Runner: PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.108755 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.156779 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.101099 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.102301 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.103592 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.165325 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.103723 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.102856 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.106357 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.167341 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.102088 TRT - VERBOSE Fastest Tactic: 0x0000000000000002 Time: 0.101099 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,64) -> Float(E1,1,E0,64) where E0=(MUL_ADD 64 (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 64) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.102579 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.106501 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.101221 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.105885 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.102317 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.101043 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.104013 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.18264 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.102291 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.101739 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.103112 TRT - VERBOSE Fastest Tactic: 0x0000000000000005 Time: 0.101043 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1:32,E0,1) -> Float(E2,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) E2=(* 2 E1) *************** TRT - VERBOSE --------------- Timing Runner: PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000018 Time: 0.139467 TRT - VERBOSE Tactic: 0x0000000000000019 Time: 0.102531 TRT - VERBOSE Tactic: 0x000000000000001a Time: 0.102987 TRT - VERBOSE Tactic: 0x000000000000001b Time: 0.107659 TRT - VERBOSE Tactic: 0x000000000000001f Time: 0.158745 TRT - VERBOSE Fastest Tactic: 0x0000000000000019 Time: 0.102531 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E1,E0,1) -> Float(1:4,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 5.74929 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 6.85647 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 6.73928 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 8.04965 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 7.98825 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 6.10946 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 8.36427 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 8.35791 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 7.12634 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 7.74346 TRT - VERBOSE Tactic: 0x000000000000000a Time: 3.247 TRT - VERBOSE Tactic: 0x000000000000000b Time: 3.96356 TRT - VERBOSE Tactic: 0x000000000000000c Time: 3.83518 TRT - VERBOSE Tactic: 0x000000000000000d Time: 4.4613 TRT - VERBOSE Tactic: 0x000000000000000e Time: 4.35868 TRT - VERBOSE Tactic: 0x000000000000000f Time: 3.9619 TRT - VERBOSE Tactic: 0x0000000000000010 Time: 5.52811 TRT - VERBOSE Tactic: 0x0000000000000011 Time: 5.70631 TRT - VERBOSE Tactic: 0x0000000000000012 Time: 5.02521 TRT - VERBOSE Tactic: 0x0000000000000013 Time: 3.8938 TRT - VERBOSE Tactic: 0x0000000000000014 Time: 2.32222 TRT - VERBOSE Tactic: 0x0000000000000015 Time: 2.52655 TRT - VERBOSE Tactic: 0x0000000000000016 Time: 3.13963 TRT - VERBOSE Tactic: 0x0000000000000017 Time: 3.65577 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.390016 TRT - VERBOSE Tactic: 0x000000000000001d Time: 0.399701 TRT - VERBOSE Tactic: 0x000000000000001e Time: 0.389931 TRT - VERBOSE Fastest Tactic: 0x000000000000001e Time: 0.389931 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 64 E1),E1,E0,1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: ReduceMean_160 (Reduce) TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.0536244 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0587147 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.0598862 TRT - VERBOSE Fastest Tactic: 0x0000000000000005 Time: 0.0536244 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000005 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 64 E1),E1,E0,1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_134 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.103243 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.198315 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.103243 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float((* E2 E0),1,E0,64) -> Float((* E2 E3),1,E3,1) where E0=(MUL_ADD 64 E1 64) E1=(CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) E2=(+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E3=(+ E1 1) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_134 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.430763 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 3.34927 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.430763 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float((* 2 E1),E1:32,E0,1) -> Float(E1,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_134 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 27.5108 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 3.59938 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 3.59938 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E5,E5,E4,1) where E0=(+ E2 1) E1=(* (+ E3 1) E0) E2=(CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) E3=(CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) E4=(+ E2 5) E5=(* (+ E3 5) E4) *************** TRT - VERBOSE --------------- Timing Runner: Pad_148 (Padding) TRT - VERBOSE Padding has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Pad_148 (Slice) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.105819 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.105819 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E5,E5,E4,1) where E0=(+ E2 5) E1=(* (+ E3 5) E0) E2=(CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) E3=(CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) E4=(+ E2 1) E5=(* (+ E3 1) E4) *************** TRT - VERBOSE --------------- Timing Runner: Conv_149 (CudaDepthwiseConvolution) TRT - VERBOSE CudaDepthwiseConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_149 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.127819 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.129301 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.127979 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 0.197499 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.128043 TRT - VERBOSE Tactic: 0x000000000000003a Time: 0.127676 TRT - VERBOSE Fastest Tactic: 0x000000000000003a Time: 0.127676 TRT - VERBOSE --------------- Timing Runner: Conv_149 (CaskConvolution) TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d TRT - VERBOSE Tactic: 0x18597bd4a7d0164d Time: 3.27426 TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 3.55991 TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d TRT - VERBOSE Tactic: 0x25eed4cfa195d49d Time: 0.90592 TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 1.74735 TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 3.64729 TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 4.81885 TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 1.54283 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 2.68478 TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c TRT - VERBOSE Tactic: 0x7e29bdfccd92c42c Time: 1.51011 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 3.0914 TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 1.57053 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 3.89325 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 4.15744 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 7.03884 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 7.39138 TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.903851 TRT - VERBOSE Conv_149 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.760917 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 7.73454 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 14.1164 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 2.74091 TRT - VERBOSE Fastest Tactic: 0xc939b7b0a4d5a05f Time: 0.760917 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003a TRT - VERBOSE *************** Autotuning format combination: Float((* (+ E2 5) E0),1,E0,1) -> Float((* (+ E2 1) E3),1,E3,1) where E0=(+ E1 5) E1=(CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) E2=(CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) E3=(+ E1 1) *************** TRT - VERBOSE --------------- Timing Runner: Conv_149 (CaskConvolution) TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 11.646 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 5.16354 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 6.22781 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 5.2082 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 10.1017 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 4.87691 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 4.87831 TRT - VERBOSE Conv_149 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 9.73414 TRT - VERBOSE Fastest Tactic: 0x963db12d24e61b80 Time: 4.87691 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x963db12d24e61b80 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float((* 64 E1),E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_159 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.1028 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.483243 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.1028 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float((* E2 E0),1,E0,1) -> Float((* E2 E3),1,E3,64) where E0=(+ E1 1) E1=(CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) E2=(+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E3=(MUL_ADD 64 E1 64) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_159 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.503051 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.314075 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 0.314075 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1:32,E0,1) -> Float((* 2 E1),E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_159 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.03906 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 3.1566 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 1.03906 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1,E0,1), Float(E2,E1,E0,1), Float(E1,E1,E0,1) -> Float(E2,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) E2=(* 64 E1) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.197067 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.150258 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.149593 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.156021 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.226997 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.150766 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.157262 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.161874 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.252848 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.150567 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.148828 TRT - VERBOSE Fastest Tactic: 0x000000000000001c Time: 0.148828 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,64), Float(E1,1,E0,64), Float((* E3 E4),1,E4,1) -> Float(E1,1,E0,64) where E0=(MUL_ADD 64 E2 64) E1=(* E3 E0) E2=(CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) E3=(+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E4=(+ E2 1) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.149547 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.432811 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.149237 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.14955 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.15638 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.215061 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.151452 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.149938 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.155794 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.192939 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.151616 TRT - VERBOSE Fastest Tactic: 0x0000000000000002 Time: 0.149237 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 TRT - VERBOSE *************** Autotuning format combination: Float(E2,E1:32,E0,1), Float(E2,E1:32,E0,1), Float(E1,E1:32,E0,1) -> Float(E2,E1:32,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) E2=(* 2 E1) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000018 Time: 0.159008 TRT - VERBOSE Tactic: 0x0000000000000019 Time: 0.162852 TRT - VERBOSE Tactic: 0x000000000000001a Time: 0.229824 TRT - VERBOSE Tactic: 0x000000000000001b Time: 0.160683 TRT - VERBOSE Tactic: 0x000000000000001f Time: 0.159029 TRT - VERBOSE Fastest Tactic: 0x0000000000000018 Time: 0.159008 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E1,E0,1), Float(1:4,E1,E0,1), Float(1:4,E1,E0,1) -> Float(1:4,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 5.77866 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 6.76872 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 10.3149 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 6.94121 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 6.23257 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 8.07038 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 9.24047 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 7.99061 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 7.8807 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 8.74884 TRT - VERBOSE Tactic: 0x000000000000000a Time: 3.61919 TRT - VERBOSE Tactic: 0x000000000000000b Time: 4.17415 TRT - VERBOSE Tactic: 0x000000000000000c Time: 4.54997 TRT - VERBOSE Tactic: 0x000000000000000d Time: 4.97537 TRT - VERBOSE Tactic: 0x000000000000000e Time: 6.02795 TRT - VERBOSE Tactic: 0x000000000000000f Time: 6.30227 TRT - VERBOSE Tactic: 0x0000000000000010 Time: 6.13922 TRT - VERBOSE Tactic: 0x0000000000000011 Time: 6.95168 TRT - VERBOSE Tactic: 0x0000000000000012 Time: 8.46597 TRT - VERBOSE Tactic: 0x0000000000000013 Time: 4.2683 TRT - VERBOSE Tactic: 0x0000000000000014 Time: 2.84614 TRT - VERBOSE Tactic: 0x0000000000000015 Time: 3.32429 TRT - VERBOSE Tactic: 0x0000000000000016 Time: 3.75141 TRT - VERBOSE Tactic: 0x0000000000000017 Time: 5.48996 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.939584 TRT - VERBOSE Tactic: 0x000000000000001d Time: 0.746656 TRT - VERBOSE Tactic: 0x000000000000001e Time: 0.827392 TRT - VERBOSE Fastest Tactic: 0x000000000000001d Time: 0.746656 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 64 E1),E1,E0,1) -> Float(E1,E1,E0,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) *************** TRT - VERBOSE --------------- Timing Runner: ReduceMax_166 (Reduce) TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.0546697 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0602062 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.0590596 TRT - VERBOSE Fastest Tactic: 0x0000000000000005 Time: 0.0546697 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000005 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E2,E2,(# 3 (SHAPE input)),1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -2) 2) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -2) 2) 1) E0) E2=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Resize_179 (Resize) TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.00855707 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 0.00855707 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E0,(# 3 (SHAPE input)),1) -> Float(E1,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) E1=(* 32 E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.271152 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.199627 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.195861 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.209195 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.199387 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.197829 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.198859 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.207627 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.202096 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.197739 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.197973 TRT - VERBOSE Fastest Tactic: 0x0000000000000002 Time: 0.195861 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,32) -> Float(E1,1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.208325 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.307904 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.197627 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.199157 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.200976 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.263269 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.200064 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.199733 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.207931 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.305173 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.198021 TRT - VERBOSE Fastest Tactic: 0x0000000000000002 Time: 0.197627 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0:32,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000018 Time: 0.196619 TRT - VERBOSE Tactic: 0x0000000000000019 Time: 0.200363 TRT - VERBOSE Tactic: 0x000000000000001a Time: 0.322011 TRT - VERBOSE Tactic: 0x000000000000001b Time: 0.198896 TRT - VERBOSE Tactic: 0x000000000000001f Time: 0.196443 TRT - VERBOSE Fastest Tactic: 0x000000000000001f Time: 0.196443 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E0,(# 3 (SHAPE input)),1) -> Float(1:4,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 9.56814 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 11.3071 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 10.9048 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 12.6998 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 13.7851 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 11.8413 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 18.0323 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 16.8886 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 13.4559 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 14.7136 TRT - VERBOSE Tactic: 0x000000000000000a Time: 6.81028 TRT - VERBOSE Tactic: 0x000000000000000b Time: 7.5797 TRT - VERBOSE Tactic: 0x000000000000000c Time: 7.69676 TRT - VERBOSE Tactic: 0x000000000000000d Time: 8.57307 TRT - VERBOSE Tactic: 0x000000000000000e Time: 9.40897 TRT - VERBOSE Tactic: 0x000000000000000f Time: 7.57597 TRT - VERBOSE Tactic: 0x0000000000000010 Time: 11.1192 TRT - VERBOSE Tactic: 0x0000000000000011 Time: 10.9717 TRT - VERBOSE Tactic: 0x0000000000000012 Time: 9.32413 TRT - VERBOSE Tactic: 0x0000000000000013 Time: 7.87042 TRT - VERBOSE Tactic: 0x0000000000000014 Time: 4.64145 TRT - VERBOSE Tactic: 0x0000000000000015 Time: 5.36595 TRT - VERBOSE Tactic: 0x0000000000000016 Time: 6.09007 TRT - VERBOSE Tactic: 0x0000000000000017 Time: 7.6328 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.778923 TRT - VERBOSE Tactic: 0x000000000000001d Time: 0.795829 TRT - VERBOSE Tactic: 0x000000000000001e Time: 0.777323 TRT - VERBOSE Fastest Tactic: 0x000000000000001e Time: 0.777323 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: ReduceMean_89 (Reduce) TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.101805 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.109091 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.167557 TRT - VERBOSE Fastest Tactic: 0x0000000000000005 Time: 0.101805 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000005 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_62 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.200384 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.388971 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.200384 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float((* (# 2 (SHAPE input)) E0),1,E0,32) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_62 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.865515 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.955787 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.865515 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0:32,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_62 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 51.3027 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 6.79794 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 6.79794 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E2,E2,E1,1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) E1=(+ (# 3 (SHAPE input)) 6) E2=(* (+ (# 2 (SHAPE input)) 6) E1) *************** TRT - VERBOSE --------------- Timing Runner: Pad_76 (Padding) TRT - VERBOSE Padding has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Pad_76 (Slice) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.204411 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.204411 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E2,E2,(# 3 (SHAPE input)),1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) E2=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) TRT - VERBOSE CudaDepthwiseConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_78 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.56649 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 1.57345 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.254827 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 1.56663 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 1.85895 TRT - VERBOSE Tactic: 0x000000000000003a Time: 0.253579 TRT - VERBOSE Fastest Tactic: 0x000000000000003a Time: 0.253579 TRT - VERBOSE --------------- Timing Runner: Conv_78 (CaskConvolution) TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d TRT - VERBOSE Tactic: 0x18597bd4a7d0164d Time: 6.85602 TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 7.03978 TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d TRT - VERBOSE Tactic: 0x25eed4cfa195d49d Time: 1.83415 TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 3.88733 TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 7.26416 TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 10.1411 TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 3.11692 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 5.3666 TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c TRT - VERBOSE Tactic: 0x7e29bdfccd92c42c Time: 3.01329 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 6.19239 TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 3.14982 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 7.75695 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 8.42601 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 14.5804 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 15.1264 TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 1.85238 TRT - VERBOSE Conv_78 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 1.51379 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 15.9169 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 26.5338 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 5.47222 TRT - VERBOSE Fastest Tactic: 0xc939b7b0a4d5a05f Time: 1.51379 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003a TRT - VERBOSE *************** Autotuning format combination: Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) where E0=(+ (# 3 (SHAPE input)) 6) *************** TRT - VERBOSE --------------- Timing Runner: Conv_78 (CaskConvolution) TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 23.3735 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 10.4749 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 12.5889 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 10.0243 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 19.9543 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 9.77047 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 9.93232 TRT - VERBOSE Conv_78 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 20.6461 TRT - VERBOSE Fastest Tactic: 0x963db12d24e61b80 Time: 9.77047 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x963db12d24e61b80 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1) -> Float((* 32 E0),E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_88 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.200944 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.388693 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.200944 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float((* (# 2 (SHAPE input)) E0),1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_88 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.69301 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.554197 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 0.554197 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0:32,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Reshape_88 (Shuffle) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 2.08542 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 6.77305 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 2.08542 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E0,(# 3 (SHAPE input)),1), Float(E1,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E1,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) E1=(* 32 E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.565995 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.379563 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.377195 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.377515 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.381163 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.376821 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.370037 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.716203 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.370784 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.372661 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.37936 TRT - VERBOSE Fastest Tactic: 0x0000000000000006 Time: 0.370037 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000006 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,32), Float(E1,1,E0,32), Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) -> Float(E1,1,E0,32) where E0=(* 32 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.292075 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.291472 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.374757 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.292373 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.291456 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.429776 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.331691 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.294224 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.602112 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.299605 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.292251 TRT - VERBOSE Fastest Tactic: 0x0000000000000004 Time: 0.291456 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000004 TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0:32,(# 3 (SHAPE input)),1), Float(E0,E0:32,(# 3 (SHAPE input)),1), Float(E0,E0:32,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000018 Time: 0.315003 TRT - VERBOSE Tactic: 0x0000000000000019 Time: 0.313307 TRT - VERBOSE Tactic: 0x000000000000001a Time: 0.478891 TRT - VERBOSE Tactic: 0x000000000000001b Time: 0.314027 TRT - VERBOSE Tactic: 0x000000000000001f Time: 0.322411 TRT - VERBOSE Fastest Tactic: 0x0000000000000019 Time: 0.313307 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E0,(# 3 (SHAPE input)),1), Float(1:4,E0,(# 3 (SHAPE input)),1), Float(1:4,E0,(# 3 (SHAPE input)),1) -> Float(1:4,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 10.8634 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 12.1426 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 22.0862 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 14.9888 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 13.708 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 17.0871 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 18.0682 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 15.9537 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 16.1482 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 17.0346 TRT - VERBOSE Tactic: 0x000000000000000a Time: 6.85056 TRT - VERBOSE Tactic: 0x000000000000000b Time: 8.55702 TRT - VERBOSE Tactic: 0x000000000000000c Time: 9.08932 TRT - VERBOSE Tactic: 0x000000000000000d Time: 9.37662 TRT - VERBOSE Tactic: 0x000000000000000e Time: 11.412 TRT - VERBOSE Tactic: 0x000000000000000f Time: 11.8333 TRT - VERBOSE Tactic: 0x0000000000000010 Time: 12.2689 TRT - VERBOSE Tactic: 0x0000000000000011 Time: 13.7832 TRT - VERBOSE Tactic: 0x0000000000000012 Time: 17.4109 TRT - VERBOSE Tactic: 0x0000000000000013 Time: 8.36875 TRT - VERBOSE Tactic: 0x0000000000000014 Time: 5.17472 TRT - VERBOSE Tactic: 0x0000000000000015 Time: 6.13819 TRT - VERBOSE Tactic: 0x0000000000000016 Time: 7.7721 TRT - VERBOSE Tactic: 0x0000000000000017 Time: 10.5013 TRT - VERBOSE Tactic: 0x000000000000001c Time: 1.51831 TRT - VERBOSE Tactic: 0x000000000000001d Time: 1.49246 TRT - VERBOSE Tactic: 0x000000000000001e Time: 1.49049 TRT - VERBOSE Fastest Tactic: 0x000000000000001e Time: 1.49049 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float((* 32 E0),E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: ReduceMax_95 (Reduce) TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.104691 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.108571 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.125493 TRT - VERBOSE Fastest Tactic: 0x0000000000000005 Time: 0.104691 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000005 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Resize_108 (Resize) TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.00686302 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 0.00686302 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0210787 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.0225628 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.0216853 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.0210067 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.0227684 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.0210833 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.0212167 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0234304 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.0213193 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.021604 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.0214513 TRT - VERBOSE Fastest Tactic: 0x0000000000000003 Time: 0.0210067 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000003 TRT - VERBOSE *************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE input)),1), Float(E0,1,(# 3 (SHAPE input)),1), Float(E0,1,(# 3 (SHAPE input)),1), Float(E0,1,(# 3 (SHAPE input)),1) -> Float(E0,1,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0216627 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.0214347 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.0214773 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.0216573 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.0215193 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.0213647 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.0213373 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0214727 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.021398 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.021158 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.0213213 TRT - VERBOSE Fastest Tactic: 0x0000000000000009 Time: 0.021158 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0:32,(# 3 (SHAPE input)),1), Float(E0,E0:32,(# 3 (SHAPE input)),1), Float(E0,E0:32,(# 3 (SHAPE input)),1), Float(E0,E0:32,(# 3 (SHAPE input)),1) -> Float(E0,E0:32,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253)) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000018 Time: 0.478549 TRT - VERBOSE Tactic: 0x0000000000000019 Time: 0.477835 TRT - VERBOSE Tactic: 0x000000000000001a Time: 0.471776 TRT - VERBOSE Tactic: 0x000000000000001b Time: 0.469867 TRT - VERBOSE Tactic: 0x000000000000001f Time: 0.47728 TRT - VERBOSE Fastest Tactic: 0x000000000000001b Time: 0.469867 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E0,(# 3 (SHAPE input)),1), Float(1:4,E0,(# 3 (SHAPE input)),1), Float(1:4,E0,(# 3 (SHAPE input)),1), Float(1:4,E0,(# 3 (SHAPE input)),1) -> Float(1:4,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253)) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.466944 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.551531 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 1.07104 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.632619 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.894059 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.859189 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.778336 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.918656 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.619861 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.721461 TRT - VERBOSE Tactic: 0x000000000000000a Time: 0.233184 TRT - VERBOSE Tactic: 0x000000000000000b Time: 0.296859 TRT - VERBOSE Tactic: 0x000000000000000c Time: 0.374368 TRT - VERBOSE Tactic: 0x000000000000000d Time: 0.357035 TRT - VERBOSE Tactic: 0x000000000000000e Time: 0.459179 TRT - VERBOSE Tactic: 0x000000000000000f Time: 0.285968 TRT - VERBOSE Tactic: 0x0000000000000010 Time: 0.479093 TRT - VERBOSE Tactic: 0x0000000000000011 Time: 0.550912 TRT - VERBOSE Tactic: 0x0000000000000012 Time: 0.380085 TRT - VERBOSE Tactic: 0x0000000000000013 Time: 0.349557 TRT - VERBOSE Tactic: 0x0000000000000014 Time: 0.175269 TRT - VERBOSE Tactic: 0x0000000000000015 Time: 0.219371 TRT - VERBOSE Tactic: 0x0000000000000016 Time: 0.366923 TRT - VERBOSE Tactic: 0x0000000000000017 Time: 0.393536 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.0656196 TRT - VERBOSE Tactic: 0x000000000000001d Time: 0.0652178 TRT - VERBOSE Tactic: 0x000000000000001e Time: 0.0647164 TRT - VERBOSE Fastest Tactic: 0x000000000000001e Time: 0.0647164 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: MaxPool_262 (TiledPooling) TRT - VERBOSE Tactic: 0x00000000002a0101 Time: 0.0156407 TRT - VERBOSE Tactic: 0x00000000002b0101 Time: 0.0130437 TRT - VERBOSE Tactic: 0x00000000002c0101 Time: 0.0134916 TRT - VERBOSE Tactic: 0x00000000002d0101 Time: 0.0143507 TRT - VERBOSE Tactic: 0x00000000002e0101 Time: 0.0152024 TRT - VERBOSE Tactic: 0x00000000002f0101 Time: 0.0149009 TRT - VERBOSE Tactic: 0x0000000000300101 Time: 0.0141053 TRT - VERBOSE Tactic: 0x0000000000310101 Time: 0.0150419 TRT - VERBOSE Tactic: 0x0000000000320101 Time: 0.0139236 TRT - VERBOSE Tactic: 0x0000000000330101 Time: 0.0132016 TRT - VERBOSE Tactic: 0x0000000000340101 Time: 0.0149347 TRT - VERBOSE Tactic: 0x0000000000350101 Time: 0.0149115 TRT - VERBOSE Tactic: 0x0000000000360101 Time: 0.0140973 TRT - VERBOSE Tactic: 0x0000000000370101 Time: 0.0144631 TRT - VERBOSE Tactic: 0x0000000000380101 Time: 0.015729 TRT - VERBOSE Tactic: 0x0000000000390101 Time: 0.0158034 TRT - VERBOSE Tactic: 0x00000000003a0101 Time: 0.0214693 TRT - VERBOSE Tactic: 0x00000000003b0101 Time: 0.0150553 TRT - VERBOSE Tactic: 0x00000000003c0101 Time: 0.0140716 TRT - VERBOSE Tactic: 0x00000000003d0101 Time: 0.0131504 TRT - VERBOSE Tactic: 0x00000000003e0101 Time: 0.0158308 TRT - VERBOSE Tactic: 0x00000000003f0101 Time: 0.0163886 TRT - VERBOSE Tactic: 0x0000000000400101 Time: 0.0149881 TRT - VERBOSE Tactic: 0x0000000000410101 Time: 0.0142022 TRT - VERBOSE Tactic: 0x0000000000420101 Time: 0.016221 TRT - VERBOSE Tactic: 0x0000000000430101 Time: 0.0173109 TRT - VERBOSE Tactic: 0x0000000000440101 Time: 0.0152509 TRT - VERBOSE Tactic: 0x0000000000450101 Time: 0.0158681 TRT - VERBOSE Tactic: 0x0000000000460101 Time: 0.0173904 TRT - VERBOSE Tactic: 0x0000000000470101 Time: 0.0158216 TRT - VERBOSE Tactic: 0x0000000000480101 Time: 0.0149013 TRT - VERBOSE Tactic: 0x0000000000490101 Time: 0.0172363 TRT - VERBOSE Tactic: 0x00000000004a0101 Time: 0.0175921 TRT - VERBOSE Tactic: 0x00000000004b0101 Time: 0.0159081 TRT - VERBOSE Tactic: 0x00000000004c0101 Time: 0.016576 TRT - VERBOSE Tactic: 0x00000000004d0101 Time: 0.0182658 TRT - VERBOSE Tactic: 0x00000000004e0101 Time: 0.0165404 TRT - VERBOSE Tactic: 0x00000000004f0101 Time: 0.0153295 TRT - VERBOSE Tactic: 0x0000000000500101 Time: 0.0175966 TRT - VERBOSE Tactic: 0x0000000000510101 Time: 0.0183276 TRT - VERBOSE Tactic: 0x0000000000520101 Time: 0.01651 TRT - VERBOSE Tactic: 0x0000000000530101 Time: 0.0167243 TRT - VERBOSE Tactic: 0x0000000000640101 Time: 0.00926044 TRT - VERBOSE Tactic: 0x0000000000670101 Time: 0.00941067 TRT - VERBOSE Fastest Tactic: 0x0000000000640101 Time: 0.00926044 TRT - VERBOSE --------------- Timing Runner: MaxPool_262 (CudnnPooling) TRT - VERBOSE Tactic: 0xffffffffffffffff Time: 0.0351136 TRT - VERBOSE Fastest Tactic: 0xffffffffffffffff Time: 0.0351136 TRT - VERBOSE --------------- Timing Runner: MaxPool_262 (CaskPooling) TRT - VERBOSE MaxPool_262 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Max Tactic: 0xb59f9cfb90407c92 TRT - VERBOSE Tactic: 0xb59f9cfb90407c92 Time: 0.0357952 TRT - VERBOSE Fastest Tactic: 0xb59f9cfb90407c92 Time: 0.0357952 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 0x0000000000640101 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E2,E2,E1,1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) E1=(+ (# 3 (SHAPE input)) 6) E2=(* (+ (# 2 (SHAPE input)) 6) E1) *************** TRT - VERBOSE --------------- Timing Runner: Pad_313 (Padding) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00675136 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00675136 TRT - VERBOSE --------------- Timing Runner: Pad_313 (Slice) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0126021 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0126021 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Padding Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E2,E2,(# 3 (SHAPE input)),1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) E2=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Conv_315 (CudaDepthwiseConvolution) TRT - VERBOSE CudaDepthwiseConvolution has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Conv_315 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0643413 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.0643733 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.096464 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 0.0641013 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.071984 TRT - VERBOSE Tactic: 0x000000000000003a Time: 0.0971467 TRT - VERBOSE Fastest Tactic: 0x0000000000000038 Time: 0.0641013 TRT - VERBOSE --------------- Timing Runner: Conv_315 (CaskConvolution) TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d TRT - VERBOSE Tactic: 0x18597bd4a7d0164d Time: 0.255339 TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 0.261685 TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d TRT - VERBOSE Tactic: 0x25eed4cfa195d49d Time: 0.065232 TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 0.146521 TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 0.260661 TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 0.381024 TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 0.130041 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.210603 TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c TRT - VERBOSE Tactic: 0x7e29bdfccd92c42c Time: 0.125774 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 0.237056 TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 0.130286 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 0.303755 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 0.316507 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 0.523403 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 0.550912 TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0786837 TRT - VERBOSE Conv_315 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.0671296 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 0.573088 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 0.9056 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 0.180363 TRT - VERBOSE Fastest Tactic: 0x25eed4cfa195d49d Time: 0.065232 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000038 TRT - VERBOSE *************** Autotuning format combination: Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) where E0=(+ (# 3 (SHAPE input)) 6) *************** TRT - VERBOSE --------------- Timing Runner: Conv_315 (CaskConvolution) TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 0.704555 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 0.316592 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 0.367211 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 0.692427 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 0.597941 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 0.31936 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 0.313765 TRT - VERBOSE Conv_315 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 0.604459 TRT - VERBOSE Fastest Tactic: 0xb132670a7750e065 Time: 0.313765 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xb132670a7750e065 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E2,E2,(# 3 (SHAPE input)),1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) E2=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning format combination: Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) where E0=(+ (# 3 (SHAPE input)) 6) *************** TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E2,E2,(# 3 (SHAPE input)),1) where E0=(+ (# 3 (SHAPE input)) 6) E1=(* (+ (# 2 (SHAPE input)) 6) E0) E2=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning format combination: Float((* (+ (# 2 (SHAPE input)) 6) E0),1,E0,1) -> Float((* (# 2 (SHAPE input)) (# 3 (SHAPE input))),1,(# 3 (SHAPE input)),1) where E0=(+ (# 3 (SHAPE input)) 6) *************** TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: -> Float(1,1,1,1) *************** TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(1,1,1,1) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: ConstantOfShape_277 (Padding) TRT - VERBOSE Padding has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: ConstantOfShape_277 (Slice) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00582933 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00582933 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0065851 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0237746 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00803784 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0065851 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E1,1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00672747 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.02143 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00802413 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00672747 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.51905 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.199931 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.51612 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.199931 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(1:4,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0336213 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0287084 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0342827 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0287084 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,1) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00656544 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0223595 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00674859 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00656544 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,1) -> Float(E1,1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.00689502 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0233671 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00782164 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.00689502 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,1) -> Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.51152 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.195227 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.51532 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.195227 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea TRT - VERBOSE *************** Autotuning format combination: Float(E1,1,E0,1) -> Float(1:4,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0599769 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.0288996 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0601707 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.0288996 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1:32,E0,1) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0317236 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.198907 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0313164 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0313164 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1:32,E0,1) -> Float(E1,1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0309896 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.201776 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0310371 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0309896 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1:32,E0,1) -> Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.53405 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.253883 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.5312 TRT - VERBOSE Fastest Tactic: 0x00000000000003ea Time: 0.253883 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1:32,E0,1) -> Float(1:4,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0826688 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.890197 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0800064 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0800064 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E1,E0,1) -> Float(E1,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0199115 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.196965 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0210007 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 0.0199115 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E1,E0,1) -> Float(E1,1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0313464 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.190747 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0260914 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0260914 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E1,E0,1) -> Float(E1,E1:32,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 1.5005 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 12.0013 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 1.50295 TRT - VERBOSE Fastest Tactic: 0x00000000000003e8 Time: 1.5005 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 TRT - VERBOSE *************** Autotuning format combination: Float(1:4,E1,E0,1) -> Float(1:4,E1,E0,1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) *************** TRT - VERBOSE --------------- Timing Runner: Cast_278 (Cast) TRT - VERBOSE Cast has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: Cast_278 (Reformat) TRT - VERBOSE Tactic: 0x00000000000003e8 Time: 0.0424267 TRT - VERBOSE Tactic: 0x00000000000003ea Time: 0.193045 TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0422027 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0422027 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,1) -> Float(E2,E2,(# 3 (SHAPE input)),1) where E0=(+ (# 3 (SHAPE input)) -10) E1=(* (+ (# 2 (SHAPE input)) -10) E0) E2=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Pad_293 (Padding) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0122423 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.0122423 TRT - VERBOSE --------------- Timing Runner: Pad_293 (Slice) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00798527 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00798527 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Int32(), Int32() -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: {ForeignNode[464 + (Unnamed Layer* 268) [Shuffle]...Where_344]} (Myelin) TRT - WARNING Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: TRT - WARNING (# 2 (SHAPE input)) TRT - WARNING (# 3 (SHAPE input)) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.212523 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.212523 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Conv_751 (CudaDepthwiseConvolution) TRT - VERBOSE Tactic: 0xffffffffffffffff Time: 0.110832 TRT - VERBOSE Fastest Tactic: 0xffffffffffffffff Time: 0.110832 TRT - VERBOSE --------------- Timing Runner: Conv_751 (FusedConvActConvolution) TRT - VERBOSE Tactic: 0x000000000007ffff Time: 0.0652071 TRT - VERBOSE Fastest Tactic: 0x000000000007ffff Time: 0.0652071 TRT - VERBOSE --------------- Timing Runner: Conv_751 (CudnnConvolution) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0550964 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.0549105 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.0838373 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 1.08612 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.201397 TRT - VERBOSE Tactic: 0x0000000000000038 Time: 0.0552472 TRT - VERBOSE Tactic: 0x0000000000000039 Time: 0.0588818 TRT - VERBOSE Tactic: 0x000000000000003a Time: 0.083848 TRT - VERBOSE Tactic: 0x000000000000003d Time: 1.07565 TRT - VERBOSE Tactic: 0x000000000000003e Time: 0.201333 TRT - VERBOSE Fastest Tactic: 0x0000000000000001 Time: 0.0549105 TRT - VERBOSE --------------- Timing Runner: Conv_751 (CaskConvolution) TRT - VERBOSE Conv_751 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 TRT - VERBOSE Tactic: 0x195431d38ba5af88 Time: 0.218981 TRT - VERBOSE Conv_751 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Tactic: 0x268494f0a1c83de3 Time: 0.197648 TRT - VERBOSE Conv_751 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Tactic: 0x27728c886a448c5a Time: 0.121458 TRT - VERBOSE Conv_751 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 TRT - VERBOSE Tactic: 0x365602d0613d4c36 Time: 0.215925 TRT - VERBOSE Conv_751 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b TRT - VERBOSE Tactic: 0x597d29027694c20b Time: 0.3156 TRT - VERBOSE Conv_751 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 TRT - VERBOSE Tactic: 0x5e7d1125e7896624 Time: 0.10612 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 TRT - VERBOSE Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.173472 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 TRT - VERBOSE Tactic: 0x8d5c64a52fab02c9 Time: 0.194752 TRT - VERBOSE Conv_751 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 TRT - VERBOSE Tactic: 0x90238daf8750ddb0 Time: 0.108032 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 TRT - VERBOSE Tactic: 0x93a1176336e5b9f6 Time: 0.24864 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da TRT - VERBOSE Tactic: 0x994f5b723e2d80da Time: 0.262283 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 TRT - VERBOSE Tactic: 0xac49795b871b0d29 Time: 0.430475 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b TRT - VERBOSE Tactic: 0xb6717e61503d5e9b Time: 0.450539 TRT - VERBOSE Conv_751 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e TRT - VERBOSE Tactic: 0xc2a5fc6b5e7cef5e Time: 0.06544 TRT - VERBOSE Conv_751 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Tactic: 0xc939b7b0a4d5a05f Time: 0.0563022 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 TRT - VERBOSE Tactic: 0xd1338f4b38d341e2 Time: 0.469995 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c TRT - VERBOSE Tactic: 0xd2aa21bfe2167c0c Time: 0.820192 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e TRT - VERBOSE Tactic: 0xe40b38338a3a7d7e Time: 0.176229 TRT - VERBOSE Fastest Tactic: 0xc939b7b0a4d5a05f Time: 0.0563022 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000001 TRT - VERBOSE *************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE input)),1) -> Float(E0,1,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: Conv_751 (CaskConvolution) TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a TRT - VERBOSE Tactic: 0x0447933cc2be855a Time: 0.69248 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c TRT - VERBOSE Tactic: 0x2595402367cdee5c Time: 0.308261 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 TRT - VERBOSE Tactic: 0x3eba442f4c9c4f50 Time: 0.360448 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 TRT - VERBOSE Tactic: 0x43334a9c8840c773 Time: 0.311637 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e TRT - VERBOSE Tactic: 0x66e3239eee98201e Time: 0.585312 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 TRT - VERBOSE Tactic: 0x963db12d24e61b80 Time: 0.313525 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 TRT - VERBOSE Tactic: 0xb132670a7750e065 Time: 0.308133 TRT - VERBOSE Conv_751 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 TRT - VERBOSE Tactic: 0xde4165142218dab8 Time: 0.592917 TRT - VERBOSE Fastest Tactic: 0xb132670a7750e065 Time: 0.308133 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xb132670a7750e065 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE input)),1) -> Float(E0,1,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE input)),1) -> Float(E0,1,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE input)),1) -> Float(E0,1,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1) -> Float(E0,E0,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE *************** Autotuning format combination: Float(E0,1,(# 3 (SHAPE input)),1) -> Float(E0,1,(# 3 (SHAPE input)),1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Float(E0,E0,(# 3 (SHAPE input)),1), Int32(), Int32() -> Float(E2,E2,E1,2,1) where E0=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) E1=(* 2 (# 3 (SHAPE input))) E2=(* (# 2 (SHAPE input)) E1) *************** TRT - VERBOSE --------------- Timing Runner: {ForeignNode[920 + (Unnamed Layer* 830) [Shuffle]...Concat_792]} (Myelin) TRT - WARNING Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: TRT - WARNING (# 2 (SHAPE input)) TRT - WARNING (# 3 (SHAPE input)) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.282864 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.282864 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: -> Int32(1) *************** TRT - VERBOSE --------------- Timing Runner: Range_382 (Fill) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00417667 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00417667 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: -> Int32(1) *************** TRT - VERBOSE --------------- Timing Runner: Range_513 (Fill) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00399251 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00399251 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: -> Int32(1) *************** TRT - VERBOSE --------------- Timing Runner: Range_646 (Fill) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00375395 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00375395 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: -> Int32(1) *************** TRT - VERBOSE --------------- Timing Runner: Range_433 (Fill) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00377564 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00377564 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: -> Int32(1) *************** TRT - VERBOSE --------------- Timing Runner: Range_564 (Fill) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00425897 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00425897 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: -> Int32(1) *************** TRT - VERBOSE --------------- Timing Runner: Range_697 (Fill) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.00391876 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 0.00391876 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0x0000000000000000 TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0,2,1) -> Float(E1,E1,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(Clip_793) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(Clip_793) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0175905 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.017952 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.017032 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.0185162 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.021172 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.016098 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.0201901 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0175013 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.0190951 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.0145878 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.0180362 TRT - VERBOSE Fastest Tactic: 0x0000000000000009 Time: 0.0145878 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,1,E0,(# 2 (SHAPE input))) -> Float(E1,E1,1,E0,(# 2 (SHAPE input))) where E0=(* 2 (# 2 (SHAPE input))) E1=(* (# 3 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(Clip_793) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(Clip_793) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.0200841 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.0182254 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.0178094 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.0181951 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.0160544 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.0232226 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.0216027 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.0176679 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.0166944 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.0152548 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.0182686 TRT - VERBOSE Fastest Tactic: 0x0000000000000009 Time: 0.0152548 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 TRT - VERBOSE *************** Autotuning format combination: Float(E1,E1,E0:32,2,1) -> Float(E1,E1,E0:32,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* E0 (CEIL_DIV (# 2 (SHAPE input)) 32)) *************** TRT - VERBOSE --------------- Timing Runner: PWN(Clip_793) (PointWise) TRT - VERBOSE PointWise has no valid tactics for this config, skipping TRT - VERBOSE --------------- Timing Runner: PWN(Clip_793) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000018 Time: 0.0166283 TRT - VERBOSE Tactic: 0x0000000000000019 Time: 0.0168912 TRT - VERBOSE Tactic: 0x000000000000001a Time: 0.0214331 TRT - VERBOSE Tactic: 0x000000000000001b Time: 0.0179599 TRT - VERBOSE Tactic: 0x000000000000001f Time: 0.0163053 TRT - VERBOSE Fastest Tactic: 0x000000000000001f Time: 0.0163053 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f TRT - VERBOSE *************** Autotuning format combination: Float(E1,1:4,E0,2,1) -> Float(E1,1:4,E0,2,1) where E0=(* 2 (# 3 (SHAPE input))) E1=(* (# 2 (SHAPE input)) E0) *************** TRT - VERBOSE --------------- Timing Runner: PWN(Clip_793) (PointWiseV2) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 0.310011 TRT - VERBOSE Tactic: 0x0000000000000001 Time: 0.370699 TRT - VERBOSE Tactic: 0x0000000000000002 Time: 0.466197 TRT - VERBOSE Tactic: 0x0000000000000003 Time: 0.513877 TRT - VERBOSE Tactic: 0x0000000000000004 Time: 0.476459 TRT - VERBOSE Tactic: 0x0000000000000005 Time: 0.370005 TRT - VERBOSE Tactic: 0x0000000000000006 Time: 0.9216 TRT - VERBOSE Tactic: 0x0000000000000007 Time: 0.642389 TRT - VERBOSE Tactic: 0x0000000000000008 Time: 0.529749 TRT - VERBOSE Tactic: 0x0000000000000009 Time: 0.478251 TRT - VERBOSE Tactic: 0x000000000000000a Time: 0.298229 TRT - VERBOSE Tactic: 0x000000000000000b Time: 0.325872 TRT - VERBOSE Tactic: 0x000000000000000c Time: 0.327344 TRT - VERBOSE Tactic: 0x000000000000000d Time: 0.413056 TRT - VERBOSE Tactic: 0x000000000000000e Time: 0.429397 TRT - VERBOSE Tactic: 0x000000000000000f Time: 0.331013 TRT - VERBOSE Tactic: 0x0000000000000010 Time: 0.608064 TRT - VERBOSE Tactic: 0x0000000000000011 Time: 0.564811 TRT - VERBOSE Tactic: 0x0000000000000012 Time: 0.450187 TRT - VERBOSE Tactic: 0x0000000000000013 Time: 0.364491 TRT - VERBOSE Tactic: 0x0000000000000014 Time: 0.270181 TRT - VERBOSE Tactic: 0x0000000000000015 Time: 0.316731 TRT - VERBOSE Tactic: 0x0000000000000016 Time: 0.392427 TRT - VERBOSE Tactic: 0x0000000000000017 Time: 0.558208 TRT - VERBOSE Tactic: 0x000000000000001c Time: 0.0532434 TRT - VERBOSE Tactic: 0x000000000000001d Time: 0.0539794 TRT - VERBOSE Tactic: 0x000000000000001e Time: 0.0548937 TRT - VERBOSE Fastest Tactic: 0x000000000000001c Time: 0.0532434 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c TRT - VERBOSE =============== Computing costs for TRT - VERBOSE *************** Autotuning format combination: Int32(1), Int32(), Float((* 128 E1),E1,E0,1), Int32(1), Int32(1), Int32(1), Int32(1), Int32(1), Int32(1), Float(E3,E3,E2,2,1), Float(E4,E4,(# 3 (SHAPE input)),1), Int32(1), Int32(1), Int32(1), Int32(), Int32(), Int32(), Int32() -> Float(1,1), Float(1024000,128,1), Float(16000,2,1) where E0=(+ (CEIL_DIV (+ (# 3 (SHAPE input)) -4) 4) 1) E1=(* (+ (CEIL_DIV (+ (# 2 (SHAPE input)) -4) 4) 1) E0) E2=(* 2 (# 3 (SHAPE input))) E3=(* (# 2 (SHAPE input)) E2) E4=(* (# 2 (SHAPE input)) (# 3 (SHAPE input))) *************** TRT - VERBOSE --------------- Timing Runner: {ForeignNode[(Unnamed Layer* 1129) [Constant] + (Unnamed Layer* 1131) [Shuffle]...Gather_1010]} (Myelin) TRT - WARNING Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: TRT - WARNING (# 2 (SHAPE input)) TRT - WARNING (# 3 (SHAPE input)) TRT - VERBOSE Tactic: 0x0000000000000000 Time: 16.1186 TRT - VERBOSE Fastest Tactic: 0x0000000000000000 Time: 16.1186 TRT - VERBOSE >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 TRT - VERBOSE Formats and tactics selection completed in 66.0292 seconds. TRT - VERBOSE After reformat layers: 66 layers TRT - VERBOSE Pre-optimized block assignment. TRT - VERBOSE Block size 59584512 TRT - VERBOSE Block size 59584512 TRT - VERBOSE Block size 59584512 TRT - VERBOSE Block size 29792256 TRT - VERBOSE Block size 29792256 TRT - VERBOSE Block size 29792256 TRT - VERBOSE Block size 14936064 TRT - VERBOSE Block size 14936064 TRT - VERBOSE Block size 14936064 TRT - VERBOSE Block size 14936064 TRT - VERBOSE Block size 14936064 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 59584512 TRT - VERBOSE Block size 4 TRT - VERBOSE Block size 60641280 TRT - VERBOSE Block size 59584512 TRT - VERBOSE Block size 4 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 59584512 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 29792256 TRT - VERBOSE Block size 4 TRT - VERBOSE Block size 30497792 TRT - VERBOSE Block size 29792256 TRT - VERBOSE Block size 4 TRT - VERBOSE Block size 465920 TRT - VERBOSE Block size 29792256 TRT - VERBOSE Block size 465920 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 14936064 TRT - VERBOSE Block size 4 TRT - VERBOSE Block size 15289344 TRT - VERBOSE Block size 14936064 TRT - VERBOSE Block size 4 TRT - VERBOSE Block size 116736 TRT - VERBOSE Block size 14936064 TRT - VERBOSE Block size 116736 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1807872 TRT - VERBOSE Block size 4 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1895424 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 12288 TRT - VERBOSE Block size 12288 TRT - VERBOSE Block size 12288 TRT - VERBOSE Block size 12288 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 12288 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 12288 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 3724288 TRT - VERBOSE Block size 3724288 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 1073741824 TRT - VERBOSE Total Activation Memory: 1881835548 TRT - INFO Detected 1 inputs and 3 output network tensors. TRT - VERBOSE Conv_6 + Relu_7 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f TRT - VERBOSE Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Conv_15 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Conv_20 + Relu_21 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a TRT - VERBOSE Conv_22 + Relu_23 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Conv_26 + Relu_27 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - VERBOSE Conv_28 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 TRT - WARNING Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: TRT - WARNING (# 2 (SHAPE input)) TRT - WARNING (# 3 (SHAPE input)) TRT - WARNING Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: TRT - WARNING (# 2 (SHAPE input)) TRT - WARNING (# 3 (SHAPE input)) TRT - WARNING Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: TRT - WARNING (# 2 (SHAPE input)) TRT - WARNING (# 3 (SHAPE input)) TRT - VERBOSE Layer: [HostToDeviceCopy] Host Persistent: 76 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: (Unnamed Layer* 33) [Constant] + (Unnamed Layer* 34) [Shuffle] Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: ConstantOfShape_39 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_6 + Relu_7 Host Persistent: 1664 Device Persistent: 2793472 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_8 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 102912 TRT - VERBOSE Layer: BatchNormalization_11 + Relu_12 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_13 + Relu_14 Host Persistent: 4224 Device Persistent: 698368 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_15 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: BatchNormalization_18 + Relu_19 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_20 + Relu_21 Host Persistent: 4224 Device Persistent: 175104 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_22 + Relu_23 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_24 + Relu_25 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_26 + Relu_27 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_28 Host Persistent: 512 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: ReduceMean_231 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Reshape_205 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Pad_219 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_220 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Reshape_230 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236)) Host Persistent: 476 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: ReduceMax_237 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Resize_250 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: ReduceMean_160 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Reshape_134 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Pad_148 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_149 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Reshape_159 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165)) Host Persistent: 476 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: ReduceMax_166 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Resize_179 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: ReduceMean_89 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Reshape_62 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Pad_76 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_78 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Reshape_88 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94)) Host Persistent: 476 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: ReduceMax_95 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Resize_108 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253)) Host Persistent: 532 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: MaxPool_262 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Pad_313 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_315 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_317 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Conv_319 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: (Unnamed Layer* 214) [Constant] + (Unnamed Layer* 215) [Shuffle] Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: ConstantOfShape_277 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Cast_278 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Pad_293 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: {ForeignNode[464 + (Unnamed Layer* 268) [Shuffle]...Where_344]} Host Persistent: 48 Device Persistent: 0 Scratch Memory: 13034112 TRT - VERBOSE Layer: Conv_751 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 2794496 TRT - VERBOSE Layer: Conv_752 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 2794496 TRT - VERBOSE Layer: Conv_753 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 2794496 TRT - VERBOSE Layer: Conv_755 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 2794496 TRT - VERBOSE Layer: Conv_757 Host Persistent: 32 Device Persistent: 0 Scratch Memory: 2794496 TRT - VERBOSE Layer: {ForeignNode[920 + (Unnamed Layer* 830) [Shuffle]...Concat_792]} Host Persistent: 48 Device Persistent: 0 Scratch Memory: 16758144 TRT - VERBOSE Layer: Range_382 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Range_513 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Range_646 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Range_433 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Range_564 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: Range_697 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: PWN(Clip_793) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 TRT - VERBOSE Layer: {ForeignNode[(Unnamed Layer* 1129) [Constant] + (Unnamed Layer* 1131) [Shuffle]...Gather_1010]} Host Persistent: 48 Device Persistent: 0 Scratch Memory: 27410816 TRT - INFO Total Host Persistent Memory: 16288 TRT - INFO Total Device Persistent Memory: 3666944 TRT - INFO Total Scratch Memory: 27410816 TRT - INFO [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 1 MiB, GPU 1935 MiB TRT - INFO [BlockAssignment] Algorithm ShiftNTopDown took 26.2777ms to assign 18 blocks to 84 nodes requiring 245077504 bytes. TRT - VERBOSE Optimized block assignment. TRT - VERBOSE Block size 59584512 TRT - VERBOSE Block size 59584512 TRT - VERBOSE Block size 60641280 TRT - VERBOSE Block size 29792256 TRT - VERBOSE Block size 14936064 TRT - VERBOSE Block size 14936064 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 1862144 TRT - VERBOSE Block size 12288 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - VERBOSE Block size 512 TRT - INFO Total Activation Memory: 245077504 TRT - VERBOSE Disabling unused tactic source: CUBLAS, CUBLAS_LT TRT - VERBOSE Using cuDNN as a tactic source TRT - INFO [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 9215, GPU 1591 (MiB) TRT - WARNING TensorRT was linked against cuDNN 8.4.1 but loaded cuDNN 8.0.4 TRT - VERBOSE Engine generation completed in 66.1885 seconds. TRT - VERBOSE Deleting timing cache: 264 entries, served 290 hits since creation. TRT - VERBOSE Engine Layer Information: Layer(ShapeHostToDevice): [HostToDeviceCopy], Tactic: 0x0000000000000000, -> 1144[Int32(1)], (Unnamed Layer* 970) [Shuffle]_output[Int32(1)], (Unnamed Layer* 950) [Shuffle]_output[Int32(1)], (Unnamed Layer* 729) [Shuffle]_output[Int32(1)], 774[Int32()], 823[Int32(4)], 1039[Int32()], 1023[Int32()], 991[Int32(4)], 350[implicit padding 9][Int32()], 80[implicit padding 10][Int32()], 80[implicit padding 11][Int32()], (Unnamed Layer* 285) [Shuffle]_output'[implicit padding 12][Int32()] Layer(Constant): (Unnamed Layer* 33) [Constant] + (Unnamed Layer* 34) [Shuffle], Tactic: 0x0000000000000000, -> (Unnamed Layer* 34) [Shuffle]_output[Float(1,1,1,1)] Layer(Slice): ConstantOfShape_39, Tactic: 0x0000000000000000, (Unnamed Layer* 34) [Shuffle]_output[Float(1,1,1,1)] -> 94[Float(1,1,-19,-20)] Layer(CaskConvolution): Conv_6 + Relu_7, Tactic: 0xc939b7b0a4d5a05f, input[Float(1,3,-19,-20)] -> 44[Float(1,32,-19,-20)] Layer(CudnnConvolution): Conv_8, Tactic: 0x000000000000003e, 44[Float(1,32,-19,-20)] -> 45[Float(1,32,-19,-20)] Layer(Scale): BatchNormalization_11 + Relu_12, Tactic: 0x0000000000000000, 45[Float(1,32,-19,-20)] -> 49[Float(1,32,-19,-20)] Layer(CaskConvolution): Conv_13 + Relu_14, Tactic: 0x27728c886a448c5a, 49[Float(1,32,-19,-20)] -> 54[Float(1,64,-29,-32)] Layer(CaskConvolution): Conv_15, Tactic: 0x268494f0a1c83de3, 54[Float(1,64,-29,-32)] -> 55[Float(1,64,-29,-32)] Layer(Scale): BatchNormalization_18 + Relu_19, Tactic: 0x0000000000000000, 55[Float(1,64,-29,-32)] -> 59[Float(1,64,-29,-32)] Layer(CaskConvolution): Conv_20 + Relu_21, Tactic: 0x27728c886a448c5a, 59[Float(1,64,-29,-32)] -> 64[Float(1,128,-43,-44)] Layer(CaskConvolution): Conv_22 + Relu_23, Tactic: 0x268494f0a1c83de3, 64[Float(1,128,-43,-44)] -> 69[Float(1,128,-43,-44)] Layer(CaskConvolution): Conv_24 + Relu_25, Tactic: 0x268494f0a1c83de3, 69[Float(1,128,-43,-44)] -> 74[Float(1,128,-43,-44)] Layer(CaskConvolution): Conv_26 + Relu_27, Tactic: 0x268494f0a1c83de3, 74[Float(1,128,-43,-44)] -> 79[Float(1,128,-43,-44)] Layer(CaskConvolution): Conv_28, Tactic: 0x268494f0a1c83de3, 79[Float(1,128,-43,-44)] -> 80[Float(1,128,-43,-44)] Layer(PointWiseV2): PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184), Tactic: 0x0000000000000002, 80[Float(1,128,-43,-44)] -> 267[Float(1,128,-43,-44)] Layer(Reduce): ReduceMean_231, Tactic: 0x0000000000000005, 267[Float(1,128,-43,-44)] -> 326[Float(1,1,-43,-44)] Layer(NoOp): Reshape_205, Tactic: 0x0000000000000000, 267[Float(1,128,-43,-44)] -> 291[Float(128,1,-43,-44)] Layer(Slice): Pad_219, Tactic: 0x0000000000000000, 291[Float(128,1,-43,-44)] -> 314[Float(128,1,-40,-41)] Layer(CudnnConvolution): Conv_220, Tactic: 0x0000000000000038, 314[Float(128,1,-40,-41)] -> 315[Float(128,1,-43,-44)] Layer(NoOp): Reshape_230, Tactic: 0x0000000000000000, 315[Float(128,1,-43,-44)] -> 325[Float(1,128,-43,-44)] Layer(PointWiseV2): PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236)), Tactic: 0x000000000000001c, 267[Float(1,128,-43,-44)], 325[Float(1,128,-43,-44)], 326[Float(1,1,-43,-44)] -> 331[Float(1,128,-43,-44)] Layer(Reduce): ReduceMax_237, Tactic: 0x0000000000000005, 331[Float(1,128,-43,-44)] -> 332[Float(1,1,-43,-44)] Layer(Resize): Resize_250, Tactic: 0x0000000000000001, 332[Float(1,1,-43,-44)] -> 347[Float(1,1,-19,-20)] Layer(PointWiseV2): PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113), Tactic: 0x0000000000000002, 55[Float(1,64,-29,-32)] -> 182[Float(1,64,-29,-32)] Layer(Reduce): ReduceMean_160, Tactic: 0x0000000000000005, 182[Float(1,64,-29,-32)] -> 241[Float(1,1,-29,-32)] Layer(NoOp): Reshape_134, Tactic: 0x0000000000000000, 182[Float(1,64,-29,-32)] -> 206[Float(64,1,-29,-32)] Layer(Slice): Pad_148, Tactic: 0x0000000000000000, 206[Float(64,1,-29,-32)] -> 229[Float(64,1,-34,-47)] Layer(CudnnConvolution): Conv_149, Tactic: 0x000000000000003a, 229[Float(64,1,-34,-47)] -> 230[Float(64,1,-29,-32)] Layer(NoOp): Reshape_159, Tactic: 0x0000000000000000, 230[Float(64,1,-29,-32)] -> 240[Float(1,64,-29,-32)] Layer(PointWiseV2): PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165)), Tactic: 0x000000000000001c, 182[Float(1,64,-29,-32)], 240[Float(1,64,-29,-32)], 241[Float(1,1,-29,-32)] -> 246[Float(1,64,-29,-32)] Layer(Reduce): ReduceMax_166, Tactic: 0x0000000000000005, 246[Float(1,64,-29,-32)] -> 247[Float(1,1,-29,-32)] Layer(Resize): Resize_179, Tactic: 0x0000000000000001, 247[Float(1,1,-29,-32)] -> 262[Float(1,1,-19,-20)] Layer(PointWiseV2): PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41), Tactic: 0x0000000000000002, 45[Float(1,32,-19,-20)] -> 96[Float(1,32,-19,-20)] Layer(Reduce): ReduceMean_89, Tactic: 0x0000000000000005, 96[Float(1,32,-19,-20)] -> 156[Float(1,1,-19,-20)] Layer(NoOp): Reshape_62, Tactic: 0x0000000000000000, 96[Float(1,32,-19,-20)] -> 120[Float(32,1,-19,-20)] Layer(Slice): Pad_76, Tactic: 0x0000000000000000, 120[Float(32,1,-19,-20)] -> 143[Float(32,1,-21,-22)] Layer(CudnnConvolution): Conv_78, Tactic: 0x000000000000003a, 143[Float(32,1,-21,-22)] -> 145[Float(32,1,-19,-20)] Layer(NoOp): Reshape_88, Tactic: 0x0000000000000000, 145[Float(32,1,-19,-20)] -> 155[Float(1,32,-19,-20)] Layer(PointWiseV2): PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94)), Tactic: 0x0000000000000006, 96[Float(1,32,-19,-20)], 155[Float(1,32,-19,-20)], 156[Float(1,1,-19,-20)] -> 161[Float(1,32,-19,-20)] Layer(Reduce): ReduceMax_95, Tactic: 0x0000000000000005, 161[Float(1,32,-19,-20)] -> 162[Float(1,1,-19,-20)] Layer(Resize): Resize_108, Tactic: 0x0000000000000001, 162[Float(1,1,-19,-20)] -> 177[Float(1,1,-19,-20)] Layer(PointWiseV2): PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253)), Tactic: 0x0000000000000003, 177[Float(1,1,-19,-20)], 94[Float(1,1,-19,-20)], 262[Float(1,1,-19,-20)], 347[Float(1,1,-19,-20)] -> 350[Float(1,1,-19,-20)] Layer(TiledPooling): MaxPool_262, Tactic: 0x0000000000640101, 350[Float(1,1,-19,-20)] -> 359[Float(1,1,-19,-20)] Layer(Padding): Pad_313, Tactic: 0x0000000000000000, 350[Float(1,1,-19,-20)] -> 434[Float(1,1,-21,-22)] Layer(CudnnConvolution): Conv_315, Tactic: 0x0000000000000038, 434[Float(1,1,-21,-22)] -> 436[Float(1,1,-19,-20)] Layer(CudnnConvolution): Conv_317, Tactic: 0x0000000000000038, 434[Float(1,1,-21,-22)] -> 438[Float(1,1,-19,-20)] Layer(CudnnConvolution): Conv_319, Tactic: 0x0000000000000038, 434[Float(1,1,-21,-22)] -> 440[Float(1,1,-19,-20)] Layer(Constant): (Unnamed Layer* 214) [Constant] + (Unnamed Layer* 215) [Shuffle], Tactic: 0x0000000000000000, -> (Unnamed Layer* 215) [Shuffle]_output[Float(1,1,1,1)] Layer(Slice): ConstantOfShape_277, Tactic: 0x0000000000000000, (Unnamed Layer* 215) [Shuffle]_output[Float(1,1,1,1)] -> 380[Float(1,1,-49,-50)] Layer(NoOp): Cast_278, Tactic: 0x0000000000000000, 380[Float(1,1,-49,-50)] -> 381[Float(1,1,-49,-50)] Layer(Slice): Pad_293, Tactic: 0x0000000000000000, 381[Float(1,1,-49,-50)] -> 405[Float(1,1,-19,-20)] Layer(Myelin): {ForeignNode[464 + (Unnamed Layer* 268) [Shuffle]...Where_344]}, Tactic: 0x0000000000000000, 350[Float(1,1,-19,-20)], 359[Float(1,1,-19,-20)], 438[Float(1,1,-19,-20)], 436[Float(1,1,-19,-20)], 440[Float(1,1,-19,-20)], 405[Float(1,1,-19,-20)], 350[implicit padding 9][Int32()], 774[Int32()] -> 465[Float(1,1,-19,-20)] Layer(CudnnConvolution): Conv_751, Tactic: 0x0000000000000001, 465[Float(1,1,-19,-20)] -> 893[Float(1,1,-19,-20)] Layer(CudnnConvolution): Conv_752, Tactic: 0x0000000000000001, 465[Float(1,1,-19,-20)] -> 894[Float(1,1,-19,-20)] Layer(CudnnConvolution): Conv_753, Tactic: 0x0000000000000001, 465[Float(1,1,-19,-20)] -> 895[Float(1,1,-19,-20)] Layer(CudnnConvolution): Conv_755, Tactic: 0x0000000000000001, 465[Float(1,1,-19,-20)] -> 897[Float(1,1,-19,-20)] Layer(CudnnConvolution): Conv_757, Tactic: 0x0000000000000001, 465[Float(1,1,-19,-20)] -> 899[Float(1,1,-19,-20)] Layer(Myelin): {ForeignNode[920 + (Unnamed Layer* 830) [Shuffle]...Concat_792]}, Tactic: 0x0000000000000000, 894[Float(1,1,-19,-20)], 893[Float(1,1,-19,-20)], 895[Float(1,1,-19,-20)], 897[Float(1,1,-19,-20)], 899[Float(1,1,-19,-20)], 350[implicit padding 9][Int32()], 774[Int32()] -> 934[Float(1,1,-19,-20,2)] Layer(Fill): Range_382, Tactic: 0x0000000000000000, -> 510[Int32(3000)] Layer(Fill): Range_513, Tactic: 0x0000000000000000, -> 648[Int32(3000)] Layer(Fill): Range_646, Tactic: 0x0000000000000000, -> 788[Int32(3000)] Layer(Fill): Range_433, Tactic: 0x0000000000000000, -> 561[Int32(3000)] Layer(Fill): Range_564, Tactic: 0x0000000000000000, -> 699[Int32(3000)] Layer(Fill): Range_697, Tactic: 0x0000000000000000, -> 839[Int32(3000)] Layer(PointWiseV2): PWN(Clip_793), Tactic: 0x0000000000000009, 934[Float(1,1,-19,-20,2)] -> 939[Float(1,1,-19,-20,2)] Layer(Myelin): {ForeignNode[(Unnamed Layer* 1129) [Constant] + (Unnamed Layer* 1131) [Shuffle]...Gather_1010]}, Tactic: 0x0000000000000000, (Unnamed Layer* 729) [Shuffle]_output[Int32(1)], 774[Int32()], 80[Float(1,128,-43,-44)], 510[Int32(3000)], 648[Int32(3000)], 788[Int32(3000)], 561[Int32(3000)], 699[Int32(3000)], 839[Int32(3000)], 939[Float(1,1,-19,-20,2)], 465[Float(1,1,-19,-20)], (Unnamed Layer* 950) [Shuffle]_output[Int32(1)], 1144[Int32(1)], (Unnamed Layer* 970) [Shuffle]_output[Int32(1)], 80[implicit padding 10][Int32()], 80[implicit padding 11][Int32()], 350[implicit padding 9][Int32()], 774[Int32()] -> scores[Float(8000,1)], descs[Float(1,8000,128)], kpts[Float(1,8000,2)] TRT - INFO [MemUsageChange] TensorRT-managed allocation in building engine: CPU +0, GPU +8, now: CPU 0, GPU 8 (MiB) TRT engine - 245077504 Bytes TRT engine number of layers - 66 TRT engine number of bindings - 4 TRT engine number of profils - 1 {"Layers": [{ "Name": "[HostToDeviceCopy]", "LayerType": "ShapeHostToDevice", "Inputs": [], "Outputs": [ { "Name": "1144", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 970) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 950) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 729) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "774", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "823", "Location": "Device", "Dimensions": [4], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "1039", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "1023", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "991", "Location": "Device", "Dimensions": [4], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "350[implicit padding 9]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "80[implicit padding 10]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "80[implicit padding 11]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 285) [Shuffle]_output'[implicit padding 12]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "ShapeH2D", "shapeValues0": [-44], "shapeValues1": [-37], "shapeValues2": [-39], "shapeValues3": [-20], "shapeValues4": [-20], "shapeValues5": [1, 1, -19, -20], "shapeValues6": [-37], "shapeValues7": [-39], "shapeValues8": [1, 128, -43, -44], "shapeValues9": [-19], "shapeValues10": [-43], "shapeValues11": [-44], "shapeValues12": [-24], "TacticValue": "0x0000000000000000" },{ "Name": "(Unnamed Layer* 33) [Constant] + (Unnamed Layer* 34) [Shuffle]", "LayerType": "Constant", "Inputs": [], "Outputs": [ { "Name": "(Unnamed Layer* 34) [Shuffle]_output", "Location": "Device", "Dimensions": [1,1,1,1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Constant", "weights": {"Type": "Float", "Count": 1}, "dimensions": [1,1,1,1], "TacticValue": "0x0000000000000000" },{ "Name": "ConstantOfShape_39", "LayerType": "Slice", "Inputs": [ { "Name": "(Unnamed Layer* 34) [Shuffle]_output", "Location": "Device", "Dimensions": [1,1,1,1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "94", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,0,0], "Size": [1,1,-19,-20], "Stride": [0,0,0,0], "Mode": "DEFAULT", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_6 + Relu_7", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "input", "Location": "Device", "Dimensions": [1,3,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "44", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 32, "Groups": 1, "Weights": {"Type": "Float", "Count": 864}, "Bias": {"Type": "Float", "Count": 32}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_128x32_relu_small_nn_v1", "TacticValue": "0xc939b7b0a4d5a05f" },{ "Name": "Conv_8", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "44", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "45", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 32, "Groups": 1, "Weights": {"Type": "Float", "Count": 9216}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x000000000000003e" },{ "Name": "BatchNormalization_11 + Relu_12", "LayerType": "Scale", "Inputs": [ { "Name": "45", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "49", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Scale", "Mode": "CHANNEL", "Shift": {"Type": "Float", "Count": 32}, "Scale": {"Type": "Float", "Count": 32}, "Power": {"Type": "Float", "Count": 0}, "Activation": "RELU", "ChannelAxis": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_13 + Relu_14", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "49", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "54", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [2,2], "Dilation": [1,1], "OutMaps": 64, "Groups": 1, "Weights": {"Type": "Float", "Count": 18432}, "Bias": {"Type": "Float", "Count": 64}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_128x64_relu_xregs_large_nn_v1", "TacticValue": "0x27728c886a448c5a" },{ "Name": "Conv_15", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "54", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "55", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 64, "Groups": 1, "Weights": {"Type": "Float", "Count": 36864}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "HasReLU": 0, "TacticName": "volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1", "TacticValue": "0x268494f0a1c83de3" },{ "Name": "BatchNormalization_18 + Relu_19", "LayerType": "Scale", "Inputs": [ { "Name": "55", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "59", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Scale", "Mode": "CHANNEL", "Shift": {"Type": "Float", "Count": 64}, "Scale": {"Type": "Float", "Count": 64}, "Power": {"Type": "Float", "Count": 0}, "Activation": "RELU", "ChannelAxis": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_20 + Relu_21", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "59", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "64", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [2,2], "Dilation": [1,1], "OutMaps": 128, "Groups": 1, "Weights": {"Type": "Float", "Count": 73728}, "Bias": {"Type": "Float", "Count": 128}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_128x64_relu_xregs_large_nn_v1", "TacticValue": "0x27728c886a448c5a" },{ "Name": "Conv_22 + Relu_23", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "64", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "69", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 128, "Groups": 1, "Weights": {"Type": "Float", "Count": 147456}, "Bias": {"Type": "Float", "Count": 128}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1", "TacticValue": "0x268494f0a1c83de3" },{ "Name": "Conv_24 + Relu_25", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "69", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "74", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 128, "Groups": 1, "Weights": {"Type": "Float", "Count": 147456}, "Bias": {"Type": "Float", "Count": 128}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1", "TacticValue": "0x268494f0a1c83de3" },{ "Name": "Conv_26 + Relu_27", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "74", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "79", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 128, "Groups": 1, "Weights": {"Type": "Float", "Count": 147456}, "Bias": {"Type": "Float", "Count": 128}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1", "TacticValue": "0x268494f0a1c83de3" },{ "Name": "Conv_28", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "79", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "80", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 128, "Groups": 1, "Weights": {"Type": "Float", "Count": 147456}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "HasReLU": 0, "TacticName": "volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1", "TacticValue": "0x268494f0a1c83de3" },{ "Name": "PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184)", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "80", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "267", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 1, "InputArgs": ["arg0"], "NbOutputVars": 1, "OutputVars": ["var0"], "NbParams": 0, "Params": [], "NbLiterals": 1, "Literals": ["1.000000e+00f"], "NbOperations": 1, "Operations": ["const auto var0 = pwgen::iDiv(arg0, literal0);"], "TacticValue": "0x0000000000000002" },{ "Name": "ReduceMean_231", "LayerType": "Reduce", "Inputs": [ { "Name": "267", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "326", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "AVG", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Reshape_205", "LayerType": "NoOp", "Inputs": [ { "Name": "267", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "291", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Pad_219", "LayerType": "Slice", "Inputs": [ { "Name": "291", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "314", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,-1,-1], "Size": [128,1,-40,-41], "Stride": [1,1,1,1], "Mode": "REFLECT", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_220", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "314", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "315", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000038" },{ "Name": "Reshape_230", "LayerType": "NoOp", "Inputs": [ { "Name": "315", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "325", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236))", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "267", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "325", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "326", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "331", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 3, "InputArgs": ["arg0", "arg1", "arg2"], "NbOutputVars": 1, "OutputVars": ["var16"], "NbParams": 0, "Params": [], "NbLiterals": 10, "Literals": ["0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f", "0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f"], "NbOperations": 17, "Operations": ["const auto var0 = pwgen::iMinus(arg0, arg1);", "const auto var1 = pwgen::iMul(literal3, var0);", "const auto var2 = pwgen::iExp(var1);", "const auto var3 = pwgen::iPlus(literal1, var2);", "const auto var4 = pwgen::iLog(var3);", "const auto var5 = pwgen::iMul(var4, literal2);", "const auto var6 = pwgen::iLessOrEqual(var0, literal4);", "const auto var7 = pwgen::iSelect(var6, var5, var0);", "const auto var8 = pwgen::iMinus(arg0, arg2);", "const auto var9 = pwgen::iMul(literal8, var8);", "const auto var10 = pwgen::iExp(var9);", "const auto var11 = pwgen::iPlus(literal6, var10);", "const auto var12 = pwgen::iLog(var11);", "const auto var13 = pwgen::iMul(var12, literal7);", "const auto var14 = pwgen::iLessOrEqual(var8, literal9);", "const auto var15 = pwgen::iSelect(var14, var13, var8);", "const auto var16 = pwgen::iMul(var7, var15);"], "TacticValue": "0x000000000000001c" },{ "Name": "ReduceMax_237", "LayerType": "Reduce", "Inputs": [ { "Name": "331", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "332", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "MAX", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Resize_250", "LayerType": "Resize", "Inputs": [ { "Name": "332", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "347", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Resize", "ResizeMode": "LINEAR", "ResizeScales": [0, 0, 0, 0, 0, 0, 0, 0], "CoordTransform": "kHALF_PIXEL", "ResizeSelector": "kUPPER", "NNRounding": "kFLOOR", "TacticValue": "0x0000000000000001" },{ "Name": "PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113)", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "55", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "182", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 1, "InputArgs": ["arg0"], "NbOutputVars": 1, "OutputVars": ["var0"], "NbParams": 0, "Params": [], "NbLiterals": 1, "Literals": ["1.000000e+00f"], "NbOperations": 1, "Operations": ["const auto var0 = pwgen::iDiv(arg0, literal0);"], "TacticValue": "0x0000000000000002" },{ "Name": "ReduceMean_160", "LayerType": "Reduce", "Inputs": [ { "Name": "182", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "241", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "AVG", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Reshape_134", "LayerType": "NoOp", "Inputs": [ { "Name": "182", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "206", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Pad_148", "LayerType": "Slice", "Inputs": [ { "Name": "206", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "229", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,-6,-6], "Size": [64,1,-34,-47], "Stride": [1,1,1,1], "Mode": "REFLECT", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_149", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "229", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "230", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [2,2], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x000000000000003a" },{ "Name": "Reshape_159", "LayerType": "NoOp", "Inputs": [ { "Name": "230", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "240", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165))", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "182", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "240", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "241", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "246", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 3, "InputArgs": ["arg0", "arg1", "arg2"], "NbOutputVars": 1, "OutputVars": ["var16"], "NbParams": 0, "Params": [], "NbLiterals": 10, "Literals": ["0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f", "0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f"], "NbOperations": 17, "Operations": ["const auto var0 = pwgen::iMinus(arg0, arg1);", "const auto var1 = pwgen::iMul(literal3, var0);", "const auto var2 = pwgen::iExp(var1);", "const auto var3 = pwgen::iPlus(literal1, var2);", "const auto var4 = pwgen::iLog(var3);", "const auto var5 = pwgen::iMul(var4, literal2);", "const auto var6 = pwgen::iLessOrEqual(var0, literal4);", "const auto var7 = pwgen::iSelect(var6, var5, var0);", "const auto var8 = pwgen::iMinus(arg0, arg2);", "const auto var9 = pwgen::iMul(literal8, var8);", "const auto var10 = pwgen::iExp(var9);", "const auto var11 = pwgen::iPlus(literal6, var10);", "const auto var12 = pwgen::iLog(var11);", "const auto var13 = pwgen::iMul(var12, literal7);", "const auto var14 = pwgen::iLessOrEqual(var8, literal9);", "const auto var15 = pwgen::iSelect(var14, var13, var8);", "const auto var16 = pwgen::iMul(var7, var15);"], "TacticValue": "0x000000000000001c" },{ "Name": "ReduceMax_166", "LayerType": "Reduce", "Inputs": [ { "Name": "246", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "247", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "MAX", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Resize_179", "LayerType": "Resize", "Inputs": [ { "Name": "247", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "262", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Resize", "ResizeMode": "LINEAR", "ResizeScales": [0, 0, 0, 0, 0, 0, 0, 0], "CoordTransform": "kHALF_PIXEL", "ResizeSelector": "kUPPER", "NNRounding": "kFLOOR", "TacticValue": "0x0000000000000001" },{ "Name": "PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41)", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "45", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "96", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 1, "InputArgs": ["arg0"], "NbOutputVars": 1, "OutputVars": ["var0"], "NbParams": 0, "Params": [], "NbLiterals": 1, "Literals": ["1.000000e+00f"], "NbOperations": 1, "Operations": ["const auto var0 = pwgen::iDiv(arg0, literal0);"], "TacticValue": "0x0000000000000002" },{ "Name": "ReduceMean_89", "LayerType": "Reduce", "Inputs": [ { "Name": "96", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "156", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "AVG", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Reshape_62", "LayerType": "NoOp", "Inputs": [ { "Name": "96", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "120", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Pad_76", "LayerType": "Slice", "Inputs": [ { "Name": "120", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "143", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,-5,-5], "Size": [32,1,-21,-22], "Stride": [1,1,1,1], "Mode": "REFLECT", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_78", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "143", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "145", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [3,3], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x000000000000003a" },{ "Name": "Reshape_88", "LayerType": "NoOp", "Inputs": [ { "Name": "145", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "155", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94))", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "96", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "155", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "156", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "161", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 3, "InputArgs": ["arg0", "arg1", "arg2"], "NbOutputVars": 1, "OutputVars": ["var16"], "NbParams": 0, "Params": [], "NbLiterals": 10, "Literals": ["0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f", "0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f"], "NbOperations": 17, "Operations": ["const auto var0 = pwgen::iMinus(arg0, arg1);", "const auto var1 = pwgen::iMul(literal3, var0);", "const auto var2 = pwgen::iExp(var1);", "const auto var3 = pwgen::iPlus(literal1, var2);", "const auto var4 = pwgen::iLog(var3);", "const auto var5 = pwgen::iMul(var4, literal2);", "const auto var6 = pwgen::iLessOrEqual(var0, literal4);", "const auto var7 = pwgen::iSelect(var6, var5, var0);", "const auto var8 = pwgen::iMinus(arg0, arg2);", "const auto var9 = pwgen::iMul(literal8, var8);", "const auto var10 = pwgen::iExp(var9);", "const auto var11 = pwgen::iPlus(literal6, var10);", "const auto var12 = pwgen::iLog(var11);", "const auto var13 = pwgen::iMul(var12, literal7);", "const auto var14 = pwgen::iLessOrEqual(var8, literal9);", "const auto var15 = pwgen::iSelect(var14, var13, var8);", "const auto var16 = pwgen::iMul(var7, var15);"], "TacticValue": "0x0000000000000006" },{ "Name": "ReduceMax_95", "LayerType": "Reduce", "Inputs": [ { "Name": "161", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "162", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "MAX", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Resize_108", "LayerType": "Resize", "Inputs": [ { "Name": "162", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "177", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Resize", "ResizeMode": "LINEAR", "ResizeScales": [0, 0, 0, 0, 0, 0, 0, 0], "CoordTransform": "kHALF_PIXEL", "ResizeSelector": "kUPPER", "NNRounding": "kFLOOR", "TacticValue": "0x0000000000000001" },{ "Name": "PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253))", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "177", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "94", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "262", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "347", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "350", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 4, "InputArgs": ["arg0", "arg1", "arg2", "arg3"], "NbOutputVars": 1, "OutputVars": ["var5"], "NbParams": 0, "Params": [], "NbLiterals": 6, "Literals": ["0.000000e+00f", "1.666667e-01f", "0.000000e+00f", "3.333333e-01f", "0.000000e+00f", "5.000000e-01f"], "NbOperations": 6, "Operations": ["const auto var0 = pwgen::iMul(arg0, literal1);", "const auto var1 = pwgen::iPlus(arg1, var0);", "const auto var2 = pwgen::iMul(arg2, literal3);", "const auto var3 = pwgen::iPlus(var1, var2);", "const auto var4 = pwgen::iMul(arg3, literal5);", "const auto var5 = pwgen::iPlus(var3, var4);"], "TacticValue": "0x0000000000000003" },{ "Name": "MaxPool_262", "LayerType": "TiledPooling", "Inputs": [ { "Name": "350", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "359", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Pooling", "PoolingType": "MAX", "WindowSize": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "BlendFactor": 0, "AverageCountExcludesPadding": 1, "TacticValue": "0x0000000000640101" },{ "Name": "Pad_313", "LayerType": "Padding", "Inputs": [ { "Name": "350", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "434", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,-5,-5], "Size": [1,1,-21,-22], "Stride": [1,1,1,1], "Mode": "FILL", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_315", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "434", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "436", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [3,3], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000038" },{ "Name": "Conv_317", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "434", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "438", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [3,3], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000038" },{ "Name": "Conv_319", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "434", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "440", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [3,3], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000038" },{ "Name": "(Unnamed Layer* 214) [Constant] + (Unnamed Layer* 215) [Shuffle]", "LayerType": "Constant", "Inputs": [], "Outputs": [ { "Name": "(Unnamed Layer* 215) [Shuffle]_output", "Location": "Device", "Dimensions": [1,1,1,1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Constant", "weights": {"Type": "Float", "Count": 1}, "dimensions": [1,1,1,1], "TacticValue": "0x0000000000000000" },{ "Name": "ConstantOfShape_277", "LayerType": "Slice", "Inputs": [ { "Name": "(Unnamed Layer* 215) [Shuffle]_output", "Location": "Device", "Dimensions": [1,1,1,1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "380", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,0,0], "Size": [1,1,-49,-50], "Stride": [0,0,0,0], "Mode": "DEFAULT", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Cast_278", "LayerType": "NoOp", "Inputs": [ { "Name": "380", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "381", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Pad_293", "LayerType": "Slice", "Inputs": [ { "Name": "381", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "405", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,-3,-3], "Size": [1,1,-19,-20], "Stride": [1,1,1,1], "Mode": "FILL", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "{ForeignNode[464 + (Unnamed Layer* 268) [Shuffle]...Where_344]}", "LayerType": "Myelin", "Inputs": [ { "Name": "350", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "359", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "438", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "436", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "440", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "405", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "350[implicit padding 9]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "774", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Conv_751", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "893", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000001" },{ "Name": "Conv_752", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "894", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000001" },{ "Name": "Conv_753", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "895", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000001" },{ "Name": "Conv_755", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "897", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000001" },{ "Name": "Conv_757", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "899", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000001" },{ "Name": "{ForeignNode[920 + (Unnamed Layer* 830) [Shuffle]...Concat_792]}", "LayerType": "Myelin", "Inputs": [ { "Name": "894", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "893", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "895", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "897", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "899", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "350[implicit padding 9]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "774", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "934", "Location": "Device", "Dimensions": [1,1,-1,-1,2], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Range_382", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "510", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Range_513", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "648", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Range_646", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "788", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Range_433", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "561", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Range_564", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "699", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Range_697", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "839", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "PWN(Clip_793)", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "934", "Location": "Device", "Dimensions": [1,1,-1,-1,2], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "939", "Location": "Device", "Dimensions": [1,1,-1,-1,2], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 1, "InputArgs": ["arg0"], "NbOutputVars": 1, "OutputVars": ["var1"], "NbParams": 0, "Params": [], "NbLiterals": 4, "Literals": ["0.000000e+00f", "1.000000e+00f", "-5.000000e-01f", "5.000000e-01f"], "NbOperations": 2, "Operations": ["const auto var0 = pwgen::iMin(literal3, arg0);", "const auto var1 = pwgen::iMax(literal2, var0);"], "TacticValue": "0x0000000000000009" },{ "Name": "{ForeignNode[(Unnamed Layer* 1129) [Constant] + (Unnamed Layer* 1131) [Shuffle]...Gather_1010]}", "LayerType": "Myelin", "Inputs": [ { "Name": "(Unnamed Layer* 729) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "774", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "80", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "510", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "648", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "788", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "561", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "699", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "839", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "939", "Location": "Device", "Dimensions": [1,1,-1,-1,2], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 950) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "1144", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 970) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "80[implicit padding 10]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "80[implicit padding 11]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "350[implicit padding 9]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "774", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "scores", "Location": "Device", "Dimensions": [8000,1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "descs", "Location": "Device", "Dimensions": [1,8000,128], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "kpts", "Location": "Device", "Dimensions": [1,8000,2], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" }], "Bindings": ["input" ,"scores" ,"descs" ,"kpts" ]} Completion model optimization =============================================================== Beginning Trt engine serialization TRT - WARNING The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1. TRT - WARNING The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1. Completion optimized model serialization TRT - VERBOSE Using cuDNN as a tactic source TRT - INFO [MemUsageChange] Init cuDNN: CPU -1, GPU +8, now: CPU 9214, GPU 1580 (MiB) TRT - WARNING TensorRT was linked against cuDNN 8.4.1 but loaded cuDNN 8.0.4 TRT - VERBOSE Total per-runner device persistent memory is 3666944 TRT - VERBOSE Total per-runner host persistent memory is 16288 TRT - VERBOSE Allocated activation device memory of size 245077504 TRT - INFO [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +237, now: CPU 0, GPU 245 (MiB) TensorRT analyzer initialization completion! DlewareAnalyzer Done! DlewareAnalyzer version - 1.1.9 =============================================================== Beginning Trt engine deserialization TRT - INFO Loaded engine size: 5 MiB TRT - VERBOSE Using cuDNN as a tactic source TRT - INFO [MemUsageChange] Init cuDNN: CPU -1, GPU +8, now: CPU 9232, GPU 1839 (MiB) TRT - WARNING TensorRT was linked against cuDNN 8.4.1 but loaded cuDNN 8.0.4 TRT - VERBOSE Deserialization required 8369 microseconds. TRT - INFO [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +8, now: CPU 0, GPU 253 (MiB) TRT engine - 245077504 Bytes TRT engine number of layers - 66 TRT engine number of bindings - 4 TRT engine number of profils - 1 {"Layers": [{ "Name": "[HostToDeviceCopy]", "LayerType": "ShapeHostToDevice", "Inputs": [], "Outputs": [ { "Name": "1144", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 970) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 950) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 729) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "774", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "823", "Location": "Device", "Dimensions": [4], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "1039", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "1023", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "991", "Location": "Device", "Dimensions": [4], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "350[implicit padding 9]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "80[implicit padding 10]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "80[implicit padding 11]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 285) [Shuffle]_output'[implicit padding 12]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "ShapeH2D", "shapeValues0": [-44], "shapeValues1": [-37], "shapeValues2": [-39], "shapeValues3": [-20], "shapeValues4": [-20], "shapeValues5": [1, 1, -19, -20], "shapeValues6": [-37], "shapeValues7": [-39], "shapeValues8": [1, 128, -43, -44], "shapeValues9": [-19], "shapeValues10": [-43], "shapeValues11": [-44], "shapeValues12": [-24], "TacticValue": "0x0000000000000000" },{ "Name": "(Unnamed Layer* 33) [Constant] + (Unnamed Layer* 34) [Shuffle]", "LayerType": "Constant", "Inputs": [], "Outputs": [ { "Name": "(Unnamed Layer* 34) [Shuffle]_output", "Location": "Device", "Dimensions": [1,1,1,1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Constant", "weights": {"Type": "Float", "Count": 1}, "dimensions": [1,1,1,1], "TacticValue": "0x0000000000000000" },{ "Name": "ConstantOfShape_39", "LayerType": "Slice", "Inputs": [ { "Name": "(Unnamed Layer* 34) [Shuffle]_output", "Location": "Device", "Dimensions": [1,1,1,1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "94", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,0,0], "Size": [1,1,-19,-20], "Stride": [0,0,0,0], "Mode": "DEFAULT", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_6 + Relu_7", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "input", "Location": "Device", "Dimensions": [1,3,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "44", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 32, "Groups": 1, "Weights": {"Type": "Float", "Count": 864}, "Bias": {"Type": "Float", "Count": 32}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_128x32_relu_small_nn_v1", "TacticValue": "0xc939b7b0a4d5a05f" },{ "Name": "Conv_8", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "44", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "45", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 32, "Groups": 1, "Weights": {"Type": "Float", "Count": 9216}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x000000000000003e" },{ "Name": "BatchNormalization_11 + Relu_12", "LayerType": "Scale", "Inputs": [ { "Name": "45", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "49", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Scale", "Mode": "CHANNEL", "Shift": {"Type": "Float", "Count": 32}, "Scale": {"Type": "Float", "Count": 32}, "Power": {"Type": "Float", "Count": 0}, "Activation": "RELU", "ChannelAxis": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_13 + Relu_14", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "49", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "54", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [2,2], "Dilation": [1,1], "OutMaps": 64, "Groups": 1, "Weights": {"Type": "Float", "Count": 18432}, "Bias": {"Type": "Float", "Count": 64}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_128x64_relu_xregs_large_nn_v1", "TacticValue": "0x27728c886a448c5a" },{ "Name": "Conv_15", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "54", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "55", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 64, "Groups": 1, "Weights": {"Type": "Float", "Count": 36864}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "HasReLU": 0, "TacticName": "volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1", "TacticValue": "0x268494f0a1c83de3" },{ "Name": "BatchNormalization_18 + Relu_19", "LayerType": "Scale", "Inputs": [ { "Name": "55", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "59", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Scale", "Mode": "CHANNEL", "Shift": {"Type": "Float", "Count": 64}, "Scale": {"Type": "Float", "Count": 64}, "Power": {"Type": "Float", "Count": 0}, "Activation": "RELU", "ChannelAxis": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_20 + Relu_21", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "59", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "64", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [2,2], "Dilation": [1,1], "OutMaps": 128, "Groups": 1, "Weights": {"Type": "Float", "Count": 73728}, "Bias": {"Type": "Float", "Count": 128}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_128x64_relu_xregs_large_nn_v1", "TacticValue": "0x27728c886a448c5a" },{ "Name": "Conv_22 + Relu_23", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "64", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "69", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 128, "Groups": 1, "Weights": {"Type": "Float", "Count": 147456}, "Bias": {"Type": "Float", "Count": 128}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1", "TacticValue": "0x268494f0a1c83de3" },{ "Name": "Conv_24 + Relu_25", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "69", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "74", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 128, "Groups": 1, "Weights": {"Type": "Float", "Count": 147456}, "Bias": {"Type": "Float", "Count": 128}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1", "TacticValue": "0x268494f0a1c83de3" },{ "Name": "Conv_26 + Relu_27", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "74", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "79", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 128, "Groups": 1, "Weights": {"Type": "Float", "Count": 147456}, "Bias": {"Type": "Float", "Count": 128}, "HasSparseWeights": 0, "Activation": "RELU", "HasBias": 1, "HasReLU": 1, "TacticName": "volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1", "TacticValue": "0x268494f0a1c83de3" },{ "Name": "Conv_28", "LayerType": "CaskConvolution", "Inputs": [ { "Name": "79", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "80", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 128, "Groups": 1, "Weights": {"Type": "Float", "Count": 147456}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "HasReLU": 0, "TacticName": "volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1", "TacticValue": "0x268494f0a1c83de3" },{ "Name": "PWN(266 + (Unnamed Layer* 140) [Shuffle], Div_184)", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "80", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "267", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 1, "InputArgs": ["arg0"], "NbOutputVars": 1, "OutputVars": ["var0"], "NbParams": 0, "Params": [], "NbLiterals": 1, "Literals": ["1.000000e+00f"], "NbOperations": 1, "Operations": ["const auto var0 = pwgen::iDiv(arg0, literal0);"], "TacticValue": "0x0000000000000002" },{ "Name": "ReduceMean_231", "LayerType": "Reduce", "Inputs": [ { "Name": "267", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "326", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "AVG", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Reshape_205", "LayerType": "NoOp", "Inputs": [ { "Name": "267", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "291", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Pad_219", "LayerType": "Slice", "Inputs": [ { "Name": "291", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "314", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,-1,-1], "Size": [128,1,-40,-41], "Stride": [1,1,1,1], "Mode": "REFLECT", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_220", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "314", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "315", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000038" },{ "Name": "Reshape_230", "LayerType": "NoOp", "Inputs": [ { "Name": "315", "Location": "Device", "Dimensions": [128,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "325", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "PWN(PWN(Sub_232, PWN(Softplus_233)), PWN(PWN(Sub_234, PWN(Softplus_235)), Mul_236))", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "267", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "325", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "326", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "331", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 3, "InputArgs": ["arg0", "arg1", "arg2"], "NbOutputVars": 1, "OutputVars": ["var16"], "NbParams": 0, "Params": [], "NbLiterals": 10, "Literals": ["0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f", "0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f"], "NbOperations": 17, "Operations": ["const auto var0 = pwgen::iMinus(arg0, arg1);", "const auto var1 = pwgen::iMul(literal3, var0);", "const auto var2 = pwgen::iExp(var1);", "const auto var3 = pwgen::iPlus(literal1, var2);", "const auto var4 = pwgen::iLog(var3);", "const auto var5 = pwgen::iMul(var4, literal2);", "const auto var6 = pwgen::iLessOrEqual(var0, literal4);", "const auto var7 = pwgen::iSelect(var6, var5, var0);", "const auto var8 = pwgen::iMinus(arg0, arg2);", "const auto var9 = pwgen::iMul(literal8, var8);", "const auto var10 = pwgen::iExp(var9);", "const auto var11 = pwgen::iPlus(literal6, var10);", "const auto var12 = pwgen::iLog(var11);", "const auto var13 = pwgen::iMul(var12, literal7);", "const auto var14 = pwgen::iLessOrEqual(var8, literal9);", "const auto var15 = pwgen::iSelect(var14, var13, var8);", "const auto var16 = pwgen::iMul(var7, var15);"], "TacticValue": "0x000000000000001c" },{ "Name": "ReduceMax_237", "LayerType": "Reduce", "Inputs": [ { "Name": "331", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "332", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "MAX", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Resize_250", "LayerType": "Resize", "Inputs": [ { "Name": "332", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "347", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Resize", "ResizeMode": "LINEAR", "ResizeScales": [0, 0, 0, 0, 0, 0, 0, 0], "CoordTransform": "kHALF_PIXEL", "ResizeSelector": "kUPPER", "NNRounding": "kFLOOR", "TacticValue": "0x0000000000000001" },{ "Name": "PWN(181 + (Unnamed Layer* 89) [Shuffle], Div_113)", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "55", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "182", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 1, "InputArgs": ["arg0"], "NbOutputVars": 1, "OutputVars": ["var0"], "NbParams": 0, "Params": [], "NbLiterals": 1, "Literals": ["1.000000e+00f"], "NbOperations": 1, "Operations": ["const auto var0 = pwgen::iDiv(arg0, literal0);"], "TacticValue": "0x0000000000000002" },{ "Name": "ReduceMean_160", "LayerType": "Reduce", "Inputs": [ { "Name": "182", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "241", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "AVG", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Reshape_134", "LayerType": "NoOp", "Inputs": [ { "Name": "182", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "206", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Pad_148", "LayerType": "Slice", "Inputs": [ { "Name": "206", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "229", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,-6,-6], "Size": [64,1,-34,-47], "Stride": [1,1,1,1], "Mode": "REFLECT", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_149", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "229", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "230", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [2,2], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x000000000000003a" },{ "Name": "Reshape_159", "LayerType": "NoOp", "Inputs": [ { "Name": "230", "Location": "Device", "Dimensions": [64,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "240", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "PWN(PWN(Sub_161, PWN(Softplus_162)), PWN(PWN(Sub_163, PWN(Softplus_164)), Mul_165))", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "182", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "240", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "241", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "246", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 3, "InputArgs": ["arg0", "arg1", "arg2"], "NbOutputVars": 1, "OutputVars": ["var16"], "NbParams": 0, "Params": [], "NbLiterals": 10, "Literals": ["0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f", "0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f"], "NbOperations": 17, "Operations": ["const auto var0 = pwgen::iMinus(arg0, arg1);", "const auto var1 = pwgen::iMul(literal3, var0);", "const auto var2 = pwgen::iExp(var1);", "const auto var3 = pwgen::iPlus(literal1, var2);", "const auto var4 = pwgen::iLog(var3);", "const auto var5 = pwgen::iMul(var4, literal2);", "const auto var6 = pwgen::iLessOrEqual(var0, literal4);", "const auto var7 = pwgen::iSelect(var6, var5, var0);", "const auto var8 = pwgen::iMinus(arg0, arg2);", "const auto var9 = pwgen::iMul(literal8, var8);", "const auto var10 = pwgen::iExp(var9);", "const auto var11 = pwgen::iPlus(literal6, var10);", "const auto var12 = pwgen::iLog(var11);", "const auto var13 = pwgen::iMul(var12, literal7);", "const auto var14 = pwgen::iLessOrEqual(var8, literal9);", "const auto var15 = pwgen::iSelect(var14, var13, var8);", "const auto var16 = pwgen::iMul(var7, var15);"], "TacticValue": "0x000000000000001c" },{ "Name": "ReduceMax_166", "LayerType": "Reduce", "Inputs": [ { "Name": "246", "Location": "Device", "Dimensions": [1,64,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "247", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "MAX", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Resize_179", "LayerType": "Resize", "Inputs": [ { "Name": "247", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "262", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Resize", "ResizeMode": "LINEAR", "ResizeScales": [0, 0, 0, 0, 0, 0, 0, 0], "CoordTransform": "kHALF_PIXEL", "ResizeSelector": "kUPPER", "NNRounding": "kFLOOR", "TacticValue": "0x0000000000000001" },{ "Name": "PWN(95 + (Unnamed Layer* 38) [Shuffle], Div_41)", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "45", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "96", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 1, "InputArgs": ["arg0"], "NbOutputVars": 1, "OutputVars": ["var0"], "NbParams": 0, "Params": [], "NbLiterals": 1, "Literals": ["1.000000e+00f"], "NbOperations": 1, "Operations": ["const auto var0 = pwgen::iDiv(arg0, literal0);"], "TacticValue": "0x0000000000000002" },{ "Name": "ReduceMean_89", "LayerType": "Reduce", "Inputs": [ { "Name": "96", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "156", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "AVG", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Reshape_62", "LayerType": "NoOp", "Inputs": [ { "Name": "96", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "120", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Pad_76", "LayerType": "Slice", "Inputs": [ { "Name": "120", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "143", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,-5,-5], "Size": [32,1,-21,-22], "Stride": [1,1,1,1], "Mode": "REFLECT", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_78", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "143", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "145", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [3,3], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x000000000000003a" },{ "Name": "Reshape_88", "LayerType": "NoOp", "Inputs": [ { "Name": "145", "Location": "Device", "Dimensions": [32,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "155", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "PWN(PWN(Sub_90, PWN(Softplus_91)), PWN(PWN(Sub_92, PWN(Softplus_93)), Mul_94))", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "96", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "155", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "156", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "161", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 3, "InputArgs": ["arg0", "arg1", "arg2"], "NbOutputVars": 1, "OutputVars": ["var16"], "NbParams": 0, "Params": [], "NbLiterals": 10, "Literals": ["0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f", "0.000000e+00f", "1.000000e+00f", "1.000000e+00f", "1.000000e+00f", "2.000000e+01f"], "NbOperations": 17, "Operations": ["const auto var0 = pwgen::iMinus(arg0, arg1);", "const auto var1 = pwgen::iMul(literal3, var0);", "const auto var2 = pwgen::iExp(var1);", "const auto var3 = pwgen::iPlus(literal1, var2);", "const auto var4 = pwgen::iLog(var3);", "const auto var5 = pwgen::iMul(var4, literal2);", "const auto var6 = pwgen::iLessOrEqual(var0, literal4);", "const auto var7 = pwgen::iSelect(var6, var5, var0);", "const auto var8 = pwgen::iMinus(arg0, arg2);", "const auto var9 = pwgen::iMul(literal8, var8);", "const auto var10 = pwgen::iExp(var9);", "const auto var11 = pwgen::iPlus(literal6, var10);", "const auto var12 = pwgen::iLog(var11);", "const auto var13 = pwgen::iMul(var12, literal7);", "const auto var14 = pwgen::iLessOrEqual(var8, literal9);", "const auto var15 = pwgen::iSelect(var14, var13, var8);", "const auto var16 = pwgen::iMul(var7, var15);"], "TacticValue": "0x0000000000000006" },{ "Name": "ReduceMax_95", "LayerType": "Reduce", "Inputs": [ { "Name": "161", "Location": "Device", "Dimensions": [1,32,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "162", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Reduce", "Operation": "MAX", "ReduceAxes": [0,1,0,0], "KeepDimensions": 1, "TacticValue": "0x0000000000000005" },{ "Name": "Resize_108", "LayerType": "Resize", "Inputs": [ { "Name": "162", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "177", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Resize", "ResizeMode": "LINEAR", "ResizeScales": [0, 0, 0, 0, 0, 0, 0, 0], "CoordTransform": "kHALF_PIXEL", "ResizeSelector": "kUPPER", "NNRounding": "kFLOOR", "TacticValue": "0x0000000000000001" },{ "Name": "PWN(PWN(PWN(178 + (Unnamed Layer* 85) [Shuffle] + Mul_110, Add_111), PWN(263 + (Unnamed Layer* 136) [Shuffle] + Mul_181, Add_182)), PWN(348 + (Unnamed Layer* 187) [Shuffle] + Mul_252, Add_253))", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "177", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "94", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "262", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "347", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "350", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 4, "InputArgs": ["arg0", "arg1", "arg2", "arg3"], "NbOutputVars": 1, "OutputVars": ["var5"], "NbParams": 0, "Params": [], "NbLiterals": 6, "Literals": ["0.000000e+00f", "1.666667e-01f", "0.000000e+00f", "3.333333e-01f", "0.000000e+00f", "5.000000e-01f"], "NbOperations": 6, "Operations": ["const auto var0 = pwgen::iMul(arg0, literal1);", "const auto var1 = pwgen::iPlus(arg1, var0);", "const auto var2 = pwgen::iMul(arg2, literal3);", "const auto var3 = pwgen::iPlus(var1, var2);", "const auto var4 = pwgen::iMul(arg3, literal5);", "const auto var5 = pwgen::iPlus(var3, var4);"], "TacticValue": "0x0000000000000003" },{ "Name": "MaxPool_262", "LayerType": "TiledPooling", "Inputs": [ { "Name": "350", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "359", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Pooling", "PoolingType": "MAX", "WindowSize": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "BlendFactor": 0, "AverageCountExcludesPadding": 1, "TacticValue": "0x0000000000640101" },{ "Name": "Pad_313", "LayerType": "Padding", "Inputs": [ { "Name": "350", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "434", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,-5,-5], "Size": [1,1,-21,-22], "Stride": [1,1,1,1], "Mode": "FILL", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Conv_315", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "434", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "436", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [3,3], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000038" },{ "Name": "Conv_317", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "434", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "438", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [3,3], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000038" },{ "Name": "Conv_319", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "434", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "440", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [0,0], "PostPadding": [0,0], "Stride": [1,1], "Dilation": [3,3], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000038" },{ "Name": "(Unnamed Layer* 214) [Constant] + (Unnamed Layer* 215) [Shuffle]", "LayerType": "Constant", "Inputs": [], "Outputs": [ { "Name": "(Unnamed Layer* 215) [Shuffle]_output", "Location": "Device", "Dimensions": [1,1,1,1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Constant", "weights": {"Type": "Float", "Count": 1}, "dimensions": [1,1,1,1], "TacticValue": "0x0000000000000000" },{ "Name": "ConstantOfShape_277", "LayerType": "Slice", "Inputs": [ { "Name": "(Unnamed Layer* 215) [Shuffle]_output", "Location": "Device", "Dimensions": [1,1,1,1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "380", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,0,0], "Size": [1,1,-49,-50], "Stride": [0,0,0,0], "Mode": "DEFAULT", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "Cast_278", "LayerType": "NoOp", "Inputs": [ { "Name": "380", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "381", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Pad_293", "LayerType": "Slice", "Inputs": [ { "Name": "381", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "405", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Slice", "Start": [0,0,-3,-3], "Size": [1,1,-19,-20], "Stride": [1,1,1,1], "Mode": "FILL", "negativeInfinityPadding": 0, "TacticValue": "0x0000000000000000" },{ "Name": "{ForeignNode[464 + (Unnamed Layer* 268) [Shuffle]...Where_344]}", "LayerType": "Myelin", "Inputs": [ { "Name": "350", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "359", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "438", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "436", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "440", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "405", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "350[implicit padding 9]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "774", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Conv_751", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "893", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000001" },{ "Name": "Conv_752", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "894", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000001" },{ "Name": "Conv_753", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "895", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000001" },{ "Name": "Conv_755", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "897", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000001" },{ "Name": "Conv_757", "LayerType": "CudnnConvolution", "Inputs": [ { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "899", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Convolution", "Kernel": [3,3], "PaddingMode": "kEXPLICIT_ROUND_DOWN", "PrePadding": [1,1], "PostPadding": [1,1], "Stride": [1,1], "Dilation": [1,1], "OutMaps": 1, "Groups": 1, "Weights": {"Type": "Float", "Count": 9}, "Bias": {"Type": "Float", "Count": 0}, "HasSparseWeights": 0, "Activation": "NONE", "HasBias": 0, "TacticValue": "0x0000000000000001" },{ "Name": "{ForeignNode[920 + (Unnamed Layer* 830) [Shuffle]...Concat_792]}", "LayerType": "Myelin", "Inputs": [ { "Name": "894", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "893", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "895", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "897", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "899", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "350[implicit padding 9]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "774", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "934", "Location": "Device", "Dimensions": [1,1,-1,-1,2], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" },{ "Name": "Range_382", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "510", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Range_513", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "648", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Range_646", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "788", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Range_433", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "561", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Range_564", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "699", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "Range_697", "LayerType": "Fill", "Inputs": [], "Outputs": [ { "Name": "839", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "Fill", "Op": "LINSPACE", "dimension": [3000], "alpha": 0, "beta": 1, "TacticValue": "0x0000000000000000" },{ "Name": "PWN(Clip_793)", "LayerType": "PointWiseV2", "Inputs": [ { "Name": "934", "Location": "Device", "Dimensions": [1,1,-1,-1,2], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "939", "Location": "Device", "Dimensions": [1,1,-1,-1,2], "Format/Datatype": "N/A due to dynamic shapes" }], "ParameterType": "PointWise", "ParameterSubType": "PointWiseExpression", "NbInputArgs": 1, "InputArgs": ["arg0"], "NbOutputVars": 1, "OutputVars": ["var1"], "NbParams": 0, "Params": [], "NbLiterals": 4, "Literals": ["0.000000e+00f", "1.000000e+00f", "-5.000000e-01f", "5.000000e-01f"], "NbOperations": 2, "Operations": ["const auto var0 = pwgen::iMin(literal3, arg0);", "const auto var1 = pwgen::iMax(literal2, var0);"], "TacticValue": "0x0000000000000009" },{ "Name": "{ForeignNode[(Unnamed Layer* 1129) [Constant] + (Unnamed Layer* 1131) [Shuffle]...Gather_1010]}", "LayerType": "Myelin", "Inputs": [ { "Name": "(Unnamed Layer* 729) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "774", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "80", "Location": "Device", "Dimensions": [1,128,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "510", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "648", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "788", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "561", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "699", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "839", "Location": "Device", "Dimensions": [3000], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "939", "Location": "Device", "Dimensions": [1,1,-1,-1,2], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "465", "Location": "Device", "Dimensions": [1,1,-1,-1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 950) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "1144", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "(Unnamed Layer* 970) [Shuffle]_output", "Location": "Device", "Dimensions": [1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "80[implicit padding 10]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "80[implicit padding 11]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "350[implicit padding 9]", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "774", "Location": "Device", "Dimensions": [], "Format/Datatype": "N/A due to dynamic shapes" }], "Outputs": [ { "Name": "scores", "Location": "Device", "Dimensions": [8000,1], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "descs", "Location": "Device", "Dimensions": [1,8000,128], "Format/Datatype": "N/A due to dynamic shapes" }, { "Name": "kpts", "Location": "Device", "Dimensions": [1,8000,2], "Format/Datatype": "N/A due to dynamic shapes" }], "TacticValue": "0x0000000000000000" }], "Bindings": ["input" ,"scores" ,"descs" ,"kpts" ]} Completion optimized model deserialization TensorRT inference time (CPU) is - 15.622138977050781 milliseconds TensorRT inference time (CUDA event) is - 24.66783905029297 milliseconds DlewareAnalyzer model engine device memory consumption - 245077504 DlewareAnalyzer model tesnors device memory consumption - 9778048 TRT analyzer - No ERRORS! Saved to storage start trt Saved to storage completion DONE!