[TensorRT] VERBOSE: Registered plugin creator - ::GridAnchor_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::NMS_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Reorg_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Region_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Clip_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::LReLU_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::PriorBox_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Normalize_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::RPROI_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::BatchedNMS_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::FlattenConcat_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::CropAndResize version 1 [TensorRT] VERBOSE: Registered plugin creator - ::DetectionLayer_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Proposal version 1 [TensorRT] VERBOSE: Registered plugin creator - ::ProposalLayer_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::PyramidROIAlign_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::ResizeNearest_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Split version 1 [TensorRT] VERBOSE: Registered plugin creator - ::SpecialSlice_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::InstanceNormalization_TRT version 1 [TensorRT] VERBOSE: ModelImporter.cpp:202: Adding network input: input with dtype: float32, dimensions: (1, 3, 224, 224) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: input for ONNX tensor: input [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: head.fc.weight [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: head.fc.bias [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 743 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 744 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 746 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 747 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 749 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 750 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 752 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 753 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 755 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 756 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 758 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 759 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 761 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 762 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 764 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 765 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 767 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 768 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 770 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 771 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 773 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 774 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 776 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 777 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 779 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 780 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 782 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 783 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 785 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 786 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 788 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 789 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 791 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 792 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 794 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 795 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 797 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 798 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 800 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 801 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 803 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 804 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 806 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 807 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 809 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 810 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 812 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 813 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 815 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 816 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 818 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 819 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 821 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 822 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 824 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 825 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 827 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 828 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 830 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 831 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 833 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 834 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 836 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 837 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 839 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 840 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 842 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 843 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 845 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 846 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 848 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 849 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 851 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 852 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 854 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 855 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 857 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 858 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 860 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 861 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 863 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 864 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 866 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 867 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 869 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 870 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 872 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 873 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 875 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 876 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 878 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 879 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 881 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 882 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 884 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 885 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 887 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 888 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 890 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 891 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 893 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 894 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 896 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 897 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 899 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 900 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 902 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 903 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 905 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 906 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 908 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 909 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 911 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 912 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 914 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 915 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 917 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 918 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 920 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 921 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 923 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 924 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 926 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 927 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 929 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 930 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 932 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 933 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 935 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 936 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 938 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 939 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 941 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 942 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 943 [TensorRT] WARNING: onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 944 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 945 [TensorRT] VERBOSE: onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [TensorRT] WARNING: onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 946 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 947 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 948 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 949 [TensorRT] VERBOSE: onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [TensorRT] WARNING: onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 950 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 951 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 952 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 953 [TensorRT] VERBOSE: onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [TensorRT] WARNING: onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 954 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 955 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 956 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 957 [TensorRT] VERBOSE: onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [TensorRT] WARNING: onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 958 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 959 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 960 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 961 [TensorRT] VERBOSE: onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [TensorRT] WARNING: onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 962 [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_0 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: input [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 743 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 744 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_0 [Conv] inputs: [input -> (1, 3, 224, 224)], [743 -> (32, 3, 3, 3)], [744 -> (32)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (1, 3, 224, 224) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_0 for ONNX node: Conv_0 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (1, 32, 224, 224) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 742 for ONNX tensor: 742 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_0 [Conv] outputs: [742 -> (1, 32, 224, 224)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_1 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 742 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_1 [LeakyRelu] inputs: [742 -> (1, 32, 224, 224)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_1 for ONNX node: LeakyRelu_1 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 407 for ONNX tensor: 407 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_1 [LeakyRelu] outputs: [407 -> (1, 32, 224, 224)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_2 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 407 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 746 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 747 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_2 [Conv] inputs: [407 -> (1, 32, 224, 224)], [746 -> (64, 32, 3, 3)], [747 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (1, 32, 224, 224) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_2 for ONNX node: Conv_2 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 112, 112) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 745 for ONNX tensor: 745 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_2 [Conv] outputs: [745 -> (1, 64, 112, 112)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_3 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 745 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_3 [LeakyRelu] inputs: [745 -> (1, 64, 112, 112)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_3 for ONNX node: LeakyRelu_3 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 410 for ONNX tensor: 410 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_3 [LeakyRelu] outputs: [410 -> (1, 64, 112, 112)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_4 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 410 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 749 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 750 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_4 [Conv] inputs: [410 -> (1, 64, 112, 112)], [749 -> (128, 64, 1, 1)], [750 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 112, 112) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_4 for ONNX node: Conv_4 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 112, 112) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 748 for ONNX tensor: 748 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_4 [Conv] outputs: [748 -> (1, 128, 112, 112)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_5 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 748 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_5 [LeakyRelu] inputs: [748 -> (1, 128, 112, 112)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_5 for ONNX node: LeakyRelu_5 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 413 for ONNX tensor: 413 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_5 [LeakyRelu] outputs: [413 -> (1, 128, 112, 112)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Shape_6 [Shape] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 413 [TensorRT] VERBOSE: ModelImporter.cpp:125: Shape_6 [Shape] inputs: [413 -> (1, 128, 112, 112)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Shape_6 for ONNX node: Shape_6 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 414 for ONNX tensor: 414 [TensorRT] VERBOSE: ModelImporter.cpp:179: Shape_6 [Shape] outputs: [414 -> (4)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_7 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_7 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_7 [Constant] outputs: [415 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gather_8 [Gather] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 414 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 415 [TensorRT] VERBOSE: ModelImporter.cpp:125: Gather_8 [Gather] inputs: [414 -> (4)], [415 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:986: Using Gather axis: 0 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gather_8 for ONNX node: Gather_8 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 416 for ONNX tensor: 416 [TensorRT] VERBOSE: ModelImporter.cpp:179: Gather_8 [Gather] outputs: [416 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_9 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_9 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_9 [Constant] outputs: [417 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Div_10 [Div] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 416 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 417 [TensorRT] VERBOSE: ModelImporter.cpp:125: Div_10 [Div] inputs: [416 -> ()], [417 -> ()], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Div_10 for ONNX node: Div_10 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 418 for ONNX tensor: 418 [TensorRT] VERBOSE: ModelImporter.cpp:179: Div_10 [Div] outputs: [418 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_11 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 418 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_11 [Cast] inputs: [418 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_11 for ONNX node: Cast_11 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 419 for ONNX tensor: 419 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_11 [Cast] outputs: [419 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_12 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 419 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_12 [Cast] inputs: [419 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_12 for ONNX node: Cast_12 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 420 for ONNX tensor: 420 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_12 [Cast] outputs: [420 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_13 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 420 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_13 [Unsqueeze] inputs: [420 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_13 for ONNX node: Unsqueeze_13 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 424 for ONNX tensor: 424 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_13 [Unsqueeze] outputs: [424 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_14 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_14 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_14 [Constant] outputs: [426 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_15 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 413 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 943 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 424 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 944 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 426 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_15 [Slice] inputs: [413 -> (1, 128, 112, 112)], [943 -> (1)], [424 -> (1)], [944 -> (1)], [426 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_15 for ONNX node: Slice_15 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 427 for ONNX tensor: 427 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_15 [Slice] outputs: [427 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_16 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 420 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_16 [Unsqueeze] inputs: [420 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_16 for ONNX node: Unsqueeze_16 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 430 for ONNX tensor: 430 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_16 [Unsqueeze] outputs: [430 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_17 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_17 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_17 [Constant] outputs: [433 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_18 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 413 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 430 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 945 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 946 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 433 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_18 [Slice] inputs: [413 -> (1, 128, 112, 112)], [430 -> (1)], [945 -> (1)], [946 -> (1)], [433 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_18 for ONNX node: Slice_18 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 434 for ONNX tensor: 434 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_18 [Slice] outputs: [434 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_19 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 434 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 752 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 753 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_19 [Conv] inputs: [434 -> (-1, -1, -1, -1)], [752 -> (32, 64, 1, 1)], [753 -> (32)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_19 for ONNX node: Conv_19 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 32, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 751 for ONNX tensor: 751 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_19 [Conv] outputs: [751 -> (-1, 32, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_20 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 751 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_20 [LeakyRelu] inputs: [751 -> (-1, 32, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_20 for ONNX node: LeakyRelu_20 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 437 for ONNX tensor: 437 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_20 [LeakyRelu] outputs: [437 -> (-1, 32, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_21 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 437 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 755 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 756 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_21 [Conv] inputs: [437 -> (-1, 32, -1, -1)], [755 -> (64, 32, 3, 3)], [756 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 32, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_21 for ONNX node: Conv_21 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 754 for ONNX tensor: 754 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_21 [Conv] outputs: [754 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_22 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 754 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_22 [LeakyRelu] inputs: [754 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_22 for ONNX node: LeakyRelu_22 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 440 for ONNX tensor: 440 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_22 [LeakyRelu] outputs: [440 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_23 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 440 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 434 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_23 [Add] inputs: [440 -> (-1, 64, -1, -1)], [434 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_23 for ONNX node: Add_23 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 441 for ONNX tensor: 441 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_23 [Add] outputs: [441 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_24 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 441 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 758 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 759 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_24 [Conv] inputs: [441 -> (-1, 64, -1, -1)], [758 -> (64, 64, 1, 1)], [759 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_24 for ONNX node: Conv_24 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 757 for ONNX tensor: 757 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_24 [Conv] outputs: [757 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_25 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 757 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_25 [LeakyRelu] inputs: [757 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_25 for ONNX node: LeakyRelu_25 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 444 for ONNX tensor: 444 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_25 [LeakyRelu] outputs: [444 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Concat_26 [Concat] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 427 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 444 [TensorRT] VERBOSE: ModelImporter.cpp:125: Concat_26 [Concat] inputs: [427 -> (-1, -1, -1, -1)], [444 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Concat_26 for ONNX node: Concat_26 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 445 for ONNX tensor: 445 [TensorRT] VERBOSE: ModelImporter.cpp:179: Concat_26 [Concat] outputs: [445 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_27 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 445 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 761 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 762 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_27 [Conv] inputs: [445 -> (-1, -1, -1, -1)], [761 -> (64, 128, 1, 1)], [762 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_27 for ONNX node: Conv_27 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 760 for ONNX tensor: 760 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_27 [Conv] outputs: [760 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_28 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 760 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_28 [LeakyRelu] inputs: [760 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_28 for ONNX node: LeakyRelu_28 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 448 for ONNX tensor: 448 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_28 [LeakyRelu] outputs: [448 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_29 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 448 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 764 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 765 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_29 [Conv] inputs: [448 -> (-1, 64, -1, -1)], [764 -> (128, 64, 3, 3)], [765 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_29 for ONNX node: Conv_29 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 763 for ONNX tensor: 763 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_29 [Conv] outputs: [763 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_30 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 763 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_30 [LeakyRelu] inputs: [763 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_30 for ONNX node: LeakyRelu_30 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 451 for ONNX tensor: 451 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_30 [LeakyRelu] outputs: [451 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_31 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 451 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 767 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 768 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_31 [Conv] inputs: [451 -> (-1, 128, -1, -1)], [767 -> (128, 128, 1, 1)], [768 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_31 for ONNX node: Conv_31 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 766 for ONNX tensor: 766 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_31 [Conv] outputs: [766 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_32 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 766 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_32 [LeakyRelu] inputs: [766 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_32 for ONNX node: LeakyRelu_32 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 454 for ONNX tensor: 454 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_32 [LeakyRelu] outputs: [454 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Shape_33 [Shape] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 454 [TensorRT] VERBOSE: ModelImporter.cpp:125: Shape_33 [Shape] inputs: [454 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Shape_33 for ONNX node: Shape_33 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 455 for ONNX tensor: 455 [TensorRT] VERBOSE: ModelImporter.cpp:179: Shape_33 [Shape] outputs: [455 -> (4)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_34 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_34 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_34 [Constant] outputs: [456 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gather_35 [Gather] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 455 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 456 [TensorRT] VERBOSE: ModelImporter.cpp:125: Gather_35 [Gather] inputs: [455 -> (4)], [456 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:986: Using Gather axis: 0 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gather_35 for ONNX node: Gather_35 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 457 for ONNX tensor: 457 [TensorRT] VERBOSE: ModelImporter.cpp:179: Gather_35 [Gather] outputs: [457 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_36 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_36 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_36 [Constant] outputs: [458 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Div_37 [Div] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 457 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 458 [TensorRT] VERBOSE: ModelImporter.cpp:125: Div_37 [Div] inputs: [457 -> ()], [458 -> ()], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Div_37 for ONNX node: Div_37 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 459 for ONNX tensor: 459 [TensorRT] VERBOSE: ModelImporter.cpp:179: Div_37 [Div] outputs: [459 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_38 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 459 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_38 [Cast] inputs: [459 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_38 for ONNX node: Cast_38 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 460 for ONNX tensor: 460 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_38 [Cast] outputs: [460 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_39 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 460 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_39 [Cast] inputs: [460 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_39 for ONNX node: Cast_39 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 461 for ONNX tensor: 461 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_39 [Cast] outputs: [461 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_40 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 461 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_40 [Unsqueeze] inputs: [461 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_40 for ONNX node: Unsqueeze_40 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 465 for ONNX tensor: 465 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_40 [Unsqueeze] outputs: [465 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_41 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_41 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_41 [Constant] outputs: [467 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_42 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 454 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 947 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 465 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 948 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 467 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_42 [Slice] inputs: [454 -> (-1, 128, -1, -1)], [947 -> (1)], [465 -> (1)], [948 -> (1)], [467 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_42 for ONNX node: Slice_42 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 468 for ONNX tensor: 468 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_42 [Slice] outputs: [468 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_43 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 461 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_43 [Unsqueeze] inputs: [461 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_43 for ONNX node: Unsqueeze_43 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 471 for ONNX tensor: 471 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_43 [Unsqueeze] outputs: [471 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_44 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_44 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_44 [Constant] outputs: [474 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_45 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 454 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 471 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 949 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 950 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 474 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_45 [Slice] inputs: [454 -> (-1, 128, -1, -1)], [471 -> (1)], [949 -> (1)], [950 -> (1)], [474 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_45 for ONNX node: Slice_45 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 475 for ONNX tensor: 475 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_45 [Slice] outputs: [475 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_46 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 475 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 770 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 771 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_46 [Conv] inputs: [475 -> (-1, -1, -1, -1)], [770 -> (64, 64, 1, 1)], [771 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_46 for ONNX node: Conv_46 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 769 for ONNX tensor: 769 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_46 [Conv] outputs: [769 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_47 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 769 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_47 [LeakyRelu] inputs: [769 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_47 for ONNX node: LeakyRelu_47 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 478 for ONNX tensor: 478 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_47 [LeakyRelu] outputs: [478 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_48 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 478 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 773 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 774 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_48 [Conv] inputs: [478 -> (-1, 64, -1, -1)], [773 -> (64, 64, 3, 3)], [774 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_48 for ONNX node: Conv_48 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 772 for ONNX tensor: 772 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_48 [Conv] outputs: [772 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_49 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 772 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_49 [LeakyRelu] inputs: [772 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_49 for ONNX node: LeakyRelu_49 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 481 for ONNX tensor: 481 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_49 [LeakyRelu] outputs: [481 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_50 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 481 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 475 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_50 [Add] inputs: [481 -> (-1, 64, -1, -1)], [475 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_50 for ONNX node: Add_50 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 482 for ONNX tensor: 482 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_50 [Add] outputs: [482 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_51 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 482 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 776 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 777 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_51 [Conv] inputs: [482 -> (-1, 64, -1, -1)], [776 -> (64, 64, 1, 1)], [777 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_51 for ONNX node: Conv_51 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 775 for ONNX tensor: 775 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_51 [Conv] outputs: [775 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_52 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 775 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_52 [LeakyRelu] inputs: [775 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_52 for ONNX node: LeakyRelu_52 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 485 for ONNX tensor: 485 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_52 [LeakyRelu] outputs: [485 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_53 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 485 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 779 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 780 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_53 [Conv] inputs: [485 -> (-1, 64, -1, -1)], [779 -> (64, 64, 3, 3)], [780 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_53 for ONNX node: Conv_53 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 778 for ONNX tensor: 778 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_53 [Conv] outputs: [778 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_54 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 778 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_54 [LeakyRelu] inputs: [778 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_54 for ONNX node: LeakyRelu_54 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 488 for ONNX tensor: 488 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_54 [LeakyRelu] outputs: [488 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_55 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 488 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 482 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_55 [Add] inputs: [488 -> (-1, 64, -1, -1)], [482 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_55 for ONNX node: Add_55 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 489 for ONNX tensor: 489 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_55 [Add] outputs: [489 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_56 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 489 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 782 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 783 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_56 [Conv] inputs: [489 -> (-1, 64, -1, -1)], [782 -> (64, 64, 1, 1)], [783 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_56 for ONNX node: Conv_56 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 781 for ONNX tensor: 781 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_56 [Conv] outputs: [781 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_57 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 781 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_57 [LeakyRelu] inputs: [781 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_57 for ONNX node: LeakyRelu_57 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 492 for ONNX tensor: 492 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_57 [LeakyRelu] outputs: [492 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Concat_58 [Concat] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 468 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 492 [TensorRT] VERBOSE: ModelImporter.cpp:125: Concat_58 [Concat] inputs: [468 -> (-1, -1, -1, -1)], [492 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Concat_58 for ONNX node: Concat_58 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 493 for ONNX tensor: 493 [TensorRT] VERBOSE: ModelImporter.cpp:179: Concat_58 [Concat] outputs: [493 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_59 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 493 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 785 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 786 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_59 [Conv] inputs: [493 -> (-1, -1, -1, -1)], [785 -> (128, 128, 1, 1)], [786 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_59 for ONNX node: Conv_59 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 784 for ONNX tensor: 784 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_59 [Conv] outputs: [784 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_60 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 784 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_60 [LeakyRelu] inputs: [784 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_60 for ONNX node: LeakyRelu_60 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 496 for ONNX tensor: 496 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_60 [LeakyRelu] outputs: [496 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_61 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 496 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 788 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 789 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_61 [Conv] inputs: [496 -> (-1, 128, -1, -1)], [788 -> (256, 128, 3, 3)], [789 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_61 for ONNX node: Conv_61 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 787 for ONNX tensor: 787 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_61 [Conv] outputs: [787 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_62 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 787 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_62 [LeakyRelu] inputs: [787 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_62 for ONNX node: LeakyRelu_62 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 499 for ONNX tensor: 499 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_62 [LeakyRelu] outputs: [499 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_63 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 499 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 791 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 792 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_63 [Conv] inputs: [499 -> (-1, 256, -1, -1)], [791 -> (256, 256, 1, 1)], [792 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_63 for ONNX node: Conv_63 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 790 for ONNX tensor: 790 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_63 [Conv] outputs: [790 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_64 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 790 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_64 [LeakyRelu] inputs: [790 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_64 for ONNX node: LeakyRelu_64 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 502 for ONNX tensor: 502 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_64 [LeakyRelu] outputs: [502 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Shape_65 [Shape] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 502 [TensorRT] VERBOSE: ModelImporter.cpp:125: Shape_65 [Shape] inputs: [502 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Shape_65 for ONNX node: Shape_65 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 503 for ONNX tensor: 503 [TensorRT] VERBOSE: ModelImporter.cpp:179: Shape_65 [Shape] outputs: [503 -> (4)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_66 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_66 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_66 [Constant] outputs: [504 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gather_67 [Gather] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 503 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 504 [TensorRT] VERBOSE: ModelImporter.cpp:125: Gather_67 [Gather] inputs: [503 -> (4)], [504 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:986: Using Gather axis: 0 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gather_67 for ONNX node: Gather_67 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 505 for ONNX tensor: 505 [TensorRT] VERBOSE: ModelImporter.cpp:179: Gather_67 [Gather] outputs: [505 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_68 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_68 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_68 [Constant] outputs: [506 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Div_69 [Div] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 505 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 506 [TensorRT] VERBOSE: ModelImporter.cpp:125: Div_69 [Div] inputs: [505 -> ()], [506 -> ()], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Div_69 for ONNX node: Div_69 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 507 for ONNX tensor: 507 [TensorRT] VERBOSE: ModelImporter.cpp:179: Div_69 [Div] outputs: [507 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_70 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 507 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_70 [Cast] inputs: [507 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_70 for ONNX node: Cast_70 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 508 for ONNX tensor: 508 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_70 [Cast] outputs: [508 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_71 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 508 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_71 [Cast] inputs: [508 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_71 for ONNX node: Cast_71 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 509 for ONNX tensor: 509 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_71 [Cast] outputs: [509 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_72 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 509 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_72 [Unsqueeze] inputs: [509 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_72 for ONNX node: Unsqueeze_72 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 513 for ONNX tensor: 513 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_72 [Unsqueeze] outputs: [513 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_73 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_73 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_73 [Constant] outputs: [515 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_74 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 502 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 951 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 513 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 952 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 515 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_74 [Slice] inputs: [502 -> (-1, 256, -1, -1)], [951 -> (1)], [513 -> (1)], [952 -> (1)], [515 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_74 for ONNX node: Slice_74 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 516 for ONNX tensor: 516 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_74 [Slice] outputs: [516 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_75 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 509 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_75 [Unsqueeze] inputs: [509 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_75 for ONNX node: Unsqueeze_75 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 519 for ONNX tensor: 519 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_75 [Unsqueeze] outputs: [519 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_76 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_76 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_76 [Constant] outputs: [522 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_77 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 502 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 519 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 953 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 954 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 522 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_77 [Slice] inputs: [502 -> (-1, 256, -1, -1)], [519 -> (1)], [953 -> (1)], [954 -> (1)], [522 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_77 for ONNX node: Slice_77 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 523 for ONNX tensor: 523 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_77 [Slice] outputs: [523 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_78 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 523 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 794 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 795 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_78 [Conv] inputs: [523 -> (-1, -1, -1, -1)], [794 -> (128, 128, 1, 1)], [795 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_78 for ONNX node: Conv_78 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 793 for ONNX tensor: 793 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_78 [Conv] outputs: [793 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_79 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 793 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_79 [LeakyRelu] inputs: [793 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_79 for ONNX node: LeakyRelu_79 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 526 for ONNX tensor: 526 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_79 [LeakyRelu] outputs: [526 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_80 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 526 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 797 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 798 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_80 [Conv] inputs: [526 -> (-1, 128, -1, -1)], [797 -> (128, 128, 3, 3)], [798 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_80 for ONNX node: Conv_80 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 796 for ONNX tensor: 796 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_80 [Conv] outputs: [796 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_81 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 796 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_81 [LeakyRelu] inputs: [796 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_81 for ONNX node: LeakyRelu_81 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 529 for ONNX tensor: 529 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_81 [LeakyRelu] outputs: [529 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_82 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 529 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 523 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_82 [Add] inputs: [529 -> (-1, 128, -1, -1)], [523 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_82 for ONNX node: Add_82 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 530 for ONNX tensor: 530 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_82 [Add] outputs: [530 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_83 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 530 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 800 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 801 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_83 [Conv] inputs: [530 -> (-1, 128, -1, -1)], [800 -> (128, 128, 1, 1)], [801 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_83 for ONNX node: Conv_83 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 799 for ONNX tensor: 799 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_83 [Conv] outputs: [799 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_84 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 799 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_84 [LeakyRelu] inputs: [799 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_84 for ONNX node: LeakyRelu_84 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 533 for ONNX tensor: 533 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_84 [LeakyRelu] outputs: [533 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_85 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 533 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 803 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 804 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_85 [Conv] inputs: [533 -> (-1, 128, -1, -1)], [803 -> (128, 128, 3, 3)], [804 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_85 for ONNX node: Conv_85 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 802 for ONNX tensor: 802 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_85 [Conv] outputs: [802 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_86 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 802 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_86 [LeakyRelu] inputs: [802 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_86 for ONNX node: LeakyRelu_86 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 536 for ONNX tensor: 536 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_86 [LeakyRelu] outputs: [536 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_87 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 536 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 530 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_87 [Add] inputs: [536 -> (-1, 128, -1, -1)], [530 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_87 for ONNX node: Add_87 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 537 for ONNX tensor: 537 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_87 [Add] outputs: [537 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_88 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 537 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 806 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 807 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_88 [Conv] inputs: [537 -> (-1, 128, -1, -1)], [806 -> (128, 128, 1, 1)], [807 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_88 for ONNX node: Conv_88 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 805 for ONNX tensor: 805 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_88 [Conv] outputs: [805 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_89 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 805 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_89 [LeakyRelu] inputs: [805 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_89 for ONNX node: LeakyRelu_89 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 540 for ONNX tensor: 540 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_89 [LeakyRelu] outputs: [540 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_90 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 540 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 809 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 810 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_90 [Conv] inputs: [540 -> (-1, 128, -1, -1)], [809 -> (128, 128, 3, 3)], [810 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_90 for ONNX node: Conv_90 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 808 for ONNX tensor: 808 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_90 [Conv] outputs: [808 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_91 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 808 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_91 [LeakyRelu] inputs: [808 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_91 for ONNX node: LeakyRelu_91 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 543 for ONNX tensor: 543 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_91 [LeakyRelu] outputs: [543 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_92 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 543 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 537 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_92 [Add] inputs: [543 -> (-1, 128, -1, -1)], [537 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_92 for ONNX node: Add_92 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 544 for ONNX tensor: 544 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_92 [Add] outputs: [544 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_93 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 544 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 812 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 813 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_93 [Conv] inputs: [544 -> (-1, 128, -1, -1)], [812 -> (128, 128, 1, 1)], [813 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_93 for ONNX node: Conv_93 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 811 for ONNX tensor: 811 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_93 [Conv] outputs: [811 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_94 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 811 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_94 [LeakyRelu] inputs: [811 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_94 for ONNX node: LeakyRelu_94 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 547 for ONNX tensor: 547 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_94 [LeakyRelu] outputs: [547 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_95 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 547 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 815 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 816 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_95 [Conv] inputs: [547 -> (-1, 128, -1, -1)], [815 -> (128, 128, 3, 3)], [816 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_95 for ONNX node: Conv_95 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 814 for ONNX tensor: 814 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_95 [Conv] outputs: [814 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_96 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 814 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_96 [LeakyRelu] inputs: [814 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_96 for ONNX node: LeakyRelu_96 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 550 for ONNX tensor: 550 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_96 [LeakyRelu] outputs: [550 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_97 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 550 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 544 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_97 [Add] inputs: [550 -> (-1, 128, -1, -1)], [544 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_97 for ONNX node: Add_97 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 551 for ONNX tensor: 551 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_97 [Add] outputs: [551 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_98 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 551 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 818 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 819 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_98 [Conv] inputs: [551 -> (-1, 128, -1, -1)], [818 -> (128, 128, 1, 1)], [819 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_98 for ONNX node: Conv_98 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 817 for ONNX tensor: 817 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_98 [Conv] outputs: [817 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_99 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 817 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_99 [LeakyRelu] inputs: [817 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_99 for ONNX node: LeakyRelu_99 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 554 for ONNX tensor: 554 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_99 [LeakyRelu] outputs: [554 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_100 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 554 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 821 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 822 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_100 [Conv] inputs: [554 -> (-1, 128, -1, -1)], [821 -> (128, 128, 3, 3)], [822 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_100 for ONNX node: Conv_100 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 820 for ONNX tensor: 820 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_100 [Conv] outputs: [820 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_101 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 820 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_101 [LeakyRelu] inputs: [820 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_101 for ONNX node: LeakyRelu_101 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 557 for ONNX tensor: 557 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_101 [LeakyRelu] outputs: [557 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_102 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 557 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 551 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_102 [Add] inputs: [557 -> (-1, 128, -1, -1)], [551 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_102 for ONNX node: Add_102 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 558 for ONNX tensor: 558 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_102 [Add] outputs: [558 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_103 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 558 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 824 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 825 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_103 [Conv] inputs: [558 -> (-1, 128, -1, -1)], [824 -> (128, 128, 1, 1)], [825 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_103 for ONNX node: Conv_103 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 823 for ONNX tensor: 823 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_103 [Conv] outputs: [823 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_104 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 823 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_104 [LeakyRelu] inputs: [823 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_104 for ONNX node: LeakyRelu_104 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 561 for ONNX tensor: 561 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_104 [LeakyRelu] outputs: [561 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_105 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 561 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 827 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 828 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_105 [Conv] inputs: [561 -> (-1, 128, -1, -1)], [827 -> (128, 128, 3, 3)], [828 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_105 for ONNX node: Conv_105 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 826 for ONNX tensor: 826 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_105 [Conv] outputs: [826 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_106 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 826 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_106 [LeakyRelu] inputs: [826 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_106 for ONNX node: LeakyRelu_106 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 564 for ONNX tensor: 564 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_106 [LeakyRelu] outputs: [564 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_107 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 564 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 558 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_107 [Add] inputs: [564 -> (-1, 128, -1, -1)], [558 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_107 for ONNX node: Add_107 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 565 for ONNX tensor: 565 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_107 [Add] outputs: [565 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_108 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 565 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 830 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 831 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_108 [Conv] inputs: [565 -> (-1, 128, -1, -1)], [830 -> (128, 128, 1, 1)], [831 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_108 for ONNX node: Conv_108 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 829 for ONNX tensor: 829 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_108 [Conv] outputs: [829 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_109 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 829 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_109 [LeakyRelu] inputs: [829 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_109 for ONNX node: LeakyRelu_109 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 568 for ONNX tensor: 568 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_109 [LeakyRelu] outputs: [568 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_110 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 568 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 833 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 834 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_110 [Conv] inputs: [568 -> (-1, 128, -1, -1)], [833 -> (128, 128, 3, 3)], [834 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_110 for ONNX node: Conv_110 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 832 for ONNX tensor: 832 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_110 [Conv] outputs: [832 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_111 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 832 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_111 [LeakyRelu] inputs: [832 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_111 for ONNX node: LeakyRelu_111 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 571 for ONNX tensor: 571 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_111 [LeakyRelu] outputs: [571 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_112 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 571 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 565 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_112 [Add] inputs: [571 -> (-1, 128, -1, -1)], [565 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_112 for ONNX node: Add_112 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 572 for ONNX tensor: 572 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_112 [Add] outputs: [572 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_113 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 572 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 836 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 837 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_113 [Conv] inputs: [572 -> (-1, 128, -1, -1)], [836 -> (128, 128, 1, 1)], [837 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_113 for ONNX node: Conv_113 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 835 for ONNX tensor: 835 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_113 [Conv] outputs: [835 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_114 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 835 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_114 [LeakyRelu] inputs: [835 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_114 for ONNX node: LeakyRelu_114 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 575 for ONNX tensor: 575 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_114 [LeakyRelu] outputs: [575 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_115 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 575 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 839 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 840 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_115 [Conv] inputs: [575 -> (-1, 128, -1, -1)], [839 -> (128, 128, 3, 3)], [840 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_115 for ONNX node: Conv_115 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 838 for ONNX tensor: 838 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_115 [Conv] outputs: [838 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_116 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 838 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_116 [LeakyRelu] inputs: [838 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_116 for ONNX node: LeakyRelu_116 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 578 for ONNX tensor: 578 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_116 [LeakyRelu] outputs: [578 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_117 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 578 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 572 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_117 [Add] inputs: [578 -> (-1, 128, -1, -1)], [572 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_117 for ONNX node: Add_117 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 579 for ONNX tensor: 579 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_117 [Add] outputs: [579 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_118 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 579 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 842 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 843 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_118 [Conv] inputs: [579 -> (-1, 128, -1, -1)], [842 -> (128, 128, 1, 1)], [843 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_118 for ONNX node: Conv_118 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 841 for ONNX tensor: 841 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_118 [Conv] outputs: [841 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_119 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 841 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_119 [LeakyRelu] inputs: [841 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_119 for ONNX node: LeakyRelu_119 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 582 for ONNX tensor: 582 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_119 [LeakyRelu] outputs: [582 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Concat_120 [Concat] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 516 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 582 [TensorRT] VERBOSE: ModelImporter.cpp:125: Concat_120 [Concat] inputs: [516 -> (-1, -1, -1, -1)], [582 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Concat_120 for ONNX node: Concat_120 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 583 for ONNX tensor: 583 [TensorRT] VERBOSE: ModelImporter.cpp:179: Concat_120 [Concat] outputs: [583 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_121 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 583 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 845 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 846 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_121 [Conv] inputs: [583 -> (-1, -1, -1, -1)], [845 -> (256, 256, 1, 1)], [846 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_121 for ONNX node: Conv_121 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 844 for ONNX tensor: 844 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_121 [Conv] outputs: [844 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_122 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 844 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_122 [LeakyRelu] inputs: [844 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_122 for ONNX node: LeakyRelu_122 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 586 for ONNX tensor: 586 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_122 [LeakyRelu] outputs: [586 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_123 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 586 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 848 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 849 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_123 [Conv] inputs: [586 -> (-1, 256, -1, -1)], [848 -> (512, 256, 3, 3)], [849 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_123 for ONNX node: Conv_123 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 847 for ONNX tensor: 847 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_123 [Conv] outputs: [847 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_124 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 847 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_124 [LeakyRelu] inputs: [847 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_124 for ONNX node: LeakyRelu_124 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 589 for ONNX tensor: 589 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_124 [LeakyRelu] outputs: [589 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_125 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 589 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 851 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 852 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_125 [Conv] inputs: [589 -> (-1, 512, -1, -1)], [851 -> (512, 512, 1, 1)], [852 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_125 for ONNX node: Conv_125 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 850 for ONNX tensor: 850 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_125 [Conv] outputs: [850 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_126 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 850 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_126 [LeakyRelu] inputs: [850 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_126 for ONNX node: LeakyRelu_126 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 592 for ONNX tensor: 592 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_126 [LeakyRelu] outputs: [592 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Shape_127 [Shape] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 592 [TensorRT] VERBOSE: ModelImporter.cpp:125: Shape_127 [Shape] inputs: [592 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Shape_127 for ONNX node: Shape_127 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 593 for ONNX tensor: 593 [TensorRT] VERBOSE: ModelImporter.cpp:179: Shape_127 [Shape] outputs: [593 -> (4)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_128 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_128 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_128 [Constant] outputs: [594 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gather_129 [Gather] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 593 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 594 [TensorRT] VERBOSE: ModelImporter.cpp:125: Gather_129 [Gather] inputs: [593 -> (4)], [594 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:986: Using Gather axis: 0 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gather_129 for ONNX node: Gather_129 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 595 for ONNX tensor: 595 [TensorRT] VERBOSE: ModelImporter.cpp:179: Gather_129 [Gather] outputs: [595 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_130 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_130 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_130 [Constant] outputs: [596 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Div_131 [Div] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 595 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 596 [TensorRT] VERBOSE: ModelImporter.cpp:125: Div_131 [Div] inputs: [595 -> ()], [596 -> ()], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Div_131 for ONNX node: Div_131 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 597 for ONNX tensor: 597 [TensorRT] VERBOSE: ModelImporter.cpp:179: Div_131 [Div] outputs: [597 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_132 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 597 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_132 [Cast] inputs: [597 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_132 for ONNX node: Cast_132 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 598 for ONNX tensor: 598 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_132 [Cast] outputs: [598 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_133 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 598 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_133 [Cast] inputs: [598 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_133 for ONNX node: Cast_133 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 599 for ONNX tensor: 599 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_133 [Cast] outputs: [599 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_134 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 599 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_134 [Unsqueeze] inputs: [599 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_134 for ONNX node: Unsqueeze_134 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 603 for ONNX tensor: 603 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_134 [Unsqueeze] outputs: [603 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_135 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_135 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_135 [Constant] outputs: [605 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_136 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 592 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 955 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 603 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 956 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 605 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_136 [Slice] inputs: [592 -> (-1, 512, -1, -1)], [955 -> (1)], [603 -> (1)], [956 -> (1)], [605 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_136 for ONNX node: Slice_136 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 606 for ONNX tensor: 606 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_136 [Slice] outputs: [606 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_137 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 599 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_137 [Unsqueeze] inputs: [599 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_137 for ONNX node: Unsqueeze_137 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 609 for ONNX tensor: 609 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_137 [Unsqueeze] outputs: [609 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_138 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_138 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_138 [Constant] outputs: [612 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_139 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 592 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 609 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 957 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 958 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 612 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_139 [Slice] inputs: [592 -> (-1, 512, -1, -1)], [609 -> (1)], [957 -> (1)], [958 -> (1)], [612 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_139 for ONNX node: Slice_139 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 613 for ONNX tensor: 613 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_139 [Slice] outputs: [613 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_140 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 613 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 854 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 855 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_140 [Conv] inputs: [613 -> (-1, -1, -1, -1)], [854 -> (256, 256, 1, 1)], [855 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_140 for ONNX node: Conv_140 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 853 for ONNX tensor: 853 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_140 [Conv] outputs: [853 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_141 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 853 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_141 [LeakyRelu] inputs: [853 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_141 for ONNX node: LeakyRelu_141 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 616 for ONNX tensor: 616 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_141 [LeakyRelu] outputs: [616 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_142 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 616 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 857 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 858 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_142 [Conv] inputs: [616 -> (-1, 256, -1, -1)], [857 -> (256, 256, 3, 3)], [858 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_142 for ONNX node: Conv_142 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 856 for ONNX tensor: 856 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_142 [Conv] outputs: [856 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_143 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 856 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_143 [LeakyRelu] inputs: [856 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_143 for ONNX node: LeakyRelu_143 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 619 for ONNX tensor: 619 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_143 [LeakyRelu] outputs: [619 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_144 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 619 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 613 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_144 [Add] inputs: [619 -> (-1, 256, -1, -1)], [613 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_144 for ONNX node: Add_144 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 620 for ONNX tensor: 620 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_144 [Add] outputs: [620 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_145 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 620 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 860 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 861 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_145 [Conv] inputs: [620 -> (-1, 256, -1, -1)], [860 -> (256, 256, 1, 1)], [861 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_145 for ONNX node: Conv_145 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 859 for ONNX tensor: 859 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_145 [Conv] outputs: [859 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_146 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 859 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_146 [LeakyRelu] inputs: [859 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_146 for ONNX node: LeakyRelu_146 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 623 for ONNX tensor: 623 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_146 [LeakyRelu] outputs: [623 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_147 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 623 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 863 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 864 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_147 [Conv] inputs: [623 -> (-1, 256, -1, -1)], [863 -> (256, 256, 3, 3)], [864 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_147 for ONNX node: Conv_147 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 862 for ONNX tensor: 862 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_147 [Conv] outputs: [862 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_148 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 862 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_148 [LeakyRelu] inputs: [862 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_148 for ONNX node: LeakyRelu_148 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 626 for ONNX tensor: 626 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_148 [LeakyRelu] outputs: [626 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_149 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 626 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 620 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_149 [Add] inputs: [626 -> (-1, 256, -1, -1)], [620 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_149 for ONNX node: Add_149 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 627 for ONNX tensor: 627 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_149 [Add] outputs: [627 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_150 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 627 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 866 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 867 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_150 [Conv] inputs: [627 -> (-1, 256, -1, -1)], [866 -> (256, 256, 1, 1)], [867 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_150 for ONNX node: Conv_150 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 865 for ONNX tensor: 865 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_150 [Conv] outputs: [865 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_151 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 865 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_151 [LeakyRelu] inputs: [865 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_151 for ONNX node: LeakyRelu_151 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 630 for ONNX tensor: 630 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_151 [LeakyRelu] outputs: [630 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_152 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 630 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 869 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 870 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_152 [Conv] inputs: [630 -> (-1, 256, -1, -1)], [869 -> (256, 256, 3, 3)], [870 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_152 for ONNX node: Conv_152 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 868 for ONNX tensor: 868 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_152 [Conv] outputs: [868 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_153 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 868 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_153 [LeakyRelu] inputs: [868 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_153 for ONNX node: LeakyRelu_153 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 633 for ONNX tensor: 633 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_153 [LeakyRelu] outputs: [633 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_154 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 633 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 627 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_154 [Add] inputs: [633 -> (-1, 256, -1, -1)], [627 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_154 for ONNX node: Add_154 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 634 for ONNX tensor: 634 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_154 [Add] outputs: [634 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_155 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 634 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 872 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 873 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_155 [Conv] inputs: [634 -> (-1, 256, -1, -1)], [872 -> (256, 256, 1, 1)], [873 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_155 for ONNX node: Conv_155 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 871 for ONNX tensor: 871 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_155 [Conv] outputs: [871 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_156 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 871 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_156 [LeakyRelu] inputs: [871 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_156 for ONNX node: LeakyRelu_156 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 637 for ONNX tensor: 637 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_156 [LeakyRelu] outputs: [637 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_157 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 637 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 875 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 876 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_157 [Conv] inputs: [637 -> (-1, 256, -1, -1)], [875 -> (256, 256, 3, 3)], [876 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_157 for ONNX node: Conv_157 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 874 for ONNX tensor: 874 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_157 [Conv] outputs: [874 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_158 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 874 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_158 [LeakyRelu] inputs: [874 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_158 for ONNX node: LeakyRelu_158 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 640 for ONNX tensor: 640 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_158 [LeakyRelu] outputs: [640 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_159 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 640 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 634 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_159 [Add] inputs: [640 -> (-1, 256, -1, -1)], [634 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_159 for ONNX node: Add_159 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 641 for ONNX tensor: 641 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_159 [Add] outputs: [641 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_160 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 641 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 878 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 879 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_160 [Conv] inputs: [641 -> (-1, 256, -1, -1)], [878 -> (256, 256, 1, 1)], [879 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_160 for ONNX node: Conv_160 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 877 for ONNX tensor: 877 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_160 [Conv] outputs: [877 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_161 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 877 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_161 [LeakyRelu] inputs: [877 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_161 for ONNX node: LeakyRelu_161 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 644 for ONNX tensor: 644 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_161 [LeakyRelu] outputs: [644 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_162 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 644 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 881 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 882 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_162 [Conv] inputs: [644 -> (-1, 256, -1, -1)], [881 -> (256, 256, 3, 3)], [882 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_162 for ONNX node: Conv_162 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 880 for ONNX tensor: 880 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_162 [Conv] outputs: [880 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_163 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 880 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_163 [LeakyRelu] inputs: [880 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_163 for ONNX node: LeakyRelu_163 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 647 for ONNX tensor: 647 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_163 [LeakyRelu] outputs: [647 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_164 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 647 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 641 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_164 [Add] inputs: [647 -> (-1, 256, -1, -1)], [641 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_164 for ONNX node: Add_164 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 648 for ONNX tensor: 648 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_164 [Add] outputs: [648 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_165 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 648 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 884 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 885 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_165 [Conv] inputs: [648 -> (-1, 256, -1, -1)], [884 -> (256, 256, 1, 1)], [885 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_165 for ONNX node: Conv_165 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 883 for ONNX tensor: 883 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_165 [Conv] outputs: [883 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_166 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 883 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_166 [LeakyRelu] inputs: [883 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_166 for ONNX node: LeakyRelu_166 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 651 for ONNX tensor: 651 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_166 [LeakyRelu] outputs: [651 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_167 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 651 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 887 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 888 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_167 [Conv] inputs: [651 -> (-1, 256, -1, -1)], [887 -> (256, 256, 3, 3)], [888 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_167 for ONNX node: Conv_167 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 886 for ONNX tensor: 886 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_167 [Conv] outputs: [886 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_168 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 886 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_168 [LeakyRelu] inputs: [886 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_168 for ONNX node: LeakyRelu_168 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 654 for ONNX tensor: 654 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_168 [LeakyRelu] outputs: [654 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_169 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 654 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 648 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_169 [Add] inputs: [654 -> (-1, 256, -1, -1)], [648 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_169 for ONNX node: Add_169 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 655 for ONNX tensor: 655 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_169 [Add] outputs: [655 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_170 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 655 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 890 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 891 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_170 [Conv] inputs: [655 -> (-1, 256, -1, -1)], [890 -> (256, 256, 1, 1)], [891 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_170 for ONNX node: Conv_170 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 889 for ONNX tensor: 889 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_170 [Conv] outputs: [889 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_171 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 889 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_171 [LeakyRelu] inputs: [889 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_171 for ONNX node: LeakyRelu_171 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 658 for ONNX tensor: 658 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_171 [LeakyRelu] outputs: [658 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_172 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 658 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 893 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 894 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_172 [Conv] inputs: [658 -> (-1, 256, -1, -1)], [893 -> (256, 256, 3, 3)], [894 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_172 for ONNX node: Conv_172 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 892 for ONNX tensor: 892 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_172 [Conv] outputs: [892 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_173 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 892 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_173 [LeakyRelu] inputs: [892 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_173 for ONNX node: LeakyRelu_173 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 661 for ONNX tensor: 661 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_173 [LeakyRelu] outputs: [661 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_174 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 661 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 655 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_174 [Add] inputs: [661 -> (-1, 256, -1, -1)], [655 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_174 for ONNX node: Add_174 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 662 for ONNX tensor: 662 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_174 [Add] outputs: [662 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_175 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 662 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 896 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 897 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_175 [Conv] inputs: [662 -> (-1, 256, -1, -1)], [896 -> (256, 256, 1, 1)], [897 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_175 for ONNX node: Conv_175 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 895 for ONNX tensor: 895 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_175 [Conv] outputs: [895 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_176 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 895 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_176 [LeakyRelu] inputs: [895 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_176 for ONNX node: LeakyRelu_176 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 665 for ONNX tensor: 665 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_176 [LeakyRelu] outputs: [665 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_177 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 665 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 899 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 900 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_177 [Conv] inputs: [665 -> (-1, 256, -1, -1)], [899 -> (256, 256, 3, 3)], [900 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_177 for ONNX node: Conv_177 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 898 for ONNX tensor: 898 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_177 [Conv] outputs: [898 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_178 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 898 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_178 [LeakyRelu] inputs: [898 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_178 for ONNX node: LeakyRelu_178 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 668 for ONNX tensor: 668 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_178 [LeakyRelu] outputs: [668 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_179 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 668 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 662 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_179 [Add] inputs: [668 -> (-1, 256, -1, -1)], [662 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_179 for ONNX node: Add_179 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 669 for ONNX tensor: 669 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_179 [Add] outputs: [669 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_180 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 669 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 902 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 903 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_180 [Conv] inputs: [669 -> (-1, 256, -1, -1)], [902 -> (256, 256, 1, 1)], [903 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_180 for ONNX node: Conv_180 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 901 for ONNX tensor: 901 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_180 [Conv] outputs: [901 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_181 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 901 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_181 [LeakyRelu] inputs: [901 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_181 for ONNX node: LeakyRelu_181 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 672 for ONNX tensor: 672 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_181 [LeakyRelu] outputs: [672 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Concat_182 [Concat] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 606 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 672 [TensorRT] VERBOSE: ModelImporter.cpp:125: Concat_182 [Concat] inputs: [606 -> (-1, -1, -1, -1)], [672 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Concat_182 for ONNX node: Concat_182 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 673 for ONNX tensor: 673 [TensorRT] VERBOSE: ModelImporter.cpp:179: Concat_182 [Concat] outputs: [673 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_183 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 673 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 905 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 906 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_183 [Conv] inputs: [673 -> (-1, -1, -1, -1)], [905 -> (512, 512, 1, 1)], [906 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_183 for ONNX node: Conv_183 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 904 for ONNX tensor: 904 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_183 [Conv] outputs: [904 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_184 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 904 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_184 [LeakyRelu] inputs: [904 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_184 for ONNX node: LeakyRelu_184 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 676 for ONNX tensor: 676 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_184 [LeakyRelu] outputs: [676 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_185 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 676 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 908 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 909 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_185 [Conv] inputs: [676 -> (-1, 512, -1, -1)], [908 -> (1024, 512, 3, 3)], [909 -> (1024)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_185 for ONNX node: Conv_185 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1024 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 1024, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 907 for ONNX tensor: 907 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_185 [Conv] outputs: [907 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_186 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 907 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_186 [LeakyRelu] inputs: [907 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_186 for ONNX node: LeakyRelu_186 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 679 for ONNX tensor: 679 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_186 [LeakyRelu] outputs: [679 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_187 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 679 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 911 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 912 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_187 [Conv] inputs: [679 -> (-1, 1024, -1, -1)], [911 -> (1024, 1024, 1, 1)], [912 -> (1024)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 1024, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_187 for ONNX node: Conv_187 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 1024, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 910 for ONNX tensor: 910 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_187 [Conv] outputs: [910 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_188 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 910 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_188 [LeakyRelu] inputs: [910 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_188 for ONNX node: LeakyRelu_188 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 682 for ONNX tensor: 682 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_188 [LeakyRelu] outputs: [682 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Shape_189 [Shape] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 682 [TensorRT] VERBOSE: ModelImporter.cpp:125: Shape_189 [Shape] inputs: [682 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Shape_189 for ONNX node: Shape_189 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 683 for ONNX tensor: 683 [TensorRT] VERBOSE: ModelImporter.cpp:179: Shape_189 [Shape] outputs: [683 -> (4)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_190 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_190 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_190 [Constant] outputs: [684 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gather_191 [Gather] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 683 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 684 [TensorRT] VERBOSE: ModelImporter.cpp:125: Gather_191 [Gather] inputs: [683 -> (4)], [684 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:986: Using Gather axis: 0 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gather_191 for ONNX node: Gather_191 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 685 for ONNX tensor: 685 [TensorRT] VERBOSE: ModelImporter.cpp:179: Gather_191 [Gather] outputs: [685 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_192 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_192 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_192 [Constant] outputs: [686 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Div_193 [Div] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 685 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 686 [TensorRT] VERBOSE: ModelImporter.cpp:125: Div_193 [Div] inputs: [685 -> ()], [686 -> ()], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Div_193 for ONNX node: Div_193 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 687 for ONNX tensor: 687 [TensorRT] VERBOSE: ModelImporter.cpp:179: Div_193 [Div] outputs: [687 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_194 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 687 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_194 [Cast] inputs: [687 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_194 for ONNX node: Cast_194 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 688 for ONNX tensor: 688 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_194 [Cast] outputs: [688 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_195 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 688 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_195 [Cast] inputs: [688 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_195 for ONNX node: Cast_195 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 689 for ONNX tensor: 689 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_195 [Cast] outputs: [689 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_196 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 689 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_196 [Unsqueeze] inputs: [689 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_196 for ONNX node: Unsqueeze_196 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 693 for ONNX tensor: 693 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_196 [Unsqueeze] outputs: [693 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_197 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_197 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_197 [Constant] outputs: [695 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_198 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 682 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 959 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 693 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 960 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 695 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_198 [Slice] inputs: [682 -> (-1, 1024, -1, -1)], [959 -> (1)], [693 -> (1)], [960 -> (1)], [695 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_198 for ONNX node: Slice_198 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 696 for ONNX tensor: 696 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_198 [Slice] outputs: [696 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_199 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 689 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_199 [Unsqueeze] inputs: [689 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_199 for ONNX node: Unsqueeze_199 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 699 for ONNX tensor: 699 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_199 [Unsqueeze] outputs: [699 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_200 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_200 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_200 [Constant] outputs: [702 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_201 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 682 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 699 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 961 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 962 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 702 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_201 [Slice] inputs: [682 -> (-1, 1024, -1, -1)], [699 -> (1)], [961 -> (1)], [962 -> (1)], [702 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_201 for ONNX node: Slice_201 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 703 for ONNX tensor: 703 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_201 [Slice] outputs: [703 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_202 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 703 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 914 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 915 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_202 [Conv] inputs: [703 -> (-1, -1, -1, -1)], [914 -> (512, 512, 1, 1)], [915 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_202 for ONNX node: Conv_202 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 913 for ONNX tensor: 913 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_202 [Conv] outputs: [913 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_203 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 913 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_203 [LeakyRelu] inputs: [913 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_203 for ONNX node: LeakyRelu_203 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 706 for ONNX tensor: 706 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_203 [LeakyRelu] outputs: [706 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_204 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 706 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 917 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 918 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_204 [Conv] inputs: [706 -> (-1, 512, -1, -1)], [917 -> (512, 512, 3, 3)], [918 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_204 for ONNX node: Conv_204 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 916 for ONNX tensor: 916 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_204 [Conv] outputs: [916 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_205 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 916 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_205 [LeakyRelu] inputs: [916 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_205 for ONNX node: LeakyRelu_205 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 709 for ONNX tensor: 709 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_205 [LeakyRelu] outputs: [709 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_206 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 709 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 703 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_206 [Add] inputs: [709 -> (-1, 512, -1, -1)], [703 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_206 for ONNX node: Add_206 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 710 for ONNX tensor: 710 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_206 [Add] outputs: [710 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_207 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 710 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 920 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 921 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_207 [Conv] inputs: [710 -> (-1, 512, -1, -1)], [920 -> (512, 512, 1, 1)], [921 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_207 for ONNX node: Conv_207 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 919 for ONNX tensor: 919 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_207 [Conv] outputs: [919 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_208 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 919 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_208 [LeakyRelu] inputs: [919 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_208 for ONNX node: LeakyRelu_208 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 713 for ONNX tensor: 713 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_208 [LeakyRelu] outputs: [713 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_209 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 713 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 923 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 924 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_209 [Conv] inputs: [713 -> (-1, 512, -1, -1)], [923 -> (512, 512, 3, 3)], [924 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_209 for ONNX node: Conv_209 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 922 for ONNX tensor: 922 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_209 [Conv] outputs: [922 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_210 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 922 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_210 [LeakyRelu] inputs: [922 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_210 for ONNX node: LeakyRelu_210 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 716 for ONNX tensor: 716 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_210 [LeakyRelu] outputs: [716 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_211 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 716 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 710 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_211 [Add] inputs: [716 -> (-1, 512, -1, -1)], [710 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_211 for ONNX node: Add_211 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 717 for ONNX tensor: 717 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_211 [Add] outputs: [717 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_212 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 717 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 926 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 927 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_212 [Conv] inputs: [717 -> (-1, 512, -1, -1)], [926 -> (512, 512, 1, 1)], [927 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_212 for ONNX node: Conv_212 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 925 for ONNX tensor: 925 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_212 [Conv] outputs: [925 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_213 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 925 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_213 [LeakyRelu] inputs: [925 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_213 for ONNX node: LeakyRelu_213 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 720 for ONNX tensor: 720 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_213 [LeakyRelu] outputs: [720 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_214 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 720 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 929 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 930 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_214 [Conv] inputs: [720 -> (-1, 512, -1, -1)], [929 -> (512, 512, 3, 3)], [930 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_214 for ONNX node: Conv_214 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 928 for ONNX tensor: 928 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_214 [Conv] outputs: [928 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_215 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 928 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_215 [LeakyRelu] inputs: [928 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_215 for ONNX node: LeakyRelu_215 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 723 for ONNX tensor: 723 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_215 [LeakyRelu] outputs: [723 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_216 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 723 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 717 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_216 [Add] inputs: [723 -> (-1, 512, -1, -1)], [717 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_216 for ONNX node: Add_216 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 724 for ONNX tensor: 724 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_216 [Add] outputs: [724 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_217 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 724 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 932 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 933 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_217 [Conv] inputs: [724 -> (-1, 512, -1, -1)], [932 -> (512, 512, 1, 1)], [933 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_217 for ONNX node: Conv_217 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 931 for ONNX tensor: 931 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_217 [Conv] outputs: [931 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_218 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 931 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_218 [LeakyRelu] inputs: [931 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_218 for ONNX node: LeakyRelu_218 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 727 for ONNX tensor: 727 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_218 [LeakyRelu] outputs: [727 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_219 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 727 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 935 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 936 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_219 [Conv] inputs: [727 -> (-1, 512, -1, -1)], [935 -> (512, 512, 3, 3)], [936 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_219 for ONNX node: Conv_219 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 934 for ONNX tensor: 934 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_219 [Conv] outputs: [934 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_220 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 934 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_220 [LeakyRelu] inputs: [934 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_220 for ONNX node: LeakyRelu_220 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 730 for ONNX tensor: 730 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_220 [LeakyRelu] outputs: [730 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_221 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 730 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 724 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_221 [Add] inputs: [730 -> (-1, 512, -1, -1)], [724 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_221 for ONNX node: Add_221 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 731 for ONNX tensor: 731 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_221 [Add] outputs: [731 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_222 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 731 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 938 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 939 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_222 [Conv] inputs: [731 -> (-1, 512, -1, -1)], [938 -> (512, 512, 1, 1)], [939 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_222 for ONNX node: Conv_222 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 937 for ONNX tensor: 937 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_222 [Conv] outputs: [937 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_223 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 937 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_223 [LeakyRelu] inputs: [937 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_223 for ONNX node: LeakyRelu_223 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 734 for ONNX tensor: 734 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_223 [LeakyRelu] outputs: [734 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Concat_224 [Concat] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 696 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 734 [TensorRT] VERBOSE: ModelImporter.cpp:125: Concat_224 [Concat] inputs: [696 -> (-1, -1, -1, -1)], [734 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Concat_224 for ONNX node: Concat_224 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 735 for ONNX tensor: 735 [TensorRT] VERBOSE: ModelImporter.cpp:179: Concat_224 [Concat] outputs: [735 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_225 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 735 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 941 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 942 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_225 [Conv] inputs: [735 -> (-1, -1, -1, -1)], [941 -> (1024, 1024, 1, 1)], [942 -> (1024)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_225 for ONNX node: Conv_225 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 1024, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 940 for ONNX tensor: 940 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_225 [Conv] outputs: [940 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_226 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 940 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_226 [LeakyRelu] inputs: [940 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_226 for ONNX node: LeakyRelu_226 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 738 for ONNX tensor: 738 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_226 [LeakyRelu] outputs: [738 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: GlobalAveragePool_227 [GlobalAveragePool] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 738 [TensorRT] VERBOSE: ModelImporter.cpp:125: GlobalAveragePool_227 [GlobalAveragePool] inputs: [738 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: GlobalAveragePool_227 for ONNX node: GlobalAveragePool_227 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 739 for ONNX tensor: 739 [TensorRT] VERBOSE: ModelImporter.cpp:179: GlobalAveragePool_227 [GlobalAveragePool] outputs: [739 -> (-1, 1024, 1, 1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Flatten_228 [Flatten] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 739 [TensorRT] VERBOSE: ModelImporter.cpp:125: Flatten_228 [Flatten] inputs: [739 -> (-1, 1024, 1, 1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Flatten_228 for ONNX node: Flatten_228 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 740 for ONNX tensor: 740 [TensorRT] VERBOSE: ModelImporter.cpp:179: Flatten_228 [Flatten] outputs: [740 -> (-1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gemm_229 [Gemm] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 740 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: head.fc.weight [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: head.fc.bias [TensorRT] VERBOSE: ModelImporter.cpp:125: Gemm_229 [Gemm] inputs: [740 -> (-1, -1)], [head.fc.weight -> (3, 1024)], [head.fc.bias -> (3)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: head.fc.weight for ONNX node: head.fc.weight [TensorRT] VERBOSE: builtin_op_importers.cpp:1083: Using opA: 0 opB: 0 [TensorRT] VERBOSE: builtin_op_importers.cpp:1084: GEMM: A, after squeezing: (-1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gemm_229 for ONNX node: Gemm_229 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: output_1 for ONNX tensor: output [TensorRT] VERBOSE: ModelImporter.cpp:179: Gemm_229 [Gemm] outputs: [output -> (-1, 3)], [TensorRT] VERBOSE: ModelImporter.cpp:507: Marking output_1 as output: output [TensorRT] VERBOSE: Original: 179 layers [TensorRT] VERBOSE: After dead-layer removal: 179 layers [TensorRT] VERBOSE: After scale fusion: 179 layers [TensorRT] VERBOSE: After vertical fusions: 179 layers [TensorRT] VERBOSE: After final dead-layer removal: 179 layers [TensorRT] VERBOSE: Eliminating concatenation Concat_26 [TensorRT] VERBOSE: Generating copy for 427 to 445 [TensorRT] VERBOSE: Generating copy for 444 to 445 [TensorRT] VERBOSE: Eliminating concatenation Concat_58 [TensorRT] VERBOSE: Generating copy for 468 to 493 [TensorRT] VERBOSE: Generating copy for 492 to 493 [TensorRT] VERBOSE: Eliminating concatenation Concat_120 [TensorRT] VERBOSE: Generating copy for 516 to 583 [TensorRT] VERBOSE: Generating copy for 582 to 583 [TensorRT] VERBOSE: Eliminating concatenation Concat_182 [TensorRT] VERBOSE: Generating copy for 606 to 673 [TensorRT] VERBOSE: Generating copy for 672 to 673 [TensorRT] VERBOSE: Eliminating concatenation Concat_224 [TensorRT] VERBOSE: Generating copy for 696 to 735 [TensorRT] VERBOSE: Generating copy for 734 to 735 [TensorRT] VERBOSE: After concat removal: 184 layers [TensorRT] VERBOSE: After tensor merging: 184 layers [TensorRT] VERBOSE: Constructing optimization profile number 0 [1/1]. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,150528) -> Float(1,224,50176,1605632) *************** [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.425856 [TensorRT] VERBOSE: Tactic: 1825138533642645384 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1825138533642645384 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.267104 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.27136 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.6632 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,1605632) -> Float(1,224,50176,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.227456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176:32,50176) -> Float(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.226752 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.730144 [TensorRT] VERBOSE: Tactic: 458751 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.139808 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.140288 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.311808 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.115744 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.115264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.210848 [TensorRT] VERBOSE: Tactic: 1754569683116234317 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.269504 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.271616 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.59392 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.22656 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,50176) -> Float(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.226304 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.596992 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.311872 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.072704 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.07024 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.161376 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.060416 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,12544) -> Float(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.060384 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.696928 [TensorRT] VERBOSE: Tactic: 524287 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_22 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.116128 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_22 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.115232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816), Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_23 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.086848 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088), Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_23 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.08688 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.626048 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.117312 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.115648 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: 427 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.120576 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 444 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.120064 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 444 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.314016 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.79392 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.11632 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.115712 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.551648 [TensorRT] VERBOSE: Tactic: 458751 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.071904 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.071744 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.1256 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.060704 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.06064 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.327232 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.060512 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.06112 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.123168 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039936 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.066016 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.133856 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039936 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032608 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.03376 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.258016 [TensorRT] VERBOSE: Tactic: 524287 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_49 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032704 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_49 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032768 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704), Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_50 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.02528 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272), Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_50 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.02496 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.065536 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033024 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.03264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_54 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032832 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_54 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0336 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704), Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_55 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.025024 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272), Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_55 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.02448 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032768 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.034144 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: 468 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.033472 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 492 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.033888 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 492 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.069344 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.06128 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.060416 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.560128 [TensorRT] VERBOSE: Tactic: 458751 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040352 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.041056 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.072192 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032768 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033376 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.240384 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032608 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032608 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.072704 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.023808 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040224 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.123776 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.023488 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.248768 [TensorRT] VERBOSE: Tactic: 524287 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_81 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_81 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_82 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014848 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_82 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014784 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039296 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019808 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.018784 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_86 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019168 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_86 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019072 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_87 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.015328 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_87 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01632 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02032 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_91 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0192 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_91 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019648 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_92 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014848 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_92 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014496 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019008 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.020032 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_96 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_96 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019136 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_97 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.015072 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_97 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01472 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019648 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019712 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_101 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_101 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019744 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_102 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.016384 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_102 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014752 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01936 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019552 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_106 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_106 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.018528 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_107 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014976 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_107 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014784 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_111 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01968 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_111 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019552 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_112 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014688 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_112 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014592 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019808 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019168 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_116 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019424 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_116 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_117 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014976 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_117 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014976 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019392 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019968 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: 516 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.019584 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 582 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.020256 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 582 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039616 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033824 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033152 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.511136 [TensorRT] VERBOSE: Tactic: 458751 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.024064 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02528 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.042336 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019744 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019904 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.339936 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019744 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.020032 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.043008 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.013632 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.021376 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.170624 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01328 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01136 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.279648 [TensorRT] VERBOSE: Tactic: 524287 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_143 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011008 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_143 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_144 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009888 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_144 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.008864 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022528 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011296 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_148 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011552 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_148 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_149 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010048 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_149 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01008 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_153 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011424 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_153 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011616 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_154 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.00992 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_154 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010112 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01168 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_158 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011392 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_158 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01184 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_159 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010208 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_159 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010016 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011552 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011552 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_163 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011552 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_163 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011424 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_164 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010368 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_164 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.00896 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_168 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_168 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01152 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_169 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010336 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_169 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009184 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011392 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01136 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_173 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01072 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_173 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_174 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010304 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_174 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010176 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01136 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011072 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_178 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01136 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_178 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_179 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009792 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_179 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009984 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01152 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011424 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: 606 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.008128 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 672 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.008192 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 672 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022528 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019392 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019296 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.708576 [TensorRT] VERBOSE: Tactic: 458751 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016352 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016672 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049568 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010976 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011104 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.6048 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01136 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050912 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010752 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027616 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.298752 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010816 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007776 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007584 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.509312 [TensorRT] VERBOSE: Tactic: 524287 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_205 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00768 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_205 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007744 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_206 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_206 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027712 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007776 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007808 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_210 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00768 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_210 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007744 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_211 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_211 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007584 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007648 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_215 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007872 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_215 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007872 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_216 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.00608 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_216 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00768 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.008192 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_220 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007808 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_220 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007872 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_221 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006112 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_221 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007648 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007712 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: 696 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.00608 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 734 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006016 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 734 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02672 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,1,1,1024) *************** [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (Reduce) [TensorRT] VERBOSE: Tactic: 1 time 0.146272 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,1,1,1024) -> Float(1,1024) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Flatten_228 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 time 0.004192 [TensorRT] VERBOSE: Tactic: 0 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: -> Float(1,3) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,1024), Float(1,3) -> Float(1,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Gemm_229 (MatrixMultiply) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: -> Float(1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1) -> Float(1,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: (Unnamed Layer* 464) [Shuffle] (Shuffle) [TensorRT] VERBOSE: Tactic: 0 time 0.002816 [TensorRT] VERBOSE: Tactic: 0 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,3), Float(1,3) -> Float(1,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: (Unnamed Layer* 465) [ElementWise] (ElementWise) [TensorRT] VERBOSE: Tactic: 1 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0 [TensorRT] VERBOSE: Formats and tactics selection completed in 10.7392 seconds. [TensorRT] VERBOSE: After reformat layers: 184 layers [TensorRT] VERBOSE: Block size 6422528 [TensorRT] VERBOSE: Block size 6422528 [TensorRT] VERBOSE: Block size 3211264 [TensorRT] VERBOSE: Block size 3211264 [TensorRT] VERBOSE: Block size 802816 [TensorRT] VERBOSE: Block size 401408 [TensorRT] VERBOSE: Block size 1 [TensorRT] VERBOSE: Total Activation Memory: 20471809 [TensorRT] INFO: Detected 1 inputs and 1 output network tensors. [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Layer: Conv_0 Weights: 0 HostPersistent: 2176 DevicePersistent: 305152 [TensorRT] VERBOSE: Layer: LeakyRelu_1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_2 Weights: 73728 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_3 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_4 Weights: 0 HostPersistent: 3200 DevicePersistent: 109056 [TensorRT] VERBOSE: Layer: LeakyRelu_5 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_15 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_18 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_19 Weights: 8192 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_20 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_21 Weights: 73728 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_22 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_23 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_24 Weights: 16384 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_25 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 427 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 444 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_27 Weights: 32768 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_28 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_29 Weights: 294912 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_30 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_31 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_32 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_42 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_45 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_46 Weights: 16384 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_47 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_48 Weights: 147456 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_49 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_50 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_51 Weights: 16384 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_52 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_53 Weights: 147456 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_54 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_55 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_56 Weights: 16384 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_57 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 468 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 492 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_59 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_60 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_61 Weights: 1179648 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_62 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_63 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_64 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_74 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_77 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_78 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_79 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_80 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_81 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_82 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_83 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_84 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_85 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_86 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_87 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_88 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_89 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_90 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_91 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_92 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_93 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_94 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_95 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_96 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_97 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_98 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_99 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_100 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_101 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_102 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_103 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_104 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_105 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_106 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_107 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_108 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_109 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_110 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_111 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_112 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_113 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_114 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_115 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_116 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_117 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_118 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_119 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 516 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 582 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_121 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_122 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_123 Weights: 4718592 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_124 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_125 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_126 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_136 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_139 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_140 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_141 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_142 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_143 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_144 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_145 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_146 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_147 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_148 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_149 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_150 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_151 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_152 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_153 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_154 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_155 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_156 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_157 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_158 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_159 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_160 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_161 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_162 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_163 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_164 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_165 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_166 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_167 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_168 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_169 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_170 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_171 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_172 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_173 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_174 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_175 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_176 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_177 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_178 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_179 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_180 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_181 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 606 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 672 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_183 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_184 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_185 Weights: 18874368 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_186 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_187 Weights: 4194304 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_188 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_198 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_201 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_202 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_203 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_204 Weights: 9437184 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_205 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_206 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_207 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_208 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_209 Weights: 9437184 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_210 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_211 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_212 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_213 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_214 Weights: 9437184 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_215 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_216 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_217 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_218 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_219 Weights: 9437184 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_220 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_221 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_222 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_223 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 696 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 734 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_225 Weights: 4194304 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_226 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: GlobalAveragePool_227 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Flatten_228 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: head.fc.weight Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Gemm_229 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: (Unnamed Layer* 463) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: (Unnamed Layer* 464) [Shuffle] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: (Unnamed Layer* 465) [ElementWise] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Total Host Persistent Memory: 5376 [TensorRT] VERBOSE: Total Device Persistent Memory: 414208 [TensorRT] VERBOSE: Total Weight Memory: 106291200 [TensorRT] VERBOSE: Builder timing cache: created 68 entries, 415 hit(s) [TensorRT] VERBOSE: Engine generation completed in 12.3575 seconds. [TensorRT] VERBOSE: Calculating Maxima [TensorRT] INFO: Starting Calibration. [TensorRT] INFO: Calibrated batch 0 in 0.234974 seconds. [TensorRT] INFO: Calibrated batch 1 in 0.198163 seconds. [TensorRT] INFO: Calibrated batch 2 in 0.202363 seconds. [TensorRT] INFO: Calibrated batch 3 in 0.200354 seconds. [TensorRT] INFO: Calibrated batch 4 in 0.199611 seconds. [TensorRT] INFO: Calibrated batch 5 in 0.203957 seconds. [TensorRT] INFO: Calibrated batch 6 in 0.191484 seconds. [TensorRT] INFO: Calibrated batch 7 in 0.200052 seconds. [TensorRT] INFO: Calibrated batch 8 in 0.201143 seconds. [TensorRT] INFO: Calibrated batch 9 in 0.198071 seconds. [TensorRT] INFO: Calibrated batch 10 in 0.192125 seconds. [TensorRT] INFO: Calibrated batch 11 in 0.191266 seconds. [TensorRT] INFO: Calibrated batch 12 in 0.193229 seconds. [TensorRT] INFO: Calibrated batch 13 in 0.198962 seconds. [TensorRT] INFO: Calibrated batch 14 in 0.200359 seconds. [TensorRT] INFO: Calibrated batch 15 in 0.192599 seconds. [TensorRT] INFO: Calibrated batch 16 in 0.190664 seconds. [TensorRT] INFO: Calibrated batch 17 in 0.201478 seconds. [TensorRT] INFO: Calibrated batch 18 in 0.193846 seconds. [TensorRT] INFO: Calibrated batch 19 in 0.190746 seconds. [TensorRT] INFO: Calibrated batch 20 in 0.192135 seconds. [TensorRT] INFO: Calibrated batch 21 in 0.190809 seconds. [TensorRT] INFO: Calibrated batch 22 in 0.190187 seconds. [TensorRT] INFO: Calibrated batch 23 in 0.194772 seconds. [TensorRT] INFO: Calibrated batch 24 in 0.200538 seconds. [TensorRT] INFO: Calibrated batch 25 in 0.199846 seconds. [TensorRT] INFO: Calibrated batch 26 in 0.190364 seconds. [TensorRT] INFO: Calibrated batch 27 in 0.190906 seconds. [TensorRT] INFO: Calibrated batch 28 in 0.193611 seconds. [TensorRT] INFO: Calibrated batch 29 in 0.198997 seconds. [TensorRT] INFO: Calibrated batch 30 in 0.199081 seconds. [TensorRT] INFO: Calibrated batch 31 in 0.192181 seconds. [TensorRT] INFO: Calibrated batch 32 in 0.19368 seconds. [TensorRT] INFO: Calibrated batch 33 in 0.190505 seconds. [TensorRT] INFO: Calibrated batch 34 in 0.190421 seconds. [TensorRT] INFO: Calibrated batch 35 in 0.192281 seconds. [TensorRT] INFO: Calibrated batch 36 in 0.193346 seconds. [TensorRT] INFO: Calibrated batch 37 in 0.190963 seconds. [TensorRT] INFO: Calibrated batch 38 in 0.192224 seconds. [TensorRT] INFO: Calibrated batch 39 in 0.190355 seconds. [TensorRT] INFO: Calibrated batch 40 in 0.197455 seconds. [TensorRT] INFO: Calibrated batch 41 in 0.19524 seconds. [TensorRT] INFO: Calibrated batch 42 in 0.190825 seconds. [TensorRT] INFO: Calibrated batch 43 in 0.200636 seconds. [TensorRT] INFO: Calibrated batch 44 in 0.202216 seconds. [TensorRT] INFO: Calibrated batch 45 in 0.197474 seconds. [TensorRT] INFO: Calibrated batch 46 in 0.193189 seconds. [TensorRT] INFO: Calibrated batch 47 in 0.191879 seconds. [TensorRT] INFO: Calibrated batch 48 in 0.192769 seconds. [TensorRT] INFO: Calibrated batch 49 in 0.189865 seconds. [TensorRT] INFO: Calibrated batch 50 in 0.190264 seconds. [TensorRT] INFO: Calibrated batch 51 in 0.191329 seconds. [TensorRT] INFO: Calibrated batch 52 in 0.190378 seconds. [TensorRT] INFO: Calibrated batch 53 in 0.190473 seconds. [TensorRT] INFO: Calibrated batch 54 in 0.190965 seconds. [TensorRT] INFO: Calibrated batch 55 in 0.190208 seconds. [TensorRT] INFO: Calibrated batch 56 in 0.190055 seconds. [TensorRT] INFO: Calibrated batch 57 in 0.190904 seconds. [TensorRT] INFO: Calibrated batch 58 in 0.190111 seconds. [TensorRT] INFO: Calibrated batch 59 in 0.190114 seconds. [TensorRT] INFO: Calibrated batch 60 in 0.190771 seconds. [TensorRT] INFO: Calibrated batch 61 in 0.190373 seconds. [TensorRT] INFO: Calibrated batch 62 in 0.190403 seconds. [TensorRT] INFO: Calibrated batch 63 in 0.195152 seconds. [TensorRT] INFO: Calibrated batch 64 in 0.201602 seconds. [TensorRT] INFO: Calibrated batch 65 in 0.190822 seconds. [TensorRT] INFO: Calibrated batch 66 in 0.189351 seconds. [TensorRT] INFO: Calibrated batch 67 in 0.190515 seconds. [TensorRT] INFO: Calibrated batch 68 in 0.198057 seconds. [TensorRT] INFO: Calibrated batch 69 in 0.230414 seconds. [TensorRT] INFO: Calibrated batch 70 in 0.201069 seconds. [TensorRT] INFO: Calibrated batch 71 in 0.199731 seconds. [TensorRT] INFO: Calibrated batch 72 in 0.202323 seconds. [TensorRT] INFO: Calibrated batch 73 in 0.227934 seconds. [TensorRT] INFO: Calibrated batch 74 in 0.204208 seconds. [TensorRT] INFO: Calibrated batch 75 in 0.200376 seconds. [TensorRT] INFO: Calibrated batch 76 in 0.199856 seconds. [TensorRT] INFO: Calibrated batch 77 in 0.201837 seconds. [TensorRT] INFO: Calibrated batch 78 in 0.192326 seconds. [TensorRT] INFO: Calibrated batch 79 in 0.198371 seconds. [TensorRT] INFO: Calibrated batch 80 in 0.198383 seconds. [TensorRT] INFO: Calibrated batch 81 in 0.199378 seconds. [TensorRT] INFO: Calibrated batch 82 in 0.194358 seconds. [TensorRT] INFO: Calibrated batch 83 in 0.189417 seconds. [TensorRT] INFO: Calibrated batch 84 in 0.189486 seconds. [TensorRT] INFO: Calibrated batch 85 in 0.194285 seconds. [TensorRT] INFO: Calibrated batch 86 in 0.192751 seconds. [TensorRT] INFO: Calibrated batch 87 in 0.190222 seconds. [TensorRT] INFO: Calibrated batch 88 in 0.190699 seconds. [TensorRT] INFO: Calibrated batch 89 in 0.191054 seconds. [TensorRT] INFO: Calibrated batch 90 in 0.191803 seconds. [TensorRT] INFO: Calibrated batch 91 in 0.191118 seconds. [TensorRT] INFO: Calibrated batch 92 in 0.190148 seconds. [TensorRT] INFO: Calibrated batch 93 in 0.19163 seconds. [TensorRT] INFO: Calibrated batch 94 in 0.191162 seconds. [TensorRT] INFO: Calibrated batch 95 in 0.192054 seconds. [TensorRT] INFO: Calibrated batch 96 in 0.189946 seconds. [TensorRT] INFO: Calibrated batch 97 in 0.192111 seconds. [TensorRT] INFO: Calibrated batch 98 in 0.192154 seconds. [TensorRT] INFO: Calibrated batch 99 in 0.18994 seconds. [TensorRT] INFO: Calibrated batch 100 in 0.192188 seconds. [TensorRT] INFO: Calibrated batch 101 in 0.189904 seconds. [TensorRT] INFO: Calibrated batch 102 in 0.199456 seconds. [TensorRT] INFO: Calibrated batch 103 in 0.199298 seconds. [TensorRT] INFO: Calibrated batch 104 in 0.191426 seconds. [TensorRT] INFO: Calibrated batch 105 in 0.189674 seconds. [TensorRT] INFO: Calibrated batch 106 in 0.191596 seconds. [TensorRT] INFO: Calibrated batch 107 in 0.189817 seconds. [TensorRT] INFO: Calibrated batch 108 in 0.197161 seconds. [TensorRT] INFO: Calibrated batch 109 in 0.199587 seconds. [TensorRT] INFO: Calibrated batch 110 in 0.195789 seconds. [TensorRT] INFO: Calibrated batch 111 in 0.199737 seconds. [TensorRT] INFO: Calibrated batch 112 in 0.199892 seconds. [TensorRT] INFO: Calibrated batch 113 in 0.194938 seconds. [TensorRT] INFO: Calibrated batch 114 in 0.190809 seconds. [TensorRT] INFO: Calibrated batch 115 in 0.199229 seconds. [TensorRT] INFO: Calibrated batch 116 in 0.200184 seconds. [TensorRT] INFO: Calibrated batch 117 in 0.19979 seconds. [TensorRT] INFO: Calibrated batch 118 in 0.193039 seconds. [TensorRT] INFO: Calibrated batch 119 in 0.190221 seconds. [TensorRT] INFO: Calibrated batch 120 in 0.198002 seconds. [TensorRT] INFO: Calibrated batch 121 in 0.200335 seconds. [TensorRT] INFO: Calibrated batch 122 in 0.200193 seconds. [TensorRT] INFO: Calibrated batch 123 in 0.199477 seconds. [TensorRT] INFO: Calibrated batch 124 in 0.191953 seconds. [TensorRT] INFO: Calibrated batch 125 in 0.189832 seconds. [TensorRT] INFO: Calibrated batch 126 in 0.200572 seconds. [TensorRT] INFO: Calibrated batch 127 in 0.19256 seconds. [TensorRT] INFO: Calibrated batch 128 in 0.208748 seconds. [TensorRT] INFO: Calibrated batch 129 in 0.24335 seconds. Namespace(calibration_cache='', calibration_data='data/classifier_dataset/', engine_path='test-engines/classifier_int8_noqat_norm.engine', fp16=False, int8=True, model_path='test-onnx/classifier_fp32.onnx', model_qdq_path='', norm=True) INT8 MODE ENABLED True FP16 MODE ENABLED False USE NORMALISATION MEAN [[[0.485]] [[0.456]] [[0.406]]] STD [[[0.229]] [[0.224]] [[0.225]]] NO EXISTING CALIBRATION CACHE. PERFORM CALIBRATION IMG (1, 3, 224, 224) -1.6555355717001001 1.5245316569010414 IMG (1, 3, 224, 224) -2.0007002780413523 2.6399999999999997 IMG (1, 3, 224, 224) -2.083654420442196 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.0665296676312472 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.843907852620537 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1007791752866 2.6399999999999997 IMG (1, 3, 224, 224) -1.9831932762837303 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.7925335941876905 2.6051416142781574 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.0665296676312472 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.8606442515073078 2.6399999999999997 IMG (1, 3, 224, 224) -2.0357142857142856 2.6399999999999997 IMG (1, 3, 224, 224) -2.1007791752866 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1007791752866 2.6399999999999997 IMG (1, 3, 224, 224) -1.9831932762837303 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.861032621699129 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.8952821273210265 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.6399999999999997 IMG (1, 3, 224, 224) -2.0665296676312472 2.6399999999999997 IMG (1, 3, 224, 224) -1.7925335941876905 2.6399999999999997 IMG (1, 3, 224, 224) -1.9295316329429242 2.6399999999999997 IMG (1, 3, 224, 224) -1.9637811385648218 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.083654420442196 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.6399999999999997 IMG (1, 3, 224, 224) -2.1007791752866 2.6399999999999997 IMG (1, 3, 224, 224) -1.8952821273210265 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.9295316329429242 2.6399999999999997 IMG (1, 3, 224, 224) -2.0357142857142856 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.6399999999999997 IMG (1, 3, 224, 224) -1.843907852620537 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.0665296676312472 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.7411593357548443 1.6116776212056476 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.8096583469986394 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 1.4896732711791991 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 1.332810535430908 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.861032621699129 2.6399999999999997 IMG (1, 3, 224, 224) -2.083654420442196 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.0182072818778187 2.6399999999999997 IMG (1, 3, 224, 224) -1.6212860660782025 1.4896732711791991 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.0494049107533874 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.0357142857142856 2.6399999999999997 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -2.1007791752866 2.6399999999999997 IMG (1, 3, 224, 224) -1.9295316329429242 2.6225708071390788 IMG (1, 3, 224, 224) -1.9637811385648218 2.587712421417236 IMG (1, 3, 224, 224) -2.1007791752866 2.5179956499735514 IMG (1, 3, 224, 224) -1.9831932762837303 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.413420492808024 IMG (1, 3, 224, 224) -1.9656862703684186 2.50056645711263 IMG (1, 3, 224, 224) -1.9131652650955533 2.5354248428344723 IMG (1, 3, 224, 224) -2.1007791752866 2.6051416142781574 IMG (1, 3, 224, 224) -1.9131652650955533 2.6399999999999997 IMG (1, 3, 224, 224) -1.9124068801319754 2.6399999999999997 IMG (1, 3, 224, 224) -1.946656385753873 2.6225708071390788 IMG (1, 3, 224, 224) -1.9481792686107968 2.6399999999999997 IMG (1, 3, 224, 224) -1.9980306523205411 2.2391285641988117 IMG (1, 3, 224, 224) -1.9295316329429242 2.570283228556315 IMG (1, 3, 224, 224) -1.9656862703684186 2.5528540356953937 IMG (1, 3, 224, 224) -2.0665296676312472 2.4482788785298664 IMG (1, 3, 224, 224) -1.9637811385648218 2.3785621070861813 IMG (1, 3, 224, 224) -1.9831932762837303 2.50056645711263 IMG (1, 3, 224, 224) -1.9831932762837303 2.4482788785298664 IMG (1, 3, 224, 224) -1.8256302479920643 2.6399999999999997 IMG (1, 3, 224, 224) -1.930672266853175 2.4482788785298664 IMG (1, 3, 224, 224) -1.946656385753873 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.5528540356953937 IMG (1, 3, 224, 224) -1.8956582550225514 2.6051416142781574 IMG (1, 3, 224, 224) -2.0007002780413523 2.4831372642517087 IMG (1, 3, 224, 224) -1.9124068801319754 2.6399999999999997 IMG (1, 3, 224, 224) -2.0151554051314897 2.4657080713907877 IMG (1, 3, 224, 224) -1.9656862703684186 2.4831372642517087 IMG (1, 3, 224, 224) -2.0007002780413523 2.587712421417236 IMG (1, 3, 224, 224) -2.0182072818778187 2.50056645711263 IMG[TensorRT] INFO: Calibrated batch 130 in 0.212845 seconds. [TensorRT] INFO: Calibrated batch 131 in 0.203191 seconds. [TensorRT] INFO: Calibrated batch 132 in 0.204578 seconds. [TensorRT] INFO: Calibrated batch 133 in 0.205391 seconds. [TensorRT] INFO: Calibrated batch 134 in 0.193633 seconds. [TensorRT] INFO: Calibrated batch 135 in 0.205378 seconds. [TensorRT] INFO: Calibrated batch 136 in 0.202398 seconds. [TensorRT] INFO: Calibrated batch 137 in 0.200082 seconds. [TensorRT] INFO: Calibrated batch 138 in 0.198713 seconds. [TensorRT] INFO: Calibrated batch 139 in 0.200541 seconds. [TensorRT] INFO: Calibrated batch 140 in 0.208715 seconds. [TensorRT] INFO: Calibrated batch 141 in 0.216607 seconds. [TensorRT] INFO: Calibrated batch 142 in 0.219853 seconds. [TensorRT] INFO: Calibrated batch 143 in 0.200723 seconds. [TensorRT] INFO: Calibrated batch 144 in 0.192268 seconds. [TensorRT] INFO: Calibrated batch 145 in 0.198615 seconds. [TensorRT] INFO: Calibrated batch 146 in 0.192163 seconds. [TensorRT] INFO: Calibrated batch 147 in 0.191169 seconds. [TensorRT] INFO: Calibrated batch 148 in 0.194852 seconds. [TensorRT] INFO: Calibrated batch 149 in 0.199148 seconds. [TensorRT] INFO: Calibrated batch 150 in 0.199596 seconds. [TensorRT] INFO: Calibrated batch 151 in 0.199707 seconds. [TensorRT] INFO: Calibrated batch 152 in 0.201224 seconds. [TensorRT] INFO: Calibrated batch 153 in 0.208683 seconds. [TensorRT] INFO: Calibrated batch 154 in 0.197654 seconds. [TensorRT] INFO: Calibrated batch 155 in 0.200133 seconds. [TensorRT] INFO: Calibrated batch 156 in 0.199879 seconds. [TensorRT] INFO: Calibrated batch 157 in 0.197643 seconds. [TensorRT] INFO: Calibrated batch 158 in 0.189523 seconds. [TensorRT] INFO: Calibrated batch 159 in 0.189477 seconds. [TensorRT] INFO: Calibrated batch 160 in 0.192138 seconds. [TensorRT] INFO: Calibrated batch 161 in 0.19179 seconds. [TensorRT] INFO: Calibrated batch 162 in 0.189826 seconds. [TensorRT] INFO: Calibrated batch 163 in 0.192147 seconds. [TensorRT] INFO: Calibrated batch 164 in 0.190625 seconds. [TensorRT] INFO: Calibrated batch 165 in 0.190963 seconds. [TensorRT] INFO: Calibrated batch 166 in 0.199411 seconds. [TensorRT] INFO: Calibrated batch 167 in 0.200562 seconds. [TensorRT] INFO: Calibrated batch 168 in 0.19863 seconds. [TensorRT] INFO: Calibrated batch 169 in 0.199065 seconds. [TensorRT] INFO: Calibrated batch 170 in 0.197697 seconds. [TensorRT] INFO: Calibrated batch 171 in 0.198608 seconds. [TensorRT] INFO: Calibrated batch 172 in 0.198896 seconds. [TensorRT] INFO: Calibrated batch 173 in 0.19756 seconds. [TensorRT] INFO: Calibrated batch 174 in 0.20004 seconds. [TensorRT] INFO: Calibrated batch 175 in 0.19672 seconds. [TensorRT] INFO: Calibrated batch 176 in 0.203382 seconds. [TensorRT] INFO: Calibrated batch 177 in 0.198613 seconds. [TensorRT] INFO: Calibrated batch 178 in 0.19407 seconds. [TensorRT] INFO: Calibrated batch 179 in 0.201491 seconds. [TensorRT] INFO: Calibrated batch 180 in 0.199209 seconds. [TensorRT] INFO: Calibrated batch 181 in 0.199387 seconds. [TensorRT] INFO: Calibrated batch 182 in 0.19945 seconds. [TensorRT] INFO: Calibrated batch 183 in 0.202837 seconds. [TensorRT] INFO: Calibrated batch 184 in 0.199527 seconds. [TensorRT] INFO: Calibrated batch 185 in 0.198492 seconds. [TensorRT] INFO: Calibrated batch 186 in 0.196952 seconds. [TensorRT] INFO: Calibrated batch 187 in 0.197433 seconds. [TensorRT] INFO: Calibrated batch 188 in 0.193221 seconds. [TensorRT] INFO: Calibrated batch 189 in 0.190621 seconds. [TensorRT] INFO: Calibrated batch 190 in 0.19043 seconds. [TensorRT] INFO: Calibrated batch 191 in 0.191581 seconds. [TensorRT] INFO: Calibrated batch 192 in 0.191633 seconds. [TensorRT] INFO: Calibrated batch 193 in 0.190579 seconds. [TensorRT] INFO: Calibrated batch 194 in 0.189754 seconds. [TensorRT] INFO: Calibrated batch 195 in 0.190158 seconds. [TensorRT] INFO: Calibrated batch 196 in 0.189985 seconds. [TensorRT] INFO: Calibrated batch 197 in 0.190423 seconds. [TensorRT] INFO: Calibrated batch 198 in 0.196462 seconds. [TensorRT] INFO: Calibrated batch 199 in 0.191454 seconds. [TensorRT] INFO: Calibrated batch 200 in 0.190849 seconds. [TensorRT] INFO: Calibrated batch 201 in 0.190237 seconds. [TensorRT] INFO: Calibrated batch 202 in 0.190748 seconds. [TensorRT] INFO: Calibrated batch 203 in 0.190401 seconds. [TensorRT] INFO: Calibrated batch 204 in 0.190783 seconds. [TensorRT] INFO: Calibrated batch 205 in 0.198757 seconds. [TensorRT] INFO: Calibrated batch 206 in 0.190378 seconds. [TensorRT] INFO: Calibrated batch 207 in 0.190825 seconds. [TensorRT] INFO: Calibrated batch 208 in 0.19335 seconds. [TensorRT] INFO: Calibrated batch 209 in 0.199768 seconds. [TensorRT] INFO: Calibrated batch 210 in 0.200898 seconds. [TensorRT] INFO: Calibrated batch 211 in 0.191001 seconds. [TensorRT] INFO: Calibrated batch 212 in 0.190751 seconds. [TensorRT] INFO: Calibrated batch 213 in 0.191571 seconds. [TensorRT] INFO: Calibrated batch 214 in 0.191388 seconds. [TensorRT] INFO: Calibrated batch 215 in 0.191554 seconds. [TensorRT] INFO: Calibrated batch 216 in 0.192548 seconds. [TensorRT] INFO: Calibrated batch 217 in 0.190384 seconds. [TensorRT] INFO: Calibrated batch 218 in 0.191152 seconds. [TensorRT] INFO: Calibrated batch 219 in 0.1906 seconds. [TensorRT] INFO: Calibrated batch 220 in 0.190743 seconds. [TensorRT] INFO: Calibrated batch 221 in 0.197382 seconds. [TensorRT] INFO: Calibrated batch 222 in 0.190918 seconds. [TensorRT] INFO: Calibrated batch 223 in 0.191165 seconds. [TensorRT] INFO: Calibrated batch 224 in 0.191527 seconds. [TensorRT] INFO: Calibrated batch 225 in 0.190793 seconds. [TensorRT] INFO: Calibrated batch 226 in 0.192838 seconds. [TensorRT] INFO: Calibrated batch 227 in 0.196221 seconds. [TensorRT] INFO: Calibrated batch 228 in 0.202468 seconds. [TensorRT] INFO: Calibrated batch 229 in 0.19927 seconds. [TensorRT] INFO: Calibrated batch 230 in 0.201093 seconds. [TensorRT] INFO: Calibrated batch 231 in 0.191582 seconds. [TensorRT] INFO: Calibrated batch 232 in 0.192985 seconds. [TensorRT] INFO: Calibrated batch 233 in 0.196347 seconds. [TensorRT] INFO: Calibrated batch 234 in 0.195057 seconds. [TensorRT] INFO: Calibrated batch 235 in 0.192025 seconds. [TensorRT] INFO: Calibrated batch 236 in 0.192426 seconds. [TensorRT] INFO: Calibrated batch 237 in 0.191194 seconds. [TensorRT] INFO: Calibrated batch 238 in 0.193565 seconds. [TensorRT] INFO: Calibrated batch 239 in 0.192655 seconds. [TensorRT] INFO: Calibrated batch 240 in 0.192518 seconds. [TensorRT] INFO: Calibrated batch 241 in 0.196569 seconds. [TensorRT] INFO: Calibrated batch 242 in 0.192479 seconds. [TensorRT] INFO: Calibrated batch 243 in 0.19584 seconds. [TensorRT] INFO: Calibrated batch 244 in 0.198719 seconds. [TensorRT] INFO: Calibrated batch 245 in 0.190346 seconds. [TensorRT] INFO: Calibrated batch 246 in 0.191378 seconds. [TensorRT] INFO: Calibrated batch 247 in 0.194447 seconds. [TensorRT] INFO: Calibrated batch 248 in 0.19111 seconds. [TensorRT] INFO: Calibrated batch 249 in 0.190982 seconds. [TensorRT] INFO: Calibrated batch 250 in 0.192432 seconds. [TensorRT] INFO: Calibrated batch 251 in 0.193889 seconds. [TensorRT] INFO: Calibrated batch 252 in 0.191095 seconds. [TensorRT] INFO: Calibrated batch 253 in 0.207022 seconds. [TensorRT] INFO: Calibrated batch 254 in 0.229025 seconds. [TensorRT] INFO: Calibrated batch 255 in 0.192418 seconds. [TensorRT] INFO: Calibrated batch 256 in 0.201033 seconds. [TensorRT] INFO: Calibrated batch 257 in 0.222442 seconds. [TensorRT] INFO: Calibrated batch 258 in 0.209986 seconds. [TensorRT] INFO: Calibrated batch 259 in 0.192783 seconds. [TensorRT] INFO: Calibrated batch 260 in 0.190552 seconds. [TensorRT] INFO: Calibrated batch 261 in 0.191441 seconds. [TensorRT] INFO: Calibrated batch 262 in 0.189778 seconds. [TensorRT] INFO: Calibrated batch 263 in 0.190614 seconds. [TensorRT] INFO: Calibrated batch 264 in 0.191769 seconds. [TensorRT] INFO: Calibrated batch 265 in 0.190357 seconds. [TensorRT] INFO: Calibrated batch 266 in 0.194418 seconds. (1, 3, 224, 224) -2.0322801579424388 2.5528540356953937 IMG (1, 3, 224, 224) -2.0182072818778187 2.4657080713907877 IMG (1, 3, 224, 224) -1.8267830998095882 2.587712421417236 IMG (1, 3, 224, 224) -1.9295316329429242 2.256557757059733 IMG (1, 3, 224, 224) -2.0182072818778187 2.4657080713907877 IMG (1, 3, 224, 224) -1.861032621699129 2.5179956499735514 IMG (1, 3, 224, 224) -1.861032621699129 2.3262745285034176 IMG (1, 3, 224, 224) -1.9656862703684186 2.4482788785298664 IMG (1, 3, 224, 224) -2.1007791752866 2.6225708071390788 IMG (1, 3, 224, 224) -1.9656862703684186 2.4657080713907877 IMG (1, 3, 224, 224) -1.9656862703684186 2.5179956499735514 IMG (1, 3, 224, 224) -1.930672266853175 2.6225708071390788 IMG (1, 3, 224, 224) -1.9831932762837303 2.6399999999999997 IMG (1, 3, 224, 224) -2.0494049107533874 2.5354248428344723 IMG (1, 3, 224, 224) -2.0665296676312472 2.6225708071390788 IMG (1, 3, 224, 224) -1.930672266853175 2.5179956499735514 IMG (1, 3, 224, 224) -1.9131652650955533 2.6399999999999997 IMG (1, 3, 224, 224) -1.8256302479920643 2.6399999999999997 IMG (1, 3, 224, 224) -1.9831932762837303 2.50056645711263 IMG (1, 3, 224, 224) -1.9295316329429242 2.3959912999471027 IMG (1, 3, 224, 224) -1.8952821273210265 2.570283228556315 IMG (1, 3, 224, 224) -1.9656862703684186 2.6399999999999997 IMG (1, 3, 224, 224) -1.9980306523205411 2.1519825998942057 IMG (1, 3, 224, 224) -1.8781512532649296 2.2216993713378903 IMG (1, 3, 224, 224) -2.1179039301310043 2.5179956499735514 IMG (1, 3, 224, 224) -1.9980306523205411 2.1519825998942057 IMG (1, 3, 224, 224) -1.9481792686107968 2.4831372642517087 IMG (1, 3, 224, 224) -1.861032621699129 1.9254030927022296 IMG (1, 3, 224, 224) -2.0357142857142856 2.5179956499735514 IMG (1, 3, 224, 224) -1.8781512532649296 2.6225708071390788 IMG (1, 3, 224, 224) -1.9481792686107968 2.4657080713907877 IMG (1, 3, 224, 224) -1.9481792686107968 2.214658791321334 IMG (1, 3, 224, 224) -2.1007791752866 2.5179956499735514 IMG (1, 3, 224, 224) -2.0007002780413523 2.6399999999999997 IMG (1, 3, 224, 224) -1.9481792686107968 2.4657080713907877 IMG (1, 3, 224, 224) -2.0151554051314897 2.6225708071390788 IMG (1, 3, 224, 224) -1.861032621699129 2.186840985616048 IMG (1, 3, 224, 224) -1.9831932762837303 2.413420492808024 IMG (1, 3, 224, 224) -2.0007002780413523 2.4831372642517087 IMG (1, 3, 224, 224) -1.9124068801319754 2.5179956499735514 IMG (1, 3, 224, 224) -1.9656862703684186 2.6399999999999997 IMG (1, 3, 224, 224) -1.9124068801319754 2.6399999999999997 IMG (1, 3, 224, 224) -1.8781573745100777 2.2391285641988117 IMG (1, 3, 224, 224) -2.0322801579424388 2.3262745285034176 IMG (1, 3, 224, 224) -1.861032621699129 2.6399999999999997 IMG (1, 3, 224, 224) -2.0357142857142856 2.6225708071390788 IMG (1, 3, 224, 224) -1.861032621699129 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.587712421417236 IMG (1, 3, 224, 224) -1.8781573745100777 2.3088453356424967 IMG (1, 3, 224, 224) -1.8952821273210265 2.2391285641988117 IMG (1, 3, 224, 224) -1.8956582550225514 2.5354248428344723 IMG (1, 3, 224, 224) -1.9980306523205411 2.6051416142781574 IMG (1, 3, 224, 224) -1.946656385753873 2.4657080713907877 IMG (1, 3, 224, 224) -1.9637811385648218 2.3785621070861813 IMG (1, 3, 224, 224) -2.0182072818778187 2.5179956499735514 IMG (1, 3, 224, 224) -1.9831932762837303 2.50056645711263 IMG (1, 3, 224, 224) -1.9295316329429242 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.5354248428344723 IMG (1, 3, 224, 224) -1.9809058913757707 2.2042701784769694 IMG (1, 3, 224, 224) -1.9809058913757707 2.6225708071390788 IMG (1, 3, 224, 224) -2.0007002780413523 2.430849685668945 IMG (1, 3, 224, 224) -2.0007002780413523 2.5179956499735514 IMG (1, 3, 224, 224) -2.0007002780413523 2.413420492808024 IMG (1, 3, 224, 224) -1.9831932762837303 2.50056645711263 IMG (1, 3, 224, 224) -1.8956582550225514 2.6399999999999997 IMG (1, 3, 224, 224) -1.843137249749686 2.2914161427815753 IMG (1, 3, 224, 224) -1.8606442515073078 2.2914161427815753 IMG (1, 3, 224, 224) -1.9481792686107968 2.50056645711263 IMG (1, 3, 224, 224) -1.9831932762837303 2.2391285641988117 IMG (1, 3, 224, 224) -1.930672266853175 2.570283228556315 IMG (1, 3, 224, 224) -2.0665296676312472 2.4657080713907877 IMG (1, 3, 224, 224) -1.9809058913757707 2.1519825998942057 IMG (1, 3, 224, 224) -1.930672266853175 2.4482788785298664 IMG (1, 3, 224, 224) -1.930672266853175 2.6399999999999997 IMG (1, 3, 224, 224) -1.9295316329429242 2.587712421417236 IMG (1, 3, 224, 224) -2.0007002780413523 2.4657080713907877 IMG (1, 3, 224, 224) -1.8781512532649296 2.6399999999999997 IMG (1, 3, 224, 224) -1.9481792686107968 2.430849685668945 IMG (1, 3, 224, 224) -2.0007002780413523 2.4831372642517087 IMG (1, 3, 224, 224) -2.0151554051314897 2.343703721364339 IMG (1, 3, 224, 224) -1.930672266853175 1.9920370047789995 IMG (1, 3, 224, 224) -1.9481792686107968 2.6399999999999997 IMG (1, 3, 224, 224) -1.9980306523205411 2.413420492808024 IMG (1, 3, 224, 224) -1.9656862703684186 2.4657080713907877 IMG (1, 3, 224, 224) -2.1179039301310043 2.0434173899037495 IMG (1, 3, 224, 224) -1.9831932762837303 2.4482788785298664 IMG (1, 3, 224, 224) -1.8606442515073078 2.6399999999999997 IMG (1, 3, 224, 224) -1.930672266853175 2.4657080713907877 IMG (1, 3, 224, 224) -1.9131652650955533 2.6399999999999997 IMG (1, 3, 224, 224) -2.0322801579424388 2.2914161427815753 IMG (1, 3, 224, 224) -1.930672266853175 2.6399999999999997 IMG (1, 3, 224, 224) -1.9831932762837303 2.4831372642517087 IMG (1, 3, 224, 224) -2.0665296676312472 2.2914161427815753 IMG (1, 3, 224, 224) -1.9481792686107968 2.6399999999999997 IMG (1, 3, 224, 224) -2.0182072818778187 2.50056645711263 IMG (1, 3, 224, 224) -2.0357142857142856 2.6051416142781574 IMG (1, 3, 224, 224) -1.861032621699129 2.6399999999999997 IMG (1, 3, 224, 224) -2.0357142857142856 2.4831372642517087 IMG (1, 3, 224, 224) -1.930672266853175 2.256557757059733 IMG (1, 3, 224, 224) -1.8606442515073078 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.570283228556315 IMG (1, 3, 224, 224) -2.0182072818778187 2.428571428571429 IMG (1, 3, 224, 224) -2.0357142857142856 2.6399999999999997 IMG (1, 3, 224, 224) -1.9295316329429242 2.570283228556315 IMG (1, 3, 224, 224) -1.9481792686107968 2.6399999999999997 IMG (1, 3, 224, 224) -1.861032621699129 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.430849685668945 IMG (1, 3, 224, 224) -1.843907852620537 2.6399999999999997 IMG (1, 3, 224, 224) -1.7240345829438954 2.6051416142781574 IMG (1, 3, 224, 224) -1.9831932762837303 2.4831372642517087 IMG (1, 3, 224, 224) -1.9656862703684186 2.5528540356953937 IMG (1, 3, 224, 224) -1.9295316329429242 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.4482788785298664 IMG (1, 3, 224, 224) -1.8952821273210265 2.430849685668945 IMG (1, 3, 224, 224) -1.9980306523205411 2.2042701784769694 IMG (1, 3, 224, 224) -1.861032621699129 2.4482788785298664 IMG (1, 3, 224, 224) -2.0007002780413523 2.4482788785298664 IMG (1, 3, 224, 224) -2.0494049107533874 2.186840985616048 IMG (1, 3, 224, 224) -1.930672266853175 2.3959912999471027 IMG (1, 3, 224, 224) -1.9809058913757707 2.6225708071390788 IMG (1, 3, 224, 224) -1.9656862703684186 2.6399999999999997 IMG (1, 3, 224, 224) -1.9831932762837303 2.2042701784769694 IMG (1, 3, 224, 224) -1.9124068801319754 2.2914161427815753 IMG (1, 3, 224, 224) -1.8267830998095882 2.6399999999999997 IMG (1, 3, 224, 224) -1.9637811385648218 2.6399999999999997 IMG (1, 3, 224, 224) -2.0182072818778187 2.3785621070861813 IMG (1, 3, 224, 224) -1.9131652650955533 2.5179956499735514 IMG (1, 3, 224, 224) -1.930672266853175 2.6051416142781574 IMG (1, 3, 224, 224) -1.9831932762837303 2.430849685668945 IMG (1, 3, 224, 224) -2.0322801579424388 2.6051416142781574 IMG (1, 3, 224, 224) -1.9295316329429242 2.6399999999999997 IMG (1, 3, 224, 224) -1.9481792686107968 2.3088453356424967 IMG (1, 3, 224, 224) -1.8267830998095882 2.6399999999999997 IMG (1, 3, 224, 224) -2.0151554051314897 2.587712421417236 IMG (1, 3, 224, 224) -1.9295316329429242 2.6225708071390788 IMG (1, 3, 224, 224) -2.0151554051314897 2.430849685668945 IMG (1, 3, 224, 224) -1.930672266853175 2.570283228556315 IMG (1, 3, 224, 224) -1.9980306523205411 [TensorRT] INFO: Calibrated batch 267 in 0.194003 seconds. [TensorRT] INFO: Calibrated batch 268 in 0.190944 seconds. [TensorRT] INFO: Calibrated batch 269 in 0.189832 seconds. [TensorRT] INFO: Calibrated batch 270 in 0.191026 seconds. [TensorRT] INFO: Calibrated batch 271 in 0.19042 seconds. [TensorRT] INFO: Calibrated batch 272 in 0.189795 seconds. [TensorRT] INFO: Calibrated batch 273 in 0.191015 seconds. [TensorRT] INFO: Calibrated batch 274 in 0.191932 seconds. [TensorRT] INFO: Calibrated batch 275 in 0.189825 seconds. [TensorRT] INFO: Calibrated batch 276 in 0.189131 seconds. [TensorRT] INFO: Calibrated batch 277 in 0.190739 seconds. [TensorRT] INFO: Calibrated batch 278 in 0.192373 seconds. [TensorRT] INFO: Calibrated batch 279 in 0.201095 seconds. [TensorRT] INFO: Calibrated batch 280 in 0.198762 seconds. [TensorRT] INFO: Calibrated batch 281 in 0.192522 seconds. [TensorRT] INFO: Calibrated batch 282 in 0.190722 seconds. [TensorRT] INFO: Calibrated batch 283 in 0.197875 seconds. [TensorRT] INFO: Calibrated batch 284 in 0.198282 seconds. [TensorRT] INFO: Calibrated batch 285 in 0.195605 seconds. [TensorRT] INFO: Calibrated batch 286 in 0.190286 seconds. [TensorRT] INFO: Calibrated batch 287 in 0.192878 seconds. [TensorRT] INFO: Calibrated batch 288 in 0.191194 seconds. [TensorRT] INFO: Calibrated batch 289 in 0.197122 seconds. [TensorRT] INFO: Calibrated batch 290 in 0.204688 seconds. [TensorRT] INFO: Calibrated batch 291 in 0.191956 seconds. [TensorRT] INFO: Calibrated batch 292 in 0.190769 seconds. [TensorRT] INFO: Calibrated batch 293 in 0.192538 seconds. [TensorRT] INFO: Calibrated batch 294 in 0.189972 seconds. [TensorRT] INFO: Calibrated batch 295 in 0.192598 seconds. [TensorRT] INFO: Calibrated batch 296 in 0.189891 seconds. [TensorRT] INFO: Calibrated batch 297 in 0.192512 seconds. [TensorRT] INFO: Calibrated batch 298 in 0.191069 seconds. [TensorRT] INFO: Calibrated batch 299 in 0.193626 seconds. [TensorRT] INFO: Calibrated batch 300 in 0.189463 seconds. [TensorRT] INFO: Calibrated batch 301 in 0.191793 seconds. [TensorRT] INFO: Calibrated batch 302 in 0.19108 seconds. [TensorRT] INFO: Calibrated batch 303 in 0.190363 seconds. [TensorRT] INFO: Calibrated batch 304 in 0.192297 seconds. [TensorRT] INFO: Calibrated batch 305 in 0.191895 seconds. [TensorRT] INFO: Calibrated batch 306 in 0.195351 seconds. [TensorRT] INFO: Calibrated batch 307 in 0.195574 seconds. [TensorRT] INFO: Calibrated batch 308 in 0.189389 seconds. [TensorRT] INFO: Calibrated batch 309 in 0.197748 seconds. [TensorRT] INFO: Calibrated batch 310 in 0.200561 seconds. [TensorRT] INFO: Calibrated batch 311 in 0.193672 seconds. [TensorRT] INFO: Calibrated batch 312 in 0.196101 seconds. [TensorRT] INFO: Calibrated batch 313 in 0.193746 seconds. [TensorRT] INFO: Calibrated batch 314 in 0.189724 seconds. [TensorRT] INFO: Calibrated batch 315 in 0.191207 seconds. [TensorRT] INFO: Calibrated batch 316 in 0.191308 seconds. [TensorRT] INFO: Calibrated batch 317 in 0.197875 seconds. [TensorRT] INFO: Calibrated batch 318 in 0.191637 seconds. [TensorRT] INFO: Calibrated batch 319 in 0.190502 seconds. [TensorRT] INFO: Calibrated batch 320 in 0.190212 seconds. [TensorRT] INFO: Calibrated batch 321 in 0.189865 seconds. [TensorRT] INFO: Calibrated batch 322 in 0.189774 seconds. [TensorRT] INFO: Calibrated batch 323 in 0.190273 seconds. [TensorRT] INFO: Calibrated batch 324 in 0.189245 seconds. [TensorRT] INFO: Calibrated batch 325 in 0.190943 seconds. [TensorRT] INFO: Calibrated batch 326 in 0.189973 seconds. [TensorRT] INFO: Calibrated batch 327 in 0.189708 seconds. [TensorRT] INFO: Calibrated batch 328 in 0.190181 seconds. [TensorRT] INFO: Calibrated batch 329 in 0.190481 seconds. [TensorRT] INFO: Calibrated batch 330 in 0.190927 seconds. [TensorRT] INFO: Calibrated batch 331 in 0.190681 seconds. [TensorRT] INFO: Calibrated batch 332 in 0.189831 seconds. [TensorRT] INFO: Calibrated batch 333 in 0.190865 seconds. [TensorRT] INFO: Calibrated batch 334 in 0.191064 seconds. [TensorRT] INFO: Calibrated batch 335 in 0.194686 seconds. [TensorRT] INFO: Calibrated batch 336 in 0.194038 seconds. [TensorRT] INFO: Calibrated batch 337 in 0.192612 seconds. [TensorRT] INFO: Calibrated batch 338 in 0.201779 seconds. [TensorRT] INFO: Calibrated batch 339 in 0.199349 seconds. [TensorRT] INFO: Calibrated batch 340 in 0.191596 seconds. [TensorRT] INFO: Calibrated batch 341 in 0.190623 seconds. [TensorRT] INFO: Calibrated batch 342 in 0.191834 seconds. [TensorRT] INFO: Calibrated batch 343 in 0.189912 seconds. [TensorRT] INFO: Calibrated batch 344 in 0.189889 seconds. [TensorRT] INFO: Calibrated batch 345 in 0.190006 seconds. [TensorRT] INFO: Calibrated batch 346 in 0.189935 seconds. [TensorRT] INFO: Calibrated batch 347 in 0.190685 seconds. [TensorRT] INFO: Calibrated batch 348 in 0.18926 seconds. [TensorRT] INFO: Calibrated batch 349 in 0.190205 seconds. [TensorRT] INFO: Calibrated batch 350 in 0.190374 seconds. [TensorRT] INFO: Calibrated batch 351 in 0.191557 seconds. [TensorRT] INFO: Calibrated batch 352 in 0.189786 seconds. [TensorRT] INFO: Calibrated batch 353 in 0.189866 seconds. [TensorRT] INFO: Calibrated batch 354 in 0.190986 seconds. [TensorRT] INFO: Calibrated batch 355 in 0.189734 seconds. [TensorRT] INFO: Calibrated batch 356 in 0.190606 seconds. [TensorRT] INFO: Calibrated batch 357 in 0.190436 seconds. [TensorRT] INFO: Calibrated batch 358 in 0.193418 seconds. [TensorRT] INFO: Calibrated batch 359 in 0.195716 seconds. [TensorRT] INFO: Calibrated batch 360 in 0.190252 seconds. [TensorRT] INFO: Calibrated batch 361 in 0.190377 seconds. [TensorRT] INFO: Calibrated batch 362 in 0.190672 seconds. [TensorRT] INFO: Calibrated batch 363 in 0.192589 seconds. [TensorRT] INFO: Calibrated batch 364 in 0.190514 seconds. [TensorRT] INFO: Calibrated batch 365 in 0.202448 seconds. [TensorRT] INFO: Calibrated batch 366 in 0.194815 seconds. [TensorRT] INFO: Calibrated batch 367 in 0.189562 seconds. [TensorRT] INFO: Calibrated batch 368 in 0.190651 seconds. [TensorRT] INFO: Calibrated batch 369 in 0.189534 seconds. [TensorRT] INFO: Calibrated batch 370 in 0.190482 seconds. [TensorRT] INFO: Calibrated batch 371 in 0.190166 seconds. [TensorRT] INFO: Calibrated batch 372 in 0.190114 seconds. [TensorRT] INFO: Calibrated batch 373 in 0.190251 seconds. [TensorRT] INFO: Calibrated batch 374 in 0.190286 seconds. [TensorRT] INFO: Calibrated batch 375 in 0.195837 seconds. [TensorRT] INFO: Calibrated batch 376 in 0.189615 seconds. [TensorRT] INFO: Calibrated batch 377 in 0.191364 seconds. [TensorRT] INFO: Calibrated batch 378 in 0.190928 seconds. [TensorRT] INFO: Calibrated batch 379 in 0.191018 seconds. [TensorRT] INFO: Calibrated batch 380 in 0.189463 seconds. [TensorRT] INFO: Calibrated batch 381 in 0.193403 seconds. [TensorRT] INFO: Calibrated batch 382 in 0.196035 seconds. [TensorRT] INFO: Calibrated batch 383 in 0.192267 seconds. [TensorRT] INFO: Calibrated batch 384 in 0.197621 seconds. [TensorRT] INFO: Calibrated batch 385 in 0.191683 seconds. [TensorRT] INFO: Calibrated batch 386 in 0.19056 seconds. [TensorRT] INFO: Calibrated batch 387 in 0.190611 seconds. [TensorRT] INFO: Calibrated batch 388 in 0.199628 seconds. [TensorRT] INFO: Calibrated batch 389 in 0.191532 seconds. [TensorRT] INFO: Calibrated batch 390 in 0.190055 seconds. [TensorRT] INFO: Calibrated batch 391 in 0.190132 seconds. [TensorRT] INFO: Calibrated batch 392 in 0.19096 seconds. [TensorRT] INFO: Calibrated batch 393 in 0.190141 seconds. [TensorRT] INFO: Calibrated batch 394 in 0.189663 seconds. [TensorRT] INFO: Calibrated batch 395 in 0.189312 seconds. [TensorRT] INFO: Calibrated batch 396 in 0.189309 seconds. [TensorRT] INFO: Calibrated batch 397 in 0.18974 seconds. [TensorRT] INFO: Calibrated batch 398 in 0.190551 seconds. [TensorRT] INFO: Calibrated batch 399 in 0.189995 seconds. [TensorRT] INFO: Calibrated batch 400 in 0.192061 seconds. [TensorRT] INFO: Calibrated batch 401 in 0.190894 seconds. [TensorRT] INFO: Calibrated batch 402 in 0.190858 seconds. [TensorRT] INFO: Calibrated batch 403 in 0.190097 seconds. [TensorRT] INFO: Calibrated batch 404 in 0.193449 seconds. 2.3959912999471027 IMG (1, 3, 224, 224) -1.9481792686107968 2.4831372642517087 IMG (1, 3, 224, 224) -1.930672266853175 2.2216993713378903 IMG (1, 3, 224, 224) -1.9831932762837303 2.4831372642517087 IMG (1, 3, 224, 224) -2.0665296676312472 2.6051416142781574 IMG (1, 3, 224, 224) -1.9124068801319754 2.6225708071390788 IMG (1, 3, 224, 224) -1.930672266853175 2.343703721364339 IMG (1, 3, 224, 224) -1.9481792686107968 2.6399999999999997 IMG (1, 3, 224, 224) -2.0494049107533874 2.50056645711263 IMG (1, 3, 224, 224) -1.930672266853175 2.413420492808024 IMG (1, 3, 224, 224) -2.0322801579424388 2.4657080713907877 IMG (1, 3, 224, 224) -1.9980306523205411 2.256557757059733 IMG (1, 3, 224, 224) -1.9656862703684186 2.430849685668945 IMG (1, 3, 224, 224) -1.8956582550225514 2.6225708071390788 IMG (1, 3, 224, 224) -2.0007002780413523 2.4831372642517087 IMG (1, 3, 224, 224) -1.9131652650955533 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.6225708071390788 IMG (1, 3, 224, 224) -1.9831932762837303 2.50056645711263 IMG (1, 3, 224, 224) -1.8781512532649296 2.6399999999999997 IMG (1, 3, 224, 224) -2.0494049107533874 2.099695021311442 IMG (1, 3, 224, 224) -2.0322801579424388 2.6399999999999997 IMG (1, 3, 224, 224) -1.946656385753873 2.6225708071390788 IMG (1, 3, 224, 224) -1.9809058913757707 2.570283228556315 IMG (1, 3, 224, 224) -1.8781512532649296 2.6399999999999997 IMG (1, 3, 224, 224) -1.8956582550225514 2.6399999999999997 IMG (1, 3, 224, 224) -1.8956582550225514 2.6399999999999997 IMG (1, 3, 224, 224) -2.0182072818778187 2.3088453356424967 IMG (1, 3, 224, 224) -1.930672266853175 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.2042701784769694 IMG (1, 3, 224, 224) -1.9131652650955533 2.6399999999999997 IMG (1, 3, 224, 224) -1.843907852620537 2.587712421417236 IMG (1, 3, 224, 224) -1.9656862703684186 2.4482788785298664 IMG (1, 3, 224, 224) -1.9124068801319754 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.6399999999999997 IMG (1, 3, 224, 224) -2.0151554051314897 2.6225708071390788 IMG (1, 3, 224, 224) -1.946656385753873 2.6399999999999997 IMG (1, 3, 224, 224) -1.9637811385648218 2.50056645711263 IMG (1, 3, 224, 224) -2.0182072818778187 2.1519825998942057 IMG (1, 3, 224, 224) -2.0007002780413523 2.430849685668945 IMG (1, 3, 224, 224) -1.9131652650955533 2.6399999999999997 IMG (1, 3, 224, 224) -2.0357142857142856 2.50056645711263 IMG (1, 3, 224, 224) -1.9295316329429242 2.587712421417236 IMG (1, 3, 224, 224) -1.9295316329429242 2.6399999999999997 IMG (1, 3, 224, 224) -1.9809058913757707 2.4482788785298664 IMG (1, 3, 224, 224) -1.9295316329429242 2.6399999999999997 IMG (1, 3, 224, 224) -1.9831932762837303 2.50056645711263 IMG (1, 3, 224, 224) -1.9637811385648218 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.430849685668945 IMG (1, 3, 224, 224) -1.8952821273210265 2.2914161427815753 IMG (1, 3, 224, 224) -1.7069098301329466 2.6051416142781574 IMG (1, 3, 224, 224) -2.0007002780413523 2.570283228556315 IMG (1, 3, 224, 224) -1.9980306523205411 2.3611329142252604 IMG (1, 3, 224, 224) -2.0007002780413523 2.430849685668945 IMG (1, 3, 224, 224) -1.9831932762837303 2.6225708071390788 IMG (1, 3, 224, 224) -2.0494049107533874 2.570283228556315 IMG (1, 3, 224, 224) -2.0182072818778187 2.0474074427286784 IMG (1, 3, 224, 224) -1.843907852620537 2.6399999999999997 IMG (1, 3, 224, 224) -2.0357142857142856 2.5179956499735514 IMG (1, 3, 224, 224) -2.0182072818778187 2.413420492808024 IMG (1, 3, 224, 224) -2.0151554051314897 2.413420492808024 IMG (1, 3, 224, 224) -1.946656385753873 2.587712421417236 IMG (1, 3, 224, 224) -2.0665296676312472 2.343703721364339 IMG (1, 3, 224, 224) -2.0151554051314897 2.1694117927551266 IMG (1, 3, 224, 224) -1.8952821273210265 2.2914161427815753 IMG (1, 3, 224, 224) -1.9831932762837303 2.256557757059733 IMG (1, 3, 224, 224) -1.8956582550225514 2.6399999999999997 IMG (1, 3, 224, 224) -2.0151554051314897 2.1345534070332843 IMG (1, 3, 224, 224) -1.9831932762837303 2.6399999999999997 IMG (1, 3, 224, 224) -1.8781512532649296 2.6399999999999997 IMG (1, 3, 224, 224) -1.0203081172491824 1.6813943926493324 IMG (1, 3, 224, 224) -1.9481792686107968 2.6399999999999997 IMG (1, 3, 224, 224) -1.930672266853175 2.6399999999999997 IMG (1, 3, 224, 224) -1.9481792686107968 2.6051416142781574 IMG (1, 3, 224, 224) -1.9131652650955533 2.5179956499735514 IMG (1, 3, 224, 224) -1.9831932762837303 2.6399999999999997 IMG (1, 3, 224, 224) -2.0182072818778187 2.50056645711263 IMG (1, 3, 224, 224) -1.9656862703684186 2.3262745285034176 IMG (1, 3, 224, 224) -1.668067215542708 1.5245316569010414 IMG (1, 3, 224, 224) -1.9809058913757707 2.6399999999999997 IMG (1, 3, 224, 224) -1.930672266853175 2.273986949920654 IMG (1, 3, 224, 224) -1.9637811385648218 2.3611329142252604 IMG (1, 3, 224, 224) -2.083654420442196 2.256557757059733 IMG (1, 3, 224, 224) -1.946656385753873 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.6399999999999997 IMG (1, 3, 224, 224) -1.8956582550225514 2.6399999999999997 IMG (1, 3, 224, 224) -2.0494049107533874 2.3785621070861813 IMG (1, 3, 224, 224) -2.0182072818778187 2.4482788785298664 IMG (1, 3, 224, 224) -2.083654420442196 2.6399999999999997 IMG (1, 3, 224, 224) -2.0494049107533874 2.4831372642517087 IMG (1, 3, 224, 224) -1.9831932762837303 2.413420492808024 IMG (1, 3, 224, 224) -2.0007002780413523 2.6399999999999997 IMG (1, 3, 224, 224) -1.9637811385648218 2.6399999999999997 IMG (1, 3, 224, 224) -1.946656385753873 2.6399999999999997 IMG (1, 3, 224, 224) -1.9295316329429242 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.4831372642517087 IMG (1, 3, 224, 224) -1.9831932762837303 2.50056645711263 IMG (1, 3, 224, 224) -1.946656385753873 2.587712421417236 IMG (1, 3, 224, 224) -1.9637811385648218 2.4482788785298664 IMG (1, 3, 224, 224) -1.9124068801319754 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.413420492808024 IMG (1, 3, 224, 224) -1.843137249749686 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.5528540356953937 IMG (1, 3, 224, 224) -1.9131652650955533 2.256557757059733 IMG (1, 3, 224, 224) -1.9656862703684186 2.50056645711263 IMG (1, 3, 224, 224) -1.9656862703684186 2.587712421417236 IMG (1, 3, 224, 224) -1.8781573745100777 2.343703721364339 IMG (1, 3, 224, 224) -1.9980306523205411 2.50056645711263 IMG (1, 3, 224, 224) -2.0007002780413523 2.50056645711263 IMG (1, 3, 224, 224) -2.0007002780413523 1.9776906712849933 IMG (1, 3, 224, 224) -2.0182072818778187 2.413420492808024 IMG (1, 3, 224, 224) -1.8256302479920643 2.6051416142781574 IMG (1, 3, 224, 224) -1.8952821273210265 2.4657080713907877 IMG (1, 3, 224, 224) -1.9131652650955533 2.6399999999999997 IMG (1, 3, 224, 224) -2.0357142857142856 2.4657080713907877 IMG (1, 3, 224, 224) -2.0151554051314897 2.186840985616048 IMG (1, 3, 224, 224) -1.8606442515073078 2.6399999999999997 IMG (1, 3, 224, 224) -2.0322801579424388 2.570283228556315 IMG (1, 3, 224, 224) -1.843907852620537 2.6399999999999997 IMG (1, 3, 224, 224) -1.9831932762837303 2.50056645711263 IMG (1, 3, 224, 224) -1.9656862703684186 2.6399999999999997 IMG (1, 3, 224, 224) -1.8781512532649296 2.6399999999999997 IMG (1, 3, 224, 224) -1.946656385753873 2.6225708071390788 IMG (1, 3, 224, 224) -1.8956582550225514 2.6399999999999997 IMG (1, 3, 224, 224) -1.9831932762837303 2.5354248428344723 IMG (1, 3, 224, 224) -1.9656862703684186 2.4657080713907877 IMG (1, 3, 224, 224) -2.0151554051314897 2.6051416142781574 IMG (1, 3, 224, 224) -2.0182072818778187 2.4482788785298664 IMG (1, 3, 224, 224) -1.9637811385648218 2.587712421417236 IMG (1, 3, 224, 224) -2.0151554051314897 2.6225708071390788 IMG (1, 3, 224, 224) -1.8781573745100777 2.430849685668945 IMG (1, 3, 224, 224) -1.8952821273210265 2.3262745285034176 IMG (1, 3, 224, 224) -1.9124068801319754 2.587712421417236 IMG (1, 3, 224, 224) -1.9656862703684186 2.3785621070861813 IMG (1, 3, 224, 224) -1.930672266853175 2.5528540356953937 IMG (1, 3, 224, 224) -2.0182072818778187 2.50056645711263 IMG (1, 3, 224, 224) -1.8267830998095882 2.6399999999999997 IMG (1, 3, 224, 224) -2.0494049107533874 2.1694117927551266 IMG (1, 3, 224, 224) -1.8781512532649296 2.587712421417236 IMG (1, 3, 224, 224) -1.9481792686107968[TensorRT] INFO: Calibrated batch 405 in 0.195732 seconds. [TensorRT] INFO: Calibrated batch 406 in 0.189334 seconds. [TensorRT] INFO: Calibrated batch 407 in 0.18935 seconds. [TensorRT] INFO: Calibrated batch 408 in 0.195703 seconds. [TensorRT] INFO: Calibrated batch 409 in 0.190449 seconds. [TensorRT] INFO: Calibrated batch 410 in 0.193275 seconds. [TensorRT] INFO: Calibrated batch 411 in 0.1914 seconds. [TensorRT] INFO: Calibrated batch 412 in 0.191418 seconds. [TensorRT] INFO: Calibrated batch 413 in 0.192665 seconds. [TensorRT] INFO: Calibrated batch 414 in 0.192967 seconds. [TensorRT] INFO: Calibrated batch 415 in 0.189669 seconds. [TensorRT] INFO: Calibrated batch 416 in 0.192287 seconds. [TensorRT] INFO: Calibrated batch 417 in 0.19322 seconds. [TensorRT] INFO: Calibrated batch 418 in 0.190929 seconds. [TensorRT] INFO: Calibrated batch 419 in 0.192342 seconds. [TensorRT] INFO: Calibrated batch 420 in 0.189684 seconds. [TensorRT] INFO: Calibrated batch 421 in 0.191966 seconds. [TensorRT] INFO: Calibrated batch 422 in 0.191177 seconds. [TensorRT] INFO: Calibrated batch 423 in 0.190997 seconds. [TensorRT] INFO: Calibrated batch 424 in 0.191586 seconds. [TensorRT] INFO: Calibrated batch 425 in 0.189979 seconds. [TensorRT] INFO: Calibrated batch 426 in 0.193694 seconds. [TensorRT] INFO: Calibrated batch 427 in 0.192055 seconds. [TensorRT] INFO: Calibrated batch 428 in 0.197779 seconds. [TensorRT] INFO: Calibrated batch 429 in 0.191028 seconds. [TensorRT] INFO: Calibrated batch 430 in 0.190038 seconds. [TensorRT] INFO: Calibrated batch 431 in 0.190998 seconds. [TensorRT] INFO: Calibrated batch 432 in 0.190143 seconds. [TensorRT] INFO: Calibrated batch 433 in 0.189154 seconds. [TensorRT] INFO: Calibrated batch 434 in 0.189517 seconds. [TensorRT] INFO: Calibrated batch 435 in 0.189477 seconds. [TensorRT] INFO: Calibrated batch 436 in 0.19056 seconds. [TensorRT] INFO: Calibrated batch 437 in 0.189912 seconds. [TensorRT] INFO: Calibrated batch 438 in 0.189896 seconds. [TensorRT] INFO: Calibrated batch 439 in 0.190292 seconds. [TensorRT] INFO: Calibrated batch 440 in 0.189645 seconds. [TensorRT] INFO: Calibrated batch 441 in 0.191448 seconds. [TensorRT] INFO: Calibrated batch 442 in 0.197614 seconds. [TensorRT] INFO: Calibrated batch 443 in 0.190375 seconds. [TensorRT] INFO: Calibrated batch 444 in 0.190319 seconds. [TensorRT] INFO: Calibrated batch 445 in 0.191004 seconds. [TensorRT] INFO: Calibrated batch 446 in 0.190257 seconds. [TensorRT] INFO: Calibrated batch 447 in 0.190761 seconds. [TensorRT] INFO: Calibrated batch 448 in 0.189763 seconds. [TensorRT] INFO: Calibrated batch 449 in 0.189486 seconds. [TensorRT] INFO: Calibrated batch 450 in 0.192975 seconds. [TensorRT] INFO: Calibrated batch 451 in 0.196727 seconds. [TensorRT] INFO: Calibrated batch 452 in 0.191951 seconds. [TensorRT] INFO: Calibrated batch 453 in 0.190156 seconds. [TensorRT] INFO: Calibrated batch 454 in 0.190461 seconds. [TensorRT] INFO: Calibrated batch 455 in 0.190424 seconds. [TensorRT] INFO: Calibrated batch 456 in 0.197906 seconds. [TensorRT] INFO: Calibrated batch 457 in 0.190594 seconds. [TensorRT] INFO: Calibrated batch 458 in 0.191041 seconds. [TensorRT] INFO: Calibrated batch 459 in 0.189654 seconds. [TensorRT] INFO: Calibrated batch 460 in 0.190413 seconds. [TensorRT] INFO: Calibrated batch 461 in 0.191441 seconds. [TensorRT] INFO: Calibrated batch 462 in 0.195882 seconds. [TensorRT] INFO: Calibrated batch 463 in 0.189785 seconds. [TensorRT] INFO: Calibrated batch 464 in 0.190256 seconds. [TensorRT] INFO: Calibrated batch 465 in 0.19091 seconds. [TensorRT] INFO: Calibrated batch 466 in 0.199696 seconds. [TensorRT] INFO: Calibrated batch 467 in 0.193499 seconds. [TensorRT] INFO: Calibrated batch 468 in 0.190269 seconds. [TensorRT] INFO: Calibrated batch 469 in 0.190103 seconds. [TensorRT] INFO: Calibrated batch 470 in 0.190962 seconds. [TensorRT] INFO: Calibrated batch 471 in 0.199613 seconds. [TensorRT] INFO: Calibrated batch 472 in 0.198921 seconds. [TensorRT] INFO: Calibrated batch 473 in 0.200387 seconds. [TensorRT] INFO: Calibrated batch 474 in 0.197524 seconds. [TensorRT] INFO: Calibrated batch 475 in 0.190169 seconds. [TensorRT] INFO: Calibrated batch 476 in 0.190705 seconds. [TensorRT] INFO: Calibrated batch 477 in 0.189998 seconds. [TensorRT] INFO: Calibrated batch 478 in 0.191067 seconds. [TensorRT] INFO: Calibrated batch 479 in 0.190366 seconds. [TensorRT] INFO: Calibrated batch 480 in 0.20024 seconds. [TensorRT] INFO: Calibrated batch 481 in 0.190331 seconds. [TensorRT] INFO: Calibrated batch 482 in 0.190618 seconds. [TensorRT] INFO: Calibrated batch 483 in 0.191122 seconds. [TensorRT] INFO: Calibrated batch 484 in 0.190069 seconds. [TensorRT] INFO: Calibrated batch 485 in 0.189586 seconds. [TensorRT] INFO: Calibrated batch 486 in 0.190244 seconds. [TensorRT] INFO: Calibrated batch 487 in 0.190447 seconds. [TensorRT] INFO: Calibrated batch 488 in 0.190128 seconds. [TensorRT] INFO: Calibrated batch 489 in 0.189736 seconds. [TensorRT] INFO: Calibrated batch 490 in 0.189475 seconds. [TensorRT] INFO: Calibrated batch 491 in 0.189316 seconds. [TensorRT] INFO: Calibrated batch 492 in 0.191409 seconds. [TensorRT] INFO: Calibrated batch 493 in 0.201398 seconds. [TensorRT] INFO: Calibrated batch 494 in 0.200591 seconds. [TensorRT] INFO: Calibrated batch 495 in 0.195608 seconds. [TensorRT] INFO: Calibrated batch 496 in 0.194963 seconds. [TensorRT] INFO: Calibrated batch 497 in 0.198106 seconds. [TensorRT] INFO: Calibrated batch 498 in 0.191021 seconds. [TensorRT] INFO: Calibrated batch 499 in 0.190655 seconds. [TensorRT] INFO: Calibrated batch 500 in 0.190868 seconds. [TensorRT] INFO: Calibrated batch 501 in 0.191855 seconds. [TensorRT] INFO: Calibrated batch 502 in 0.199641 seconds. [TensorRT] INFO: Calibrated batch 503 in 0.191035 seconds. [TensorRT] INFO: Calibrated batch 504 in 0.191566 seconds. [TensorRT] INFO: Calibrated batch 505 in 0.190009 seconds. [TensorRT] INFO: Calibrated batch 506 in 0.190288 seconds. [TensorRT] INFO: Calibrated batch 507 in 0.190865 seconds. [TensorRT] INFO: Calibrated batch 508 in 0.190383 seconds. [TensorRT] INFO: Calibrated batch 509 in 0.190447 seconds. [TensorRT] INFO: Calibrated batch 510 in 0.190199 seconds. [TensorRT] INFO: Calibrated batch 511 in 0.190722 seconds. [TensorRT] INFO: Calibrated batch 512 in 0.189807 seconds. [TensorRT] INFO: Calibrated batch 513 in 0.190582 seconds. [TensorRT] INFO: Calibrated batch 514 in 0.191027 seconds. [TensorRT] INFO: Calibrated batch 515 in 0.190657 seconds. [TensorRT] INFO: Calibrated batch 516 in 0.190566 seconds. [TensorRT] INFO: Calibrated batch 517 in 0.189864 seconds. [TensorRT] INFO: Calibrated batch 518 in 0.190969 seconds. [TensorRT] INFO: Calibrated batch 519 in 0.201977 seconds. [TensorRT] INFO: Calibrated batch 520 in 0.200145 seconds. [TensorRT] INFO: Calibrated batch 521 in 0.191354 seconds. [TensorRT] INFO: Calibrated batch 522 in 0.190661 seconds. [TensorRT] INFO: Calibrated batch 523 in 0.190969 seconds. [TensorRT] INFO: Calibrated batch 524 in 0.190293 seconds. [TensorRT] INFO: Calibrated batch 525 in 0.190113 seconds. [TensorRT] INFO: Calibrated batch 526 in 0.189847 seconds. [TensorRT] INFO: Calibrated batch 527 in 0.190545 seconds. [TensorRT] INFO: Calibrated batch 528 in 0.190716 seconds. [TensorRT] INFO: Calibrated batch 529 in 0.191335 seconds. [TensorRT] INFO: Calibrated batch 530 in 0.191339 seconds. [TensorRT] INFO: Calibrated batch 531 in 0.19058 seconds. [TensorRT] INFO: Calibrated batch 532 in 0.190336 seconds. [TensorRT] INFO: Calibrated batch 533 in 0.189791 seconds. [TensorRT] INFO: Calibrated batch 534 in 0.190718 seconds. [TensorRT] INFO: Calibrated batch 535 in 0.190888 seconds. [TensorRT] INFO: Calibrated batch 536 in 0.19049 seconds. [TensorRT] INFO: Calibrated batch 537 in 0.190027 seconds. [TensorRT] INFO: Calibrated batch 538 in 0.189785 seconds. [TensorRT] INFO: Calibrated batch 539 in 0.191183 seconds. [TensorRT] INFO: Calibrated batch 540 in 0.191981 seconds. [TensorRT] INFO: Calibrated batch 541 in 0.189858 seconds. [TensorRT] INFO: Calibrated batch 542 in 0.191176 seconds. [TensorRT] INFO: Calibrated batch 543 in 0.20096 seconds. 2.587712421417236 IMG (1, 3, 224, 224) -1.8956582550225514 2.6399999999999997 IMG (1, 3, 224, 224) -1.946656385753873 2.4831372642517087 IMG (1, 3, 224, 224) -1.8781512532649296 2.6399999999999997 IMG (1, 3, 224, 224) -1.8781512532649296 2.6399999999999997 IMG (1, 3, 224, 224) -1.930672266853175 2.4831372642517087 IMG (1, 3, 224, 224) -1.8956582550225514 2.6399999999999997 IMG (1, 3, 224, 224) -1.930672266853175 2.4482788785298664 IMG (1, 3, 224, 224) -2.0007002780413523 2.50056645711263 IMG (1, 3, 224, 224) -2.0494049107533874 2.2042701784769694 IMG (1, 3, 224, 224) -1.930672266853175 2.6051416142781574 IMG (1, 3, 224, 224) -2.0182072818778187 2.50056645711263 IMG (1, 3, 224, 224) -1.9131652650955533 2.6399999999999997 IMG (1, 3, 224, 224) -1.946656385753873 2.6399999999999997 IMG (1, 3, 224, 224) -1.9295316329429242 2.3785621070861813 IMG (1, 3, 224, 224) -2.0665296676312472 2.50056645711263 IMG (1, 3, 224, 224) -1.9831932762837303 2.430849685668945 IMG (1, 3, 224, 224) -1.9131652650955533 2.6399999999999997 IMG (1, 3, 224, 224) -1.9831932762837303 2.413420492808024 IMG (1, 3, 224, 224) -1.9481792686107968 2.50056645711263 IMG (1, 3, 224, 224) -1.9656862703684186 2.5179956499735514 IMG (1, 3, 224, 224) -1.9809058913757707 2.6399999999999997 IMG (1, 3, 224, 224) -2.0182072818778187 2.4482788785298664 IMG (1, 3, 224, 224) -1.9295316329429242 2.343703721364339 IMG (1, 3, 224, 224) -1.9809058913757707 2.6399999999999997 IMG (1, 3, 224, 224) -1.861032621699129 2.6399999999999997 IMG (1, 3, 224, 224) -1.9131652650955533 2.4482788785298664 IMG (1, 3, 224, 224) -1.930672266853175 2.6225708071390788 IMG (1, 3, 224, 224) -2.0357142857142856 2.50056645711263 IMG (1, 3, 224, 224) -1.946656385753873 2.4831372642517087 IMG (1, 3, 224, 224) -2.1007791752866 1.8858543740851537 IMG (1, 3, 224, 224) -1.9124068801319754 2.6051416142781574 IMG (1, 3, 224, 224) -1.9131652650955533 2.6051416142781574 IMG (1, 3, 224, 224) -1.9831932762837303 2.50056645711263 IMG (1, 3, 224, 224) -1.9980306523205411 2.2914161427815753 IMG (1, 3, 224, 224) -2.0322801579424388 2.413420492808024 IMG (1, 3, 224, 224) -1.9656862703684186 2.6399999999999997 IMG (1, 3, 224, 224) -1.9131652650955533 2.5528540356953937 IMG (1, 3, 224, 224) -1.9131652650955533 2.6225708071390788 IMG (1, 3, 224, 224) -1.9980306523205411 2.3785621070861813 IMG (1, 3, 224, 224) -1.9656862703684186 2.3959912999471027 IMG (1, 3, 224, 224) -1.9131652650955533 2.4657080713907877 IMG (1, 3, 224, 224) -1.9809058913757707 2.6051416142781574 IMG (1, 3, 224, 224) -1.930672266853175 2.6399999999999997 IMG (1, 3, 224, 224) -1.930672266853175 2.5179956499735514 IMG (1, 3, 224, 224) -1.9656862703684186 2.4657080713907877 IMG (1, 3, 224, 224) -2.083654420442196 2.5179956499735514 IMG (1, 3, 224, 224) -1.9831932762837303 2.413420492808024 IMG (1, 3, 224, 224) -1.946656385753873 2.570283228556315 IMG (1, 3, 224, 224) -2.0007002780413523 2.413420492808024 IMG (1, 3, 224, 224) -1.9809058913757707 2.413420492808024 IMG (1, 3, 224, 224) -1.930672266853175 2.4831372642517087 IMG (1, 3, 224, 224) -1.946656385753873 2.6399999999999997 IMG (1, 3, 224, 224) -1.8781512532649296 2.6399999999999997 IMG (1, 3, 224, 224) -2.0007002780413523 2.5354248428344723 IMG (1, 3, 224, 224) -1.9131652650955533 2.50056645711263 IMG (1, 3, 224, 224) -1.9131652650955533 2.6399999999999997 IMG (1, 3, 224, 224) -1.7754088413767417 2.430849685668945 IMG (1, 3, 224, 224) -1.946656385753873 2.6399999999999997 IMG (1, 3, 224, 224) -1.930672266853175 2.6399999999999997 IMG (1, 3, 224, 224) -1.9637811385648218 2.6399999999999997 IMG (1, 3, 224, 224) -2.0357142857142856 2.430849685668945 IMG (1, 3, 224, 224) -2.1007791752866 2.6399999999999997 IMG (1, 3, 224, 224) -1.946656385753873 2.6399999999999997 IMG (1, 3, 224, 224) -1.9131652650955533 2.6225708071390788 IMG (1, 3, 224, 224) -1.9656862703684186 2.587712421417236 IMG (1, 3, 224, 224) -2.0007002780413523 2.430849685668945 IMG (1, 3, 224, 224) -1.930672266853175 2.6399999999999997 IMG (1, 3, 224, 224) -1.9656862703684186 2.0648366355895993 IMG (1, 3, 224, 224) -1.9131652650955533 2.3785621070861813 IMG (1, 3, 224, 224) -1.930672266853175 2.6225708071390788 IMG (1, 3, 224, 224) -2.0182072818778187 2.4831372642517087 IMG (1, 3, 224, 224) -2.0182072818778187 2.50056645711263 IMG (1, 3, 224, 224) -1.843907852620537 2.570283228556315 IMG (1, 3, 224, 224) -1.861032621699129 2.6399999999999997 IMG (1, 3, 224, 224) -1.9481792686107968 2.4657080713907877 IMG (1, 3, 224, 224) -2.0665296676312472 2.3060224162680765 IMG (1, 3, 224, 224) -1.2128851365830218 1.0159260945549178 IMG (1, 3, 224, 224) -2.0665296676312472 2.3235294180256982 IMG (1, 3, 224, 224) -2.083654420442196 2.256557757059733 IMG (1, 3, 224, 224) -2.1179039301310043 0.6356428209940591 IMG (1, 3, 224, 224) -1.125350127794913 0.998801341743969 IMG (1, 3, 224, 224) -2.1179039301310043 2.6051416142781574 IMG (1, 3, 224, 224) -2.1007791752866 2.6399999999999997 IMG (1, 3, 224, 224) -1.9809058913757707 2.186840985616048 IMG (1, 3, 224, 224) -2.0357142857142856 1.6495419485600233 IMG (1, 3, 224, 224) -1.125350127794913 0.9816765889330202 IMG (1, 3, 224, 224) -2.1007791752866 2.3235294180256982 IMG (1, 3, 224, 224) -2.0665296676312472 2.2885154145104547 IMG (1, 3, 224, 224) -2.1007791752866 2.6399999999999997 IMG (1, 3, 224, 224) -2.083654420442196 2.3235294180256982 IMG (1, 3, 224, 224) -2.083654420442196 2.34103641978332 IMG (1, 3, 224, 224) -2.1007791752866 2.6225708071390788 IMG (1, 3, 224, 224) -2.083654420442196 2.3235294180256982 IMG (1, 3, 224, 224) -2.083654420442196 2.2489082969432315 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.9980306523205411 2.0648366355895993 IMG (1, 3, 224, 224) -2.1179039301310043 2.4657080713907877 IMG (1, 3, 224, 224) -1.9980306523205411 2.2216993713378903 IMG (1, 3, 224, 224) -2.0494049107533874 2.3060224162680765 IMG (1, 3, 224, 224) -1.2303921383406435 0.998801341743969 IMG (1, 3, 224, 224) -2.1179039301310043 2.587712421417236 IMG (1, 3, 224, 224) -2.0494049107533874 2.099695021311442 IMG (1, 3, 224, 224) -2.0494049107533874 2.256557757059733 IMG (1, 3, 224, 224) -2.1179039301310043 2.587712421417236 IMG (1, 3, 224, 224) -1.125350127794913 1.0330508473658666 IMG (1, 3, 224, 224) -2.0665296676312472 2.3060224162680765 IMG (1, 3, 224, 224) -2.0151554051314897 1.9951198641459145 IMG (1, 3, 224, 224) -1.9980306523205411 2.186840985616048 IMG (1, 3, 224, 224) -1.2478991400982653 0.9816765889330202 IMG (1, 3, 224, 224) -2.1007791752866 2.3060224162680765 IMG (1, 3, 224, 224) -1.843907852620537 0.025620938407050115 IMG (1, 3, 224, 224) -2.0151554051314897 2.1694117927551266 IMG (1, 3, 224, 224) -1.9809058913757707 2.256557757059733 IMG (1, 3, 224, 224) -2.0494049107533874 2.2885154145104547 IMG (1, 3, 224, 224) -2.0494049107533874 2.099695021311442 IMG (1, 3, 224, 224) -2.1179039301310043 2.4831372642517087 IMG (1, 3, 224, 224) -2.0494049107533874 2.1694117927551266 IMG (1, 3, 224, 224) -2.1179039301310043 2.6051416142781574 IMG (1, 3, 224, 224) -1.9809058913757707 2.1519825998942057 IMG (1, 3, 224, 224) -1.8267830998095882 2.430849685668945 IMG (1, 3, 224, 224) -1.9831932762837303 1.8892884879133065 IMG (1, 3, 224, 224) -2.1007791752866 2.50056645711263 IMG (1, 3, 224, 224) -1.9809058913757707 2.1694117927551266 IMG (1, 3, 224, 224) -2.1179039301310043 2.570283228556315 IMG (1, 3, 224, 224) -2.083654420442196 2.3060224162680765 IMG (1, 3, 224, 224) -2.1007791752866 2.6051416142781574 IMG (1, 3, 224, 224) -2.1007791752866 2.271008412752833 IMG (1, 3, 224, 224) -2.1007791752866 2.3060224162680765 IMG (1, 3, 224, 224) -2.0665296676312472 2.117124214172363 IMG (1, 3, 224, 224) -2.0322801579424388 2.0648366355895993 IMG (1, 3, 224, 224) -2.0665296676312472 2.3235294180256982 IMG (1, 3, 224, 224) -2.1179039301310043 2.587712421417236 IMG (1, 3, 224, 224) -2.0322801579424388 2.186840985616048 IMG (1, 3, 224, 224) -1.1953781348254 1.0365142567952472 IMG (1, 3, 224, 224) -2.0665296676312472 2.2885154145104547 IMG (1, 3, 224, 224) -1.1603641313101565 1.0673003529877643 IMG (1, 3, 224, 224) -2.0665296676312472 2.3235294180256982 IMG (1, 3, 224, 224) -2.0151554051314897 2.117124214172363 IMG (1, 3, 224, 224)[TensorRT] INFO: Calibrated batch 544 in 0.191619 seconds. [TensorRT] INFO: Calibrated batch 545 in 0.191736 seconds. [TensorRT] INFO: Calibrated batch 546 in 0.190486 seconds. [TensorRT] INFO: Calibrated batch 547 in 0.189868 seconds. [TensorRT] INFO: Calibrated batch 548 in 0.189775 seconds. [TensorRT] INFO: Calibrated batch 549 in 0.190541 seconds. [TensorRT] INFO: Calibrated batch 550 in 0.190873 seconds. [TensorRT] INFO: Calibrated batch 551 in 0.190969 seconds. [TensorRT] INFO: Calibrated batch 552 in 0.190449 seconds. [TensorRT] INFO: Calibrated batch 553 in 0.190503 seconds. [TensorRT] INFO: Calibrated batch 554 in 0.18998 seconds. [TensorRT] INFO: Calibrated batch 555 in 0.190436 seconds. [TensorRT] INFO: Calibrated batch 556 in 0.191324 seconds. [TensorRT] INFO: Calibrated batch 557 in 0.190815 seconds. [TensorRT] INFO: Calibrated batch 558 in 0.190371 seconds. [TensorRT] INFO: Calibrated batch 559 in 0.190414 seconds. [TensorRT] INFO: Calibrated batch 560 in 0.190231 seconds. [TensorRT] INFO: Calibrated batch 561 in 0.19019 seconds. [TensorRT] INFO: Calibrated batch 562 in 0.190566 seconds. [TensorRT] INFO: Calibrated batch 563 in 0.189903 seconds. [TensorRT] INFO: Calibrated batch 564 in 0.190151 seconds. [TensorRT] INFO: Calibrated batch 565 in 0.190406 seconds. [TensorRT] INFO: Calibrated batch 566 in 0.19853 seconds. [TensorRT] INFO: Calibrated batch 567 in 0.194445 seconds. [TensorRT] INFO: Calibrated batch 568 in 0.194964 seconds. [TensorRT] INFO: Calibrated batch 569 in 0.190006 seconds. [TensorRT] INFO: Calibrated batch 570 in 0.190294 seconds. [TensorRT] INFO: Calibrated batch 571 in 0.191622 seconds. [TensorRT] INFO: Calibrated batch 572 in 0.191475 seconds. [TensorRT] INFO: Calibrated batch 573 in 0.190101 seconds. [TensorRT] INFO: Calibrated batch 574 in 0.189552 seconds. [TensorRT] INFO: Calibrated batch 575 in 0.190213 seconds. [TensorRT] INFO: Calibrated batch 576 in 0.189912 seconds. [TensorRT] INFO: Calibrated batch 577 in 0.190041 seconds. [TensorRT] INFO: Calibrated batch 578 in 0.191774 seconds. [TensorRT] INFO: Calibrated batch 579 in 0.191528 seconds. [TensorRT] INFO: Calibrated batch 580 in 0.191754 seconds. [TensorRT] INFO: Calibrated batch 581 in 0.190047 seconds. [TensorRT] INFO: Calibrated batch 582 in 0.190872 seconds. [TensorRT] INFO: Calibrated batch 583 in 0.189932 seconds. [TensorRT] INFO: Calibrated batch 584 in 0.189541 seconds. [TensorRT] INFO: Calibrated batch 585 in 0.190104 seconds. [TensorRT] INFO: Calibrated batch 586 in 0.19643 seconds. [TensorRT] INFO: Calibrated batch 587 in 0.202302 seconds. [TensorRT] INFO: Calibrated batch 588 in 0.192792 seconds. [TensorRT] INFO: Post Processing Calibration data in 2.62572 seconds. [TensorRT] VERBOSE: Overriding tensor scales: 445 [inf] using 445 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 493 [inf] using 493 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 583 [inf] using 583 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 673 [inf] using 673 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 735 [inf] using 735 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 427 copy [inf] using 445 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 427 [inf] using 427 copy [inf] [TensorRT] VERBOSE: Overriding tensor scales: 444 copy [inf] using 445 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 444 [inf] using 444 copy [inf] [TensorRT] VERBOSE: Overriding tensor scales: 468 copy [inf] using 493 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 468 [inf] using 468 copy [inf] [TensorRT] VERBOSE: Overriding tensor scales: 492 copy [inf] using 493 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 492 [inf] using 492 copy [inf] [TensorRT] VERBOSE: Overriding tensor scales: 516 copy [inf] using 583 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 516 [inf] using 516 copy [inf] [TensorRT] VERBOSE: Overriding tensor scales: 582 copy [inf] using 583 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 582 [inf] using 582 copy [inf] [TensorRT] VERBOSE: Overriding tensor scales: 606 copy [inf] using 673 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 606 [inf] using 606 copy [inf] [TensorRT] VERBOSE: Overriding tensor scales: 672 copy [inf] using 673 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 672 [inf] using 672 copy [inf] [TensorRT] VERBOSE: Overriding tensor scales: 696 copy [inf] using 735 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 696 [inf] using 696 copy [inf] [TensorRT] VERBOSE: Overriding tensor scales: 734 copy [inf] using 735 [inf] [TensorRT] VERBOSE: Overriding tensor scales: 734 [inf] using 734 copy [inf] [TensorRT] INFO: Calibration completed in 129.679 seconds. [TensorRT] VERBOSE: INT8 Inference Tensor Scales: input range [-2.04692e+38,2.04692e+38] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 742 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 407 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 745 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 410 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 748 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 413 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 427 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 434 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 751 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 437 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 754 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 440 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 441 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 757 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 444 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 445 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 760 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 448 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 763 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 451 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 766 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 454 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 468 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 475 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 769 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 478 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 772 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 481 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 482 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 775 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 485 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 778 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 488 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 489 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 781 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 492 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 493 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 784 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 496 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 787 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 499 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 790 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 502 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 516 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 523 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 793 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 526 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 796 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 529 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 530 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 799 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 533 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 802 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 536 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 537 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 805 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 540 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 808 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 543 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 544 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 811 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 547 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 814 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 550 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 551 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 817 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 554 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 820 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 557 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 558 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 823 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 561 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 826 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 564 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 565 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 829 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 568 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 832 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 571 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 572 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 835 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 575 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 838 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 578 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 579 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 841 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 582 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 583 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 844 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 586 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 847 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 589 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 850 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 592 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 606 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 613 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 853 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 616 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 856 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 619 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 620 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 859 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 623 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 862 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 626 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 627 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 865 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 630 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 868 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 633 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 634 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 871 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 637 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 874 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 640 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 641 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 877 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 644 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 880 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 647 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 648 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 883 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 651 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 886 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 654 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 655 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 889 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 658 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 892 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 661 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 662 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 895 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 665 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 898 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 668 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 669 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 901 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 672 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 673 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 904 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 676 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 907 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 679 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 910 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 682 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 696 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 703 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 913 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 706 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 916 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 709 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 710 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 919 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 713 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 922 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 716 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 717 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 925 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 720 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 928 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 723 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 724 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 931 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 727 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 934 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 730 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 731 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 937 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 734 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 735 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 940 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 738 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 739 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 740 range [-inf,inf] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: (Unnamed Layer* 461) [Constant]_output range [-0.151062,0.151062] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: (Unnamed Layer* 462) [Matrix Multiply]_output range [nan,nan] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: (Unnamed Layer* 463) [Constant]_output range [-0.137925,0.137925] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: (Unnamed Layer* 464) [Shuffle]_output range [-0.137925,0.137925] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: output range [nan,nan] [TensorRT] VERBOSE: Original: 179 layers [TensorRT] VERBOSE: After dead-layer removal: 179 layers [TensorRT] VERBOSE: Fusing (Unnamed Layer* 463) [Constant] with (Unnamed Layer* 464) [Shuffle] [TensorRT] VERBOSE: After Myelin optimization: 178 layers [TensorRT] VERBOSE: After scale fusion: 178 layers [TensorRT] VERBOSE: Swap the layer type of GlobalAveragePool_227 from REDUCE to POOLING [TensorRT] VERBOSE: Fusing LeakyRelu_22 with Add_23 [TensorRT] VERBOSE: Fusing LeakyRelu_49 with Add_50 [TensorRT] VERBOSE: Fusing LeakyRelu_54 with Add_55 [TensorRT] VERBOSE: Fusing LeakyRelu_81 with Add_82 [TensorRT] VERBOSE: Fusing LeakyRelu_86 with Add_87 [TensorRT] VERBOSE: Fusing LeakyRelu_91 with Add_92 [TensorRT] VERBOSE: Fusing LeakyRelu_96 with Add_97 [TensorRT] VERBOSE: Fusing LeakyRelu_101 with Add_102 [TensorRT] VERBOSE: Fusing LeakyRelu_106 with Add_107 [TensorRT] VERBOSE: Fusing LeakyRelu_111 with Add_112 [TensorRT] VERBOSE: Fusing LeakyRelu_116 with Add_117 [TensorRT] VERBOSE: Fusing LeakyRelu_143 with Add_144 [TensorRT] VERBOSE: Fusing LeakyRelu_148 with Add_149 [TensorRT] VERBOSE: Fusing LeakyRelu_153 with Add_154 [TensorRT] VERBOSE: Fusing LeakyRelu_158 with Add_159 [TensorRT] VERBOSE: Fusing LeakyRelu_163 with Add_164 [TensorRT] VERBOSE: Fusing LeakyRelu_168 with Add_169 [TensorRT] VERBOSE: Fusing LeakyRelu_173 with Add_174 [TensorRT] VERBOSE: Fusing LeakyRelu_178 with Add_179 [TensorRT] VERBOSE: Fusing LeakyRelu_205 with Add_206 [TensorRT] VERBOSE: Fusing LeakyRelu_210 with Add_211 [TensorRT] VERBOSE: Fusing LeakyRelu_215 with Add_216 [TensorRT] VERBOSE: Fusing LeakyRelu_220 with Add_221 [TensorRT] VERBOSE: After vertical fusions: 155 layers [TensorRT] VERBOSE: After final dead-layer removal: 155 layers [TensorRT] VERBOSE: After tensor merging: 155 layers [TensorRT] VERBOSE: Replacing slice Slice_18 with copy from 413 to 434 [TensorRT] VERBOSE: Overriding 434 range [-inf,inf] using 413 range [-inf,inf] [TensorRT] VERBOSE: Assigning 413 copy range using 413 range [-inf,inf] [TensorRT] VERBOSE: Replacing slice Slice_15 with copy from 413 to 427 [TensorRT] VERBOSE: Overriding 427 range [-inf,inf] using 413 range [-inf,inf] [TensorRT] VERBOSE: Assigning 413 copy range using 413 range [-inf,inf] [TensorRT] VERBOSE: Replacing slice Slice_45 with copy from 454 to 475 [TensorRT] VERBOSE: Overriding 475 range [-inf,inf] using 454 range [-inf,inf] [TensorRT] VERBOSE: Assigning 454 copy range using 454 range [-inf,inf] [TensorRT] VERBOSE: Replacing slice Slice_42 with copy from 454 to 468 [TensorRT] VERBOSE: Overriding 468 range [-inf,inf] using 454 range [-inf,inf] [TensorRT] VERBOSE: Assigning 454 copy range using 454 range [-inf,inf] [TensorRT] VERBOSE: Replacing slice Slice_77 with copy from 502 to 523 [TensorRT] VERBOSE: Overriding 523 range [-inf,inf] using 502 range [-inf,inf] [TensorRT] VERBOSE: Assigning 502 copy range using 502 range [-inf,inf] [TensorRT] VERBOSE: Replacing slice Slice_74 with copy from 502 to 516 [TensorRT] VERBOSE: Overriding 516 range [-inf,inf] using 502 range [-inf,inf] [TensorRT] VERBOSE: Assigning 502 copy range using 502 range [-inf,inf] [TensorRT] VERBOSE: Replacing slice Slice_139 with copy from 592 to 613 [TensorRT] VERBOSE: Overriding 613 range [-inf,inf] using 592 range [-inf,inf] [TensorRT] VERBOSE: Assigning 592 copy range using 592 range [-inf,inf] [TensorRT] VERBOSE: Replacing slice Slice_136 with copy from 592 to 606 [TensorRT] VERBOSE: Overriding 606 range [-inf,inf] using 592 range [-inf,inf] [TensorRT] VERBOSE: Assigning 592 copy range using 592 range [-inf,inf] [TensorRT] VERBOSE: Replacing slice Slice_201 with copy from 682 to 703 [TensorRT] VERBOSE: Overriding 703 range [-inf,inf] using 682 range [-inf,inf] [TensorRT] VERBOSE: Assigning 682 copy range using 682 range [-inf,inf] [TensorRT] VERBOSE: Replacing slice Slice_198 with copy from 682 to 696 [TensorRT] VERBOSE: Overriding 696 range [-inf,inf] using 682 range [-inf,inf] [TensorRT] VERBOSE: Assigning 682 copy range using 682 range [-inf,inf] [TensorRT] VERBOSE: Eliminating concatenation Concat_26 [TensorRT] VERBOSE: Retargeting 427 to 445 [TensorRT] VERBOSE: Overriding 427 range [-inf,inf] using 445 range [-inf,inf] [TensorRT] VERBOSE: Retargeting 444 to 445 [TensorRT] VERBOSE: Overriding 444 range [-inf,inf] using 445 range [-inf,inf] [TensorRT] VERBOSE: Eliminating concatenation Concat_58 [TensorRT] VERBOSE: Retargeting 468 to 493 [TensorRT] VERBOSE: Overriding 468 range [-inf,inf] using 493 range [-inf,inf] [TensorRT] VERBOSE: Retargeting 492 to 493 [TensorRT] VERBOSE: Overriding 492 range [-inf,inf] using 493 range [-inf,inf] [TensorRT] VERBOSE: Eliminating concatenation Concat_120 [TensorRT] VERBOSE: Retargeting 516 to 583 [TensorRT] VERBOSE: Overriding 516 range [-inf,inf] using 583 range [-inf,inf] [TensorRT] VERBOSE: Retargeting 582 to 583 [TensorRT] VERBOSE: Overriding 582 range [-inf,inf] using 583 range [-inf,inf] [TensorRT] VERBOSE: Eliminating concatenation Concat_182 [TensorRT] VERBOSE: Retargeting 606 to 673 [TensorRT] VERBOSE: Overriding 606 range [-inf,inf] using 673 range [-inf,inf] [TensorRT] VERBOSE: Retargeting 672 to 673 [TensorRT] VERBOSE: Overriding 672 range [-inf,inf] using 673 range [-inf,inf] [TensorRT] VERBOSE: Eliminating concatenation Concat_224 [TensorRT] VERBOSE: Retargeting 696 to 735 [TensorRT] VERBOSE: Overriding 696 range [-inf,inf] using 735 range [-inf,inf] [TensorRT] VERBOSE: Retargeting 734 to 735 [TensorRT] VERBOSE: Overriding 734 range [-inf,inf] using 735 range [-inf,inf] [TensorRT] VERBOSE: After concat removal: 150 layers [TensorRT] INFO: Writing Calibration Cache for calibrator: TRT-7103-EntropyCalibration2 [TensorRT] VERBOSE: Dynamic range would not be set for tensor 445. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [TensorRT] VERBOSE: Dynamic range would not be set for tensor 493. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [TensorRT] VERBOSE: Dynamic range would not be set for tensor 583. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [TensorRT] VERBOSE: Dynamic range would not be set for tensor 673. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [TensorRT] VERBOSE: Dynamic range would not be set for tensor 735. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [TensorRT] VERBOSE: Configuring builder for Int8 Mode completed in 129.772 seconds. [TensorRT] VERBOSE: Graph construction and optimization completed in 129.792 seconds. [TensorRT] INFO: [TensorRT] INFO: --------------- Layers running on DLA: [TensorRT] INFO: [TensorRT] INFO: --------------- Layers running on GPU: [TensorRT] INFO: Conv_0, LeakyRelu_1, Conv_2, LeakyRelu_3, Conv_4, LeakyRelu_5, Slice_18, Conv_19, LeakyRelu_20, Conv_21, PWN(LeakyRelu_22, Add_23), Conv_24, Slice_15, LeakyRelu_25, Conv_27, LeakyRelu_28, Conv_29, LeakyRelu_30, Conv_31, LeakyRelu_32, Slice_45, Conv_46, LeakyRelu_47, Conv_48, PWN(LeakyRelu_49, Add_50), Conv_51, LeakyRelu_52, Conv_53, PWN(LeakyRelu_54, Add_55), Conv_56, Slice_42, LeakyRelu_57, Conv_59, LeakyRelu_60, Conv_61, LeakyRelu_62, Conv_63, LeakyRelu_64, Slice_77, Conv_78, LeakyRelu_79, Conv_80, PWN(LeakyRelu_81, Add_82), Conv_83, LeakyRelu_84, Conv_85, PWN(LeakyRelu_86, Add_87), Conv_88, LeakyRelu_89, Conv_90, PWN(LeakyRelu_91, Add_92), Conv_93, LeakyRelu_94, Conv_95, PWN(LeakyRelu_96, Add_97), Conv_98, LeakyRelu_99, Conv_100, PWN(LeakyRelu_101, Add_102), Conv_103, LeakyRelu_104, Conv_105, PWN(LeakyRelu_106, Add_107), Conv_108, LeakyRelu_109, Conv_110, PWN(LeakyRelu_111, Add_112), Conv_113, LeakyRelu_114, Conv_115, PWN(LeakyRelu_116, Add_117), Conv_118, Slice_74, LeakyRelu_119, Conv_121, LeakyRelu_122, Conv_123, LeakyRelu_124, Conv_125, LeakyRelu_126, Slice_139, Conv_140, LeakyRelu_141, Conv_142, PWN(LeakyRelu_143, Add_144), Conv_145, LeakyRelu_146, Conv_147, PWN(LeakyRelu_148, Add_149), Conv_150, LeakyRelu_151, Conv_152, PWN(LeakyRelu_153, Add_154), Conv_155, LeakyRelu_156, Conv_157, PWN(LeakyRelu_158, Add_159), Conv_160, LeakyRelu_161, Conv_162, PWN(LeakyRelu_163, Add_164), Conv_165, LeakyRelu_166, Conv_167, PWN(LeakyRelu_168, Add_169), Conv_170, LeakyRelu_171, Conv_172, PWN(LeakyRelu_173, Add_174), Conv_175, LeakyRelu_176, Conv_177, PWN(LeakyRelu_178, Add_179), Conv_180, Slice_136, LeakyRelu_181, Conv_183, LeakyRelu_184, Conv_185, LeakyRelu_186, Conv_187, LeakyRelu_188, Slice_201, Conv_202, LeakyRelu_203, Conv_204, PWN(LeakyRelu_205, Add_206), Conv_207, LeakyRelu_208, Conv_209, PWN(LeakyRelu_210, Add_211), Conv_212, LeakyRelu_213, Conv_214, PWN(LeakyRelu_215, Add_216), Conv_217, LeakyRelu_218, Conv_219, PWN(LeakyRelu_220, Add_221), Conv_222, Slice_198, LeakyRelu_223, Conv_225, LeakyRelu_226, GlobalAveragePool_227, Flatten_228, head.fc.weight, Gemm_229, (Unnamed Layer* 463) [Constant] + (Unnamed Layer* 464) [Shuffle], (Unnamed Layer* 465) [ElementWise], [TensorRT] VERBOSE: Constructing optimization profile number 0 [1/1]. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.193856 [TensorRT] VERBOSE: Tactic: 0 time 0.020256 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020256 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.231072 [TensorRT] VERBOSE: Tactic: 0 time 0.011808 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011808 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.22736 [TensorRT] VERBOSE: Tactic: 0 time 0.071008 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.071008 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,150528) -> Float(1,224,50176,1605632) *************** [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.431136 [TensorRT] VERBOSE: Conv_0 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.203552 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.2456 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.43008 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.633152 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.210432 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.214976 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.161664 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.12368 [TensorRT] VERBOSE: Fastest Tactic: -3946921629105938337 Time: 0.12368 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.358304 [TensorRT] VERBOSE: Tactic: 2 time 1.23069 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 722432, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 19968, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.362464 [TensorRT] INFO: Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output. [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.358304 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3946921629105938337 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176,150528) -> Int8(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,50176) -> Float(1,224,50176,1605632) *************** [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.321152 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.126496 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.1024 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.163584 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.12912 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.105696 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.19696 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.160096 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.321088 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.516288 [TensorRT] VERBOSE: Fastest Tactic: 1659301557717208403 Time: 0.1024 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1659301557717208403 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,50176) -> Int8(1,224,50176:4,401408) *************** [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.1216 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.119488 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.087776 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.241984 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.065792 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.241632 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.06448 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.40144 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.086848 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.139296 [TensorRT] VERBOSE: Fastest Tactic: -6282183216199417697 Time: 0.06448 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6282183216199417697 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,50176) -> Int8(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.088608 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.066592 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.136512 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.063808 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.116864 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.086752 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.235776 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.119328 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.23584 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.39056 [TensorRT] VERBOSE: Fastest Tactic: 8047041638267142825 Time: 0.063808 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8047041638267142825 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:32,50176) -> Float(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:32,50176) -> Int8(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.280768 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.172384 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.347584 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.167968 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.1648 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.29888 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.34816 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.170688 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.170912 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.164288 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.34416 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.271744 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.164288 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.273568 [TensorRT] VERBOSE: Tactic: 0 time 0.756992 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.273568 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.339968 [TensorRT] VERBOSE: Tactic: 0 time 0.071776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.071776 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.326528 [TensorRT] VERBOSE: Tactic: 0 time 0.663776 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.326528 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.713728 [TensorRT] VERBOSE: Tactic: 0 time 0.689184 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.689184 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.354752 [TensorRT] VERBOSE: Tactic: 0 time 0.722656 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.354752 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.28928 [TensorRT] VERBOSE: Tactic: 0 time 1.37347 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.28928 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.348928 [TensorRT] VERBOSE: Tactic: 0 time 0.105984 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.105984 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.339488 [TensorRT] VERBOSE: Tactic: 0 time 0.87408 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.339488 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.336256 [TensorRT] VERBOSE: Tactic: 0 time 0.04288 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04288 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.338208 [TensorRT] VERBOSE: Tactic: 0 time 0.48544 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.338208 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.26464 [TensorRT] VERBOSE: Tactic: 0 time 1.23626 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.26464 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.321824 [TensorRT] VERBOSE: Tactic: 0 time 0.04112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04112 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,1605632) -> Float(1,224,50176,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.229536 [TensorRT] VERBOSE: Tactic: 256 time 0.229728 [TensorRT] VERBOSE: Tactic: 512 time 0.232992 [TensorRT] VERBOSE: Tactic: -32 time 0.3072 [TensorRT] VERBOSE: Tactic: -64 time 0.270752 [TensorRT] VERBOSE: Tactic: -128 time 0.267712 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.229536 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.136928 [TensorRT] VERBOSE: Tactic: 1 time 0.128064 [TensorRT] VERBOSE: Tactic: 2 time 0.11552 [TensorRT] VERBOSE: Tactic: 3 time 0.126464 [TensorRT] VERBOSE: Tactic: 4 time 0.116032 [TensorRT] VERBOSE: Tactic: 5 time 0.11344 [TensorRT] VERBOSE: Tactic: 6 time 0.132288 [TensorRT] VERBOSE: Tactic: 7 time 0.11744 [TensorRT] VERBOSE: Tactic: 8 time 0.113472 [TensorRT] VERBOSE: Tactic: 9 time 0.115584 [TensorRT] VERBOSE: Tactic: 28 time 0.132448 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.11344 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176:32,50176) -> Float(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.231424 [TensorRT] VERBOSE: Tactic: 256 time 0.231776 [TensorRT] VERBOSE: Tactic: 512 time 0.235424 [TensorRT] VERBOSE: Tactic: -32 time 0.308704 [TensorRT] VERBOSE: Tactic: -64 time 0.270272 [TensorRT] VERBOSE: Tactic: -128 time 0.268032 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.231424 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.200736 [TensorRT] VERBOSE: Tactic: 25 time 0.194528 [TensorRT] VERBOSE: Tactic: 26 time 0.187808 [TensorRT] VERBOSE: Tactic: 27 time 0.194368 [TensorRT] VERBOSE: Tactic: 31 time 0.189376 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.187808 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,401408) -> Int8(1,224,50176:4,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.30928 [TensorRT] VERBOSE: Tactic: 256 time 0.259072 [TensorRT] VERBOSE: Tactic: 512 time 0.261632 [TensorRT] VERBOSE: Tactic: -32 time 0.323648 [TensorRT] VERBOSE: Tactic: -64 time 0.346208 [TensorRT] VERBOSE: Tactic: -128 time 0.352864 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.259072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.077472 [TensorRT] VERBOSE: Tactic: 1 time 0.057056 [TensorRT] VERBOSE: Tactic: 2 time 0.05696 [TensorRT] VERBOSE: Tactic: 3 time 0.049248 [TensorRT] VERBOSE: Tactic: 4 time 0.0536 [TensorRT] VERBOSE: Tactic: 5 time 0.056096 [TensorRT] VERBOSE: Tactic: 6 time 0.047008 [TensorRT] VERBOSE: Tactic: 7 time 0.054176 [TensorRT] VERBOSE: Tactic: 8 time 0.06528 [TensorRT] VERBOSE: Tactic: 9 time 0.071296 [TensorRT] VERBOSE: Tactic: 10 time 0.138048 [TensorRT] VERBOSE: Tactic: 11 time 0.099552 [TensorRT] VERBOSE: Tactic: 12 time 0.088256 [TensorRT] VERBOSE: Tactic: 13 time 0.079424 [TensorRT] VERBOSE: Tactic: 14 time 0.075008 [TensorRT] VERBOSE: Tactic: 15 time 0.074016 [TensorRT] VERBOSE: Tactic: 16 time 0.07312 [TensorRT] VERBOSE: Tactic: 17 time 0.067968 [TensorRT] VERBOSE: Tactic: 18 time 0.075808 [TensorRT] VERBOSE: Tactic: 19 time 0.076544 [TensorRT] VERBOSE: Tactic: 20 time 0.239552 [TensorRT] VERBOSE: Tactic: 21 time 0.165888 [TensorRT] VERBOSE: Tactic: 22 time 0.117696 [TensorRT] VERBOSE: Tactic: 23 time 0.098304 [TensorRT] VERBOSE: Tactic: 28 time 0.110528 [TensorRT] VERBOSE: Tactic: 29 time 0.145152 [TensorRT] VERBOSE: Tactic: 30 time 0.230912 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.047008 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:32,50176) -> Int8(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.270944 [TensorRT] VERBOSE: Tactic: 256 time 0.232288 [TensorRT] VERBOSE: Tactic: 512 time 0.231968 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.231968 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.052128 [TensorRT] VERBOSE: Tactic: 11 time 0.053504 [TensorRT] VERBOSE: Tactic: 12 time 0.054144 [TensorRT] VERBOSE: Tactic: 13 time 0.055776 [TensorRT] VERBOSE: Tactic: 14 time 0.05648 [TensorRT] VERBOSE: Tactic: 15 time 0.074016 [TensorRT] VERBOSE: Tactic: 16 time 0.060576 [TensorRT] VERBOSE: Tactic: 17 time 0.05424 [TensorRT] VERBOSE: Tactic: 18 time 0.074048 [TensorRT] VERBOSE: Tactic: 19 time 0.104768 [TensorRT] VERBOSE: Tactic: 20 time 0.058272 [TensorRT] VERBOSE: Tactic: 21 time 0.052736 [TensorRT] VERBOSE: Tactic: 22 time 0.046112 [TensorRT] VERBOSE: Tactic: 23 time 0.0512 [TensorRT] VERBOSE: Tactic: 24 time 0.080576 [TensorRT] VERBOSE: Tactic: 25 time 0.063232 [TensorRT] VERBOSE: Tactic: 26 time 0.052736 [TensorRT] VERBOSE: Tactic: 27 time 0.0512 [TensorRT] VERBOSE: Tactic: 29 time 0.323104 [TensorRT] VERBOSE: Tactic: 30 time 0.180704 [TensorRT] VERBOSE: Tactic: 31 time 0.11392 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.046112 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.739296 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.739296 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.74656 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.39936 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.741024 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.8272 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.390048 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.393344 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.49072 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.424288 [TensorRT] VERBOSE: Fastest Tactic: 6808617066150061604 Time: 0.390048 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.6328 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 14450688, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 9748480, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 149504, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.6328 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,401408) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.215584 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.139584 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.130592 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.11712 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.13248 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.134272 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.122464 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.11296 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.209856 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.282624 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.11296 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,401408) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.181792 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.181792 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.107552 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.108416 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.130176 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.200608 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.122432 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.199456 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.119808 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.2488 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.118496 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.108416 [TensorRT] VERBOSE: Fastest Tactic: 4438325421691896755 Time: 0.107552 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4438325421691896755 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,401408) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.124 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.123936 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.1072 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.117312 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.107776 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.11664 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.198656 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.108544 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.198112 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.246784 [TensorRT] VERBOSE: Fastest Tactic: 7125598890155666458 Time: 0.1072 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7125598890155666458 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:32,50176) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:32,50176) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.158752 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.158752 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.090496 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.070848 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.106176 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.068768 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.067136 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.09824 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.10752 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.066016 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.069696 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.064 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.10384 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.091008 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.064 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.141152 [TensorRT] VERBOSE: Tactic: 0 time 0.419392 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.141152 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.176992 [TensorRT] VERBOSE: Tactic: 0 time 0.037696 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.037696 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.175008 [TensorRT] VERBOSE: Tactic: 0 time 0.327328 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.175008 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.324576 [TensorRT] VERBOSE: Tactic: 0 time 0.342624 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.324576 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.18544 [TensorRT] VERBOSE: Tactic: 0 time 0.359968 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.18544 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.173952 [TensorRT] VERBOSE: Tactic: 0 time 0.65152 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.173952 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.178144 [TensorRT] VERBOSE: Tactic: 0 time 0.052576 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.052576 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.175744 [TensorRT] VERBOSE: Tactic: 0 time 0.393408 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.175744 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.180704 [TensorRT] VERBOSE: Tactic: 0 time 0.025824 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.025824 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.180928 [TensorRT] VERBOSE: Tactic: 0 time 0.151136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.151136 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.165888 [TensorRT] VERBOSE: Tactic: 0 time 0.58496 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.165888 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.172672 [TensorRT] VERBOSE: Tactic: 0 time 0.040832 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040832 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.118016 [TensorRT] VERBOSE: Tactic: 256 time 0.118208 [TensorRT] VERBOSE: Tactic: 512 time 0.118912 [TensorRT] VERBOSE: Tactic: -32 time 0.173408 [TensorRT] VERBOSE: Tactic: -64 time 0.143008 [TensorRT] VERBOSE: Tactic: -128 time 0.136192 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.118016 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.070336 [TensorRT] VERBOSE: Tactic: 1 time 0.065056 [TensorRT] VERBOSE: Tactic: 2 time 0.05824 [TensorRT] VERBOSE: Tactic: 3 time 0.064544 [TensorRT] VERBOSE: Tactic: 4 time 0.059552 [TensorRT] VERBOSE: Tactic: 5 time 0.05728 [TensorRT] VERBOSE: Tactic: 6 time 0.067488 [TensorRT] VERBOSE: Tactic: 7 time 0.06256 [TensorRT] VERBOSE: Tactic: 8 time 0.058272 [TensorRT] VERBOSE: Tactic: 9 time 0.063712 [TensorRT] VERBOSE: Tactic: 28 time 0.071744 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.05728 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.118688 [TensorRT] VERBOSE: Tactic: 256 time 0.117824 [TensorRT] VERBOSE: Tactic: 512 time 0.12096 [TensorRT] VERBOSE: Tactic: -32 time 0.172192 [TensorRT] VERBOSE: Tactic: -64 time 0.14464 [TensorRT] VERBOSE: Tactic: -128 time 0.138208 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.117824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.095392 [TensorRT] VERBOSE: Tactic: 25 time 0.096768 [TensorRT] VERBOSE: Tactic: 26 time 0.09728 [TensorRT] VERBOSE: Tactic: 27 time 0.097056 [TensorRT] VERBOSE: Tactic: 31 time 0.096576 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.095392 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.157024 [TensorRT] VERBOSE: Tactic: 256 time 0.133984 [TensorRT] VERBOSE: Tactic: 512 time 0.134592 [TensorRT] VERBOSE: Tactic: -32 time 0.167136 [TensorRT] VERBOSE: Tactic: -64 time 0.176928 [TensorRT] VERBOSE: Tactic: -128 time 0.176 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.133984 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.042144 [TensorRT] VERBOSE: Tactic: 1 time 0.033664 [TensorRT] VERBOSE: Tactic: 2 time 0.031936 [TensorRT] VERBOSE: Tactic: 3 time 0.028576 [TensorRT] VERBOSE: Tactic: 4 time 0.032 [TensorRT] VERBOSE: Tactic: 5 time 0.033792 [TensorRT] VERBOSE: Tactic: 6 time 0.02928 [TensorRT] VERBOSE: Tactic: 7 time 0.031744 [TensorRT] VERBOSE: Tactic: 8 time 0.038176 [TensorRT] VERBOSE: Tactic: 9 time 0.04064 [TensorRT] VERBOSE: Tactic: 10 time 0.07152 [TensorRT] VERBOSE: Tactic: 11 time 0.05264 [TensorRT] VERBOSE: Tactic: 12 time 0.047456 [TensorRT] VERBOSE: Tactic: 13 time 0.043296 [TensorRT] VERBOSE: Tactic: 14 time 0.041504 [TensorRT] VERBOSE: Tactic: 15 time 0.039776 [TensorRT] VERBOSE: Tactic: 16 time 0.044 [TensorRT] VERBOSE: Tactic: 17 time 0.03872 [TensorRT] VERBOSE: Tactic: 18 time 0.044128 [TensorRT] VERBOSE: Tactic: 19 time 0.046656 [TensorRT] VERBOSE: Tactic: 20 time 0.123552 [TensorRT] VERBOSE: Tactic: 21 time 0.085504 [TensorRT] VERBOSE: Tactic: 22 time 0.063232 [TensorRT] VERBOSE: Tactic: 23 time 0.052928 [TensorRT] VERBOSE: Tactic: 28 time 0.057824 [TensorRT] VERBOSE: Tactic: 29 time 0.075424 [TensorRT] VERBOSE: Tactic: 30 time 0.117408 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.028576 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.156832 [TensorRT] VERBOSE: Tactic: 256 time 0.132544 [TensorRT] VERBOSE: Tactic: 512 time 0.134944 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.132544 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.028672 [TensorRT] VERBOSE: Tactic: 11 time 0.03024 [TensorRT] VERBOSE: Tactic: 12 time 0.031072 [TensorRT] VERBOSE: Tactic: 13 time 0.031744 [TensorRT] VERBOSE: Tactic: 14 time 0.03056 [TensorRT] VERBOSE: Tactic: 15 time 0.043008 [TensorRT] VERBOSE: Tactic: 16 time 0.028384 [TensorRT] VERBOSE: Tactic: 17 time 0.03392 [TensorRT] VERBOSE: Tactic: 18 time 0.043968 [TensorRT] VERBOSE: Tactic: 19 time 0.064064 [TensorRT] VERBOSE: Tactic: 20 time 0.032768 [TensorRT] VERBOSE: Tactic: 21 time 0.0296 [TensorRT] VERBOSE: Tactic: 22 time 0.028768 [TensorRT] VERBOSE: Tactic: 23 time 0.03088 [TensorRT] VERBOSE: Tactic: 24 time 0.044032 [TensorRT] VERBOSE: Tactic: 25 time 0.035168 [TensorRT] VERBOSE: Tactic: 26 time 0.030432 [TensorRT] VERBOSE: Tactic: 27 time 0.030208 [TensorRT] VERBOSE: Tactic: 29 time 0.165056 [TensorRT] VERBOSE: Tactic: 30 time 0.093248 [TensorRT] VERBOSE: Tactic: 31 time 0.061888 [TensorRT] VERBOSE: Fastest Tactic: 16 Time: 0.028384 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 16 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.21072 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.210944 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.242464 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.205504 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.192896 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.187392 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.1968 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.303104 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.241792 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.187392 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.486048 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 3211264, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 6963200, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 108544, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.486048 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.11504 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.141504 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.126048 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.111264 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.13248 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.128736 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.11072 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.112 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.141216 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.115744 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.125824 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.113664 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.11072 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,401408) *************** [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.066144 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.071616 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.069984 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.069024 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.10096 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.072096 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.084 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.07808 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.072736 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.083392 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.094208 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.0936 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.066144 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3145259992339075399 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.071808 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.099616 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.084224 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.068224 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.078816 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.068 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.091744 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.093888 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.073152 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.08096 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.06864 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.073568 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.068 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.048864 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.06144 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.048544 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.05408 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.060832 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.053248 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.056224 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.053696 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.05232 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.053376 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.059552 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.04976 [TensorRT] VERBOSE: Fastest Tactic: 5754467717466343388 Time: 0.048544 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5754467717466343388 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.279936 [TensorRT] VERBOSE: Tactic: 0 time 0.839584 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.279936 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.64608 [TensorRT] VERBOSE: Tactic: 0 time 0.721344 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.64608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.355328 [TensorRT] VERBOSE: Tactic: 0 time 0.104224 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.104224 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.344256 [TensorRT] VERBOSE: Tactic: 0 time 0.816768 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.344256 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.341568 [TensorRT] VERBOSE: Tactic: 0 time 0.30096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.30096 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.315712 [TensorRT] VERBOSE: Tactic: 0 time 1.11213 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.315712 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.233376 [TensorRT] VERBOSE: Tactic: 256 time 0.232832 [TensorRT] VERBOSE: Tactic: 512 time 0.238976 [TensorRT] VERBOSE: Tactic: -32 time 0.311264 [TensorRT] VERBOSE: Tactic: -64 time 0.27456 [TensorRT] VERBOSE: Tactic: -128 time 0.26912 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.232832 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.138048 [TensorRT] VERBOSE: Tactic: 1 time 0.13152 [TensorRT] VERBOSE: Tactic: 2 time 0.11568 [TensorRT] VERBOSE: Tactic: 3 time 0.130048 [TensorRT] VERBOSE: Tactic: 4 time 0.112096 [TensorRT] VERBOSE: Tactic: 5 time 0.11536 [TensorRT] VERBOSE: Tactic: 6 time 0.135584 [TensorRT] VERBOSE: Tactic: 7 time 0.116896 [TensorRT] VERBOSE: Tactic: 8 time 0.113952 [TensorRT] VERBOSE: Tactic: 9 time 0.116032 [TensorRT] VERBOSE: Tactic: 28 time 0.136384 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.112096 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,50176) -> Float(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.231584 [TensorRT] VERBOSE: Tactic: 256 time 0.233408 [TensorRT] VERBOSE: Tactic: 512 time 0.238688 [TensorRT] VERBOSE: Tactic: -32 time 0.313856 [TensorRT] VERBOSE: Tactic: -64 time 0.275872 [TensorRT] VERBOSE: Tactic: -128 time 0.267968 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.231584 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.193088 [TensorRT] VERBOSE: Tactic: 25 time 0.189792 [TensorRT] VERBOSE: Tactic: 26 time 0.188832 [TensorRT] VERBOSE: Tactic: 27 time 0.18896 [TensorRT] VERBOSE: Tactic: 31 time 0.19264 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.188832 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] WARNING: No implementation of layer LeakyRelu_5 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.282048 [TensorRT] VERBOSE: Tactic: 0 time 0.871392 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.282048 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.64592 [TensorRT] VERBOSE: Tactic: 0 time 0.70144 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.64592 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.133568 [TensorRT] VERBOSE: Tactic: 0 time 0.063904 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.063904 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.14368 [TensorRT] VERBOSE: Tactic: 0 time 0.39968 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.14368 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.181984 [TensorRT] VERBOSE: Tactic: 0 time 0.100768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.100768 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.174208 [TensorRT] VERBOSE: Tactic: 0 time 0.285568 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.174208 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.331232 [TensorRT] VERBOSE: Tactic: 0 time 0.351232 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.331232 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.148256 [TensorRT] VERBOSE: Tactic: 0 time 0.061536 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.061536 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.184672 [TensorRT] VERBOSE: Tactic: 0 time 0.355232 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.184672 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.180736 [TensorRT] VERBOSE: Tactic: 0 time 0.749856 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.180736 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.315392 [TensorRT] VERBOSE: Tactic: 655359 time 0.324288 [TensorRT] VERBOSE: Tactic: 786431 time 0.280512 [TensorRT] VERBOSE: Tactic: 851967 time 0.425056 [TensorRT] VERBOSE: Tactic: 1179647 time 0.277312 [TensorRT] VERBOSE: Tactic: 1310719 time 0.415392 [TensorRT] VERBOSE: Tactic: 1376255 time 0.30528 [TensorRT] VERBOSE: Tactic: 1441791 time 0.413696 [TensorRT] VERBOSE: Tactic: 1507327 time 0.35104 [TensorRT] VERBOSE: Tactic: 1638399 time 0.275104 [TensorRT] VERBOSE: Tactic: 1835007 time 0.289504 [TensorRT] VERBOSE: Tactic: 1900543 time 0.359296 [TensorRT] VERBOSE: Tactic: 2097151 time 0.2816 [TensorRT] VERBOSE: Tactic: 2162687 time 0.300352 [TensorRT] VERBOSE: Tactic: 2293759 time 0.308768 [TensorRT] VERBOSE: Tactic: 2359295 time 0.261088 [TensorRT] VERBOSE: Tactic: 2686975 time 0.286496 [TensorRT] VERBOSE: Tactic: 3080191 time 0.34064 [TensorRT] VERBOSE: Tactic: 3342335 time 0.350368 [TensorRT] VERBOSE: Tactic: 3407871 time 0.278848 [TensorRT] VERBOSE: Tactic: 3538943 time 0.272096 [TensorRT] VERBOSE: Tactic: 3670015 time 0.367744 [TensorRT] VERBOSE: Tactic: 3932159 time 0.34752 [TensorRT] VERBOSE: Tactic: 3997695 time 0.282624 [TensorRT] VERBOSE: Tactic: 4063231 time 0.408576 [TensorRT] VERBOSE: Tactic: 4194303 time 0.269056 [TensorRT] VERBOSE: Tactic: 4259839 time 0.270944 [TensorRT] VERBOSE: Tactic: 4325375 time 0.268096 [TensorRT] VERBOSE: Tactic: 4521983 time 0.287424 [TensorRT] VERBOSE: Tactic: 4587519 time 0.268064 [TensorRT] VERBOSE: Tactic: 4653055 time 0.252384 [TensorRT] VERBOSE: Tactic: 4915199 time 0.26928 [TensorRT] VERBOSE: Tactic: 4980735 time 0.271168 [TensorRT] VERBOSE: Tactic: 5177343 time 0.304384 [TensorRT] VERBOSE: Tactic: 5242879 time 0.284672 [TensorRT] VERBOSE: Tactic: 5373951 time 0.369088 [TensorRT] VERBOSE: Tactic: 5439487 time 0.346848 [TensorRT] VERBOSE: Tactic: 5570559 time 0.346112 [TensorRT] VERBOSE: Tactic: 5636095 time 0.410272 [TensorRT] VERBOSE: Tactic: 5701631 time 0.299008 [TensorRT] VERBOSE: Tactic: 5767167 time 0.84128 [TensorRT] VERBOSE: Tactic: 5832703 time 0.27712 [TensorRT] VERBOSE: Tactic: 5898239 time 0.275488 [TensorRT] VERBOSE: Tactic: 6029311 time 0.297248 [TensorRT] VERBOSE: Tactic: 6225919 time 0.274336 [TensorRT] VERBOSE: Tactic: 6291455 time 0.27872 [TensorRT] VERBOSE: Tactic: 6422527 time 0.326656 [TensorRT] VERBOSE: Tactic: 6750207 time 0.302432 [TensorRT] VERBOSE: Tactic: 6815743 time 0.327424 [TensorRT] VERBOSE: Tactic: 6946815 time 0.334432 [TensorRT] VERBOSE: Tactic: 7012351 time 0.2768 [TensorRT] VERBOSE: Tactic: 7077887 time 0.26144 [TensorRT] VERBOSE: Tactic: 7143423 time 0.347744 [TensorRT] VERBOSE: Tactic: 7208959 time 0.288704 [TensorRT] VERBOSE: Tactic: 7340031 time 0.282944 [TensorRT] VERBOSE: Tactic: 7405567 time 0.278048 [TensorRT] VERBOSE: Tactic: 7536639 time 0.360576 [TensorRT] VERBOSE: Tactic: 7602175 time 0.287104 [TensorRT] VERBOSE: Tactic: 7733247 time 0.25088 [TensorRT] VERBOSE: Tactic: 7798783 time 0.279648 [TensorRT] VERBOSE: Tactic: 8191999 time 0.337536 [TensorRT] VERBOSE: Tactic: 8257535 time 0.277376 [TensorRT] VERBOSE: Tactic: 8323071 time 0.300576 [TensorRT] VERBOSE: Tactic: 8650751 time 0.301856 [TensorRT] VERBOSE: Tactic: 8716287 time 0.350208 [TensorRT] VERBOSE: Tactic: 9109503 time 0.286656 [TensorRT] VERBOSE: Tactic: 9568255 time 0.268864 [TensorRT] VERBOSE: Tactic: 9895935 time 0.266272 [TensorRT] VERBOSE: Tactic: 10223615 time 0.286976 [TensorRT] VERBOSE: Tactic: 10354687 time 0.265632 [TensorRT] VERBOSE: Tactic: 10551295 time 0.296768 [TensorRT] VERBOSE: Tactic: 10747903 time 0.250368 [TensorRT] VERBOSE: Tactic: 10944511 time 0.27184 [TensorRT] VERBOSE: Fastest Tactic: 10747903 Time: 0.250368 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.197728 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.188448 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.069856 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.189568 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.1024 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.099104 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.104896 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.089856 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.07104 [TensorRT] VERBOSE: Fastest Tactic: 2733356012094739613 Time: 0.069856 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.13152 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 3211264, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 3203072, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.128576 [TensorRT] VERBOSE: Fastest Tactic: 57 Time: 0.128576 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2733356012094739613 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.09392 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.044512 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.036448 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.052192 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.04224 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.038176 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.051392 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.053248 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.043808 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.091328 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.03584 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.0912 [TensorRT] VERBOSE: Fastest Tactic: -3908975881807046106 Time: 0.03584 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3908975881807046106 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,100352) *************** [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.075328 [TensorRT] VERBOSE: Tactic: 655359 time 0.103744 [TensorRT] VERBOSE: Tactic: 786431 time 0.065216 [TensorRT] VERBOSE: Tactic: 851967 time 0.195552 [TensorRT] VERBOSE: Tactic: 1179647 time 0.105056 [TensorRT] VERBOSE: Tactic: 1310719 time 0.068128 [TensorRT] VERBOSE: Tactic: 1376255 time 0.073376 [TensorRT] VERBOSE: Tactic: 1441791 time 0.11888 [TensorRT] VERBOSE: Tactic: 1507327 time 0.135456 [TensorRT] VERBOSE: Tactic: 1638399 time 0.069824 [TensorRT] VERBOSE: Tactic: 1835007 time 0.064448 [TensorRT] VERBOSE: Tactic: 1900543 time 0.11536 [TensorRT] VERBOSE: Tactic: 2162687 time 0.087808 [TensorRT] VERBOSE: Tactic: 2293759 time 0.0728 [TensorRT] VERBOSE: Tactic: 2359295 time 0.090976 [TensorRT] VERBOSE: Tactic: 2686975 time 0.079776 [TensorRT] VERBOSE: Tactic: 3080191 time 0.123776 [TensorRT] VERBOSE: Tactic: 3342335 time 0.133024 [TensorRT] VERBOSE: Tactic: 3407871 time 0.074592 [TensorRT] VERBOSE: Tactic: 3538943 time 0.080128 [TensorRT] VERBOSE: Tactic: 3670015 time 0.097536 [TensorRT] VERBOSE: Tactic: 3932159 time 0.102368 [TensorRT] VERBOSE: Tactic: 3997695 time 0.062464 [TensorRT] VERBOSE: Tactic: 4063231 time 0.192384 [TensorRT] VERBOSE: Tactic: 4194303 time 0.058848 [TensorRT] VERBOSE: Tactic: 4325375 time 0.073728 [TensorRT] VERBOSE: Tactic: 4521983 time 0.069632 [TensorRT] VERBOSE: Tactic: 4587519 time 0.05856 [TensorRT] VERBOSE: Tactic: 4653055 time 0.110592 [TensorRT] VERBOSE: Tactic: 4915199 time 0.059104 [TensorRT] VERBOSE: Tactic: 4980735 time 0.070336 [TensorRT] VERBOSE: Tactic: 5177343 time 0.107008 [TensorRT] VERBOSE: Tactic: 5242879 time 0.07424 [TensorRT] VERBOSE: Tactic: 5373951 time 0.11632 [TensorRT] VERBOSE: Tactic: 5439487 time 0.07664 [TensorRT] VERBOSE: Tactic: 5570559 time 0.127872 [TensorRT] VERBOSE: Tactic: 5636095 time 0.191552 [TensorRT] VERBOSE: Tactic: 5701631 time 0.077088 [TensorRT] VERBOSE: Tactic: 5767167 time 0.137888 [TensorRT] VERBOSE: Tactic: 5832703 time 0.072544 [TensorRT] VERBOSE: Tactic: 5898239 time 0.103616 [TensorRT] VERBOSE: Tactic: 6029311 time 0.073024 [TensorRT] VERBOSE: Tactic: 6225919 time 0.081472 [TensorRT] VERBOSE: Tactic: 6291455 time 0.105952 [TensorRT] VERBOSE: Tactic: 6422527 time 0.113696 [TensorRT] VERBOSE: Tactic: 6750207 time 0.072928 [TensorRT] VERBOSE: Tactic: 6815743 time 0.085152 [TensorRT] VERBOSE: Tactic: 6946815 time 0.074112 [TensorRT] VERBOSE: Tactic: 7077887 time 0.079104 [TensorRT] VERBOSE: Tactic: 7143423 time 0.074976 [TensorRT] VERBOSE: Tactic: 7208959 time 0.074944 [TensorRT] VERBOSE: Tactic: 7340031 time 0.107616 [TensorRT] VERBOSE: Tactic: 7405567 time 0.093984 [TensorRT] VERBOSE: Tactic: 7536639 time 0.089248 [TensorRT] VERBOSE: Tactic: 7602175 time 0.060544 [TensorRT] VERBOSE: Tactic: 7733247 time 0.07776 [TensorRT] VERBOSE: Tactic: 7798783 time 0.065504 [TensorRT] VERBOSE: Tactic: 8191999 time 0.071008 [TensorRT] VERBOSE: Tactic: 8257535 time 0.061024 [TensorRT] VERBOSE: Tactic: 8323071 time 0.063936 [TensorRT] VERBOSE: Tactic: 8650751 time 0.066656 [TensorRT] VERBOSE: Tactic: 8716287 time 0.09472 [TensorRT] VERBOSE: Tactic: 9568255 time 0.058624 [TensorRT] VERBOSE: Tactic: 9895935 time 0.060288 [TensorRT] VERBOSE: Tactic: 10223615 time 0.079904 [TensorRT] VERBOSE: Tactic: 10354687 time 0.0792 [TensorRT] VERBOSE: Tactic: 10551295 time 0.065696 [TensorRT] VERBOSE: Tactic: 10747903 time 0.076576 [TensorRT] VERBOSE: Tactic: 10944511 time 0.070432 [TensorRT] VERBOSE: Fastest Tactic: 4587519 Time: 0.05856 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.038368 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.07056 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.038656 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.039296 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.034592 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.070912 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.028736 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.027648 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.0712 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.02784 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.031616 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.032736 [TensorRT] VERBOSE: Fastest Tactic: 8097855305881829878 Time: 0.027648 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8097855305881829878 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.068608 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.0344 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.028352 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.036416 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.027392 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.037504 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.03216 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.033664 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.069184 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.028928 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.038336 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.069376 [TensorRT] VERBOSE: Fastest Tactic: 8047041638267142825 Time: 0.027392 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8047041638267142825 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.041344 [TensorRT] VERBOSE: Tactic: 655359 time 0.091552 [TensorRT] VERBOSE: Tactic: 786431 time 0.045056 [TensorRT] VERBOSE: Tactic: 851967 time 0.194336 [TensorRT] VERBOSE: Tactic: 1179647 time 0.105472 [TensorRT] VERBOSE: Tactic: 1310719 time 0.040384 [TensorRT] VERBOSE: Tactic: 1376255 time 0.068608 [TensorRT] VERBOSE: Tactic: 1441791 time 0.113056 [TensorRT] VERBOSE: Tactic: 1507327 time 0.12512 [TensorRT] VERBOSE: Tactic: 1638399 time 0.065024 [TensorRT] VERBOSE: Tactic: 1835007 time 0.048384 [TensorRT] VERBOSE: Tactic: 1900543 time 0.099904 [TensorRT] VERBOSE: Tactic: 2162687 time 0.072256 [TensorRT] VERBOSE: Tactic: 2293759 time 0.070528 [TensorRT] VERBOSE: Tactic: 2359295 time 0.075872 [TensorRT] VERBOSE: Tactic: 2686975 time 0.070688 [TensorRT] VERBOSE: Tactic: 3080191 time 0.113632 [TensorRT] VERBOSE: Tactic: 3342335 time 0.12288 [TensorRT] VERBOSE: Tactic: 3407871 time 0.072704 [TensorRT] VERBOSE: Tactic: 3538943 time 0.083488 [TensorRT] VERBOSE: Tactic: 3670015 time 0.086016 [TensorRT] VERBOSE: Tactic: 3932159 time 0.09968 [TensorRT] VERBOSE: Tactic: 3997695 time 0.048928 [TensorRT] VERBOSE: Tactic: 4063231 time 0.189248 [TensorRT] VERBOSE: Tactic: 4194303 time 0.0432 [TensorRT] VERBOSE: Tactic: 4325375 time 0.0704 [TensorRT] VERBOSE: Tactic: 4521983 time 0.062752 [TensorRT] VERBOSE: Tactic: 4587519 time 0.047712 [TensorRT] VERBOSE: Tactic: 4653055 time 0.11232 [TensorRT] VERBOSE: Tactic: 4915199 time 0.046816 [TensorRT] VERBOSE: Tactic: 4980735 time 0.066912 [TensorRT] VERBOSE: Tactic: 5177343 time 0.104384 [TensorRT] VERBOSE: Tactic: 5242879 time 0.075104 [TensorRT] VERBOSE: Tactic: 5373951 time 0.108704 [TensorRT] VERBOSE: Tactic: 5439487 time 0.057536 [TensorRT] VERBOSE: Tactic: 5570559 time 0.116608 [TensorRT] VERBOSE: Tactic: 5636095 time 0.189568 [TensorRT] VERBOSE: Tactic: 5701631 time 0.067648 [TensorRT] VERBOSE: Tactic: 5767167 time 0.112384 [TensorRT] VERBOSE: Tactic: 5832703 time 0.071392 [TensorRT] VERBOSE: Tactic: 5898239 time 0.102624 [TensorRT] VERBOSE: Tactic: 6029311 time 0.069824 [TensorRT] VERBOSE: Tactic: 6225919 time 0.083968 [TensorRT] VERBOSE: Tactic: 6291455 time 0.104128 [TensorRT] VERBOSE: Tactic: 6422527 time 0.109248 [TensorRT] VERBOSE: Tactic: 6750207 time 0.06256 [TensorRT] VERBOSE: Tactic: 6815743 time 0.079168 [TensorRT] VERBOSE: Tactic: 6946815 time 0.05344 [TensorRT] VERBOSE: Tactic: 7077887 time 0.077344 [TensorRT] VERBOSE: Tactic: 7143423 time 0.064864 [TensorRT] VERBOSE: Tactic: 7208959 time 0.071104 [TensorRT] VERBOSE: Tactic: 7340031 time 0.104416 [TensorRT] VERBOSE: Tactic: 7405567 time 0.090112 [TensorRT] VERBOSE: Tactic: 7536639 time 0.093568 [TensorRT] VERBOSE: Tactic: 7602175 time 0.045856 [TensorRT] VERBOSE: Tactic: 7733247 time 0.0768 [TensorRT] VERBOSE: Tactic: 7798783 time 0.044064 [TensorRT] VERBOSE: Tactic: 8191999 time 0.0624 [TensorRT] VERBOSE: Tactic: 8257535 time 0.04352 [TensorRT] VERBOSE: Tactic: 8323071 time 0.051328 [TensorRT] VERBOSE: Tactic: 8650751 time 0.045696 [TensorRT] VERBOSE: Tactic: 8716287 time 0.089536 [TensorRT] VERBOSE: Tactic: 9568255 time 0.045696 [TensorRT] VERBOSE: Tactic: 9895935 time 0.04352 [TensorRT] VERBOSE: Tactic: 10223615 time 0.070624 [TensorRT] VERBOSE: Tactic: 10354687 time 0.074464 [TensorRT] VERBOSE: Tactic: 10551295 time 0.046752 [TensorRT] VERBOSE: Tactic: 10747903 time 0.077664 [TensorRT] VERBOSE: Tactic: 10944511 time 0.06656 [TensorRT] VERBOSE: Fastest Tactic: 1310719 Time: 0.040384 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.045216 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.05888 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.046176 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.031744 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.059232 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.032992 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.032736 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.032352 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.03264 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.032736 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.058368 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.045504 [TensorRT] VERBOSE: Fastest Tactic: 7039764449991095921 Time: 0.031744 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7039764449991095921 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.072288 [TensorRT] VERBOSE: Tactic: 0 time 0.195744 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.072288 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.093408 [TensorRT] VERBOSE: Tactic: 0 time 0.021504 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021504 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.086528 [TensorRT] VERBOSE: Tactic: 0 time 0.14208 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.086528 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.1712 [TensorRT] VERBOSE: Tactic: 0 time 0.176 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.1712 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.09552 [TensorRT] VERBOSE: Tactic: 0 time 0.18288 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.09552 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.074848 [TensorRT] VERBOSE: Tactic: 0 time 0.36864 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.074848 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.090112 [TensorRT] VERBOSE: Tactic: 0 time 0.027936 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.027936 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.091392 [TensorRT] VERBOSE: Tactic: 0 time 0.202304 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.091392 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.088544 [TensorRT] VERBOSE: Tactic: 0 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.089152 [TensorRT] VERBOSE: Tactic: 0 time 0.077536 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.077536 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.070496 [TensorRT] VERBOSE: Tactic: 0 time 0.286624 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.070496 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.091808 [TensorRT] VERBOSE: Tactic: 0 time 0.01424 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01424 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0608 [TensorRT] VERBOSE: Tactic: 256 time 0.061536 [TensorRT] VERBOSE: Tactic: 512 time 0.062368 [TensorRT] VERBOSE: Tactic: -32 time 0.094208 [TensorRT] VERBOSE: Tactic: -64 time 0.0776 [TensorRT] VERBOSE: Tactic: -128 time 0.073088 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.0608 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.036736 [TensorRT] VERBOSE: Tactic: 1 time 0.034624 [TensorRT] VERBOSE: Tactic: 2 time 0.032128 [TensorRT] VERBOSE: Tactic: 3 time 0.035776 [TensorRT] VERBOSE: Tactic: 4 time 0.032032 [TensorRT] VERBOSE: Tactic: 5 time 0.031968 [TensorRT] VERBOSE: Tactic: 6 time 0.039456 [TensorRT] VERBOSE: Tactic: 7 time 0.032672 [TensorRT] VERBOSE: Tactic: 8 time 0.032704 [TensorRT] VERBOSE: Tactic: 9 time 0.031744 [TensorRT] VERBOSE: Tactic: 28 time 0.035648 [TensorRT] VERBOSE: Fastest Tactic: 9 Time: 0.031744 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,12544) -> Float(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.060928 [TensorRT] VERBOSE: Tactic: 256 time 0.061568 [TensorRT] VERBOSE: Tactic: 512 time 0.063808 [TensorRT] VERBOSE: Tactic: -32 time 0.092448 [TensorRT] VERBOSE: Tactic: -64 time 0.077792 [TensorRT] VERBOSE: Tactic: -128 time 0.0736 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.060928 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.048928 [TensorRT] VERBOSE: Tactic: 25 time 0.050144 [TensorRT] VERBOSE: Tactic: 26 time 0.050144 [TensorRT] VERBOSE: Tactic: 27 time 0.0512 [TensorRT] VERBOSE: Tactic: 31 time 0.051104 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.048928 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,100352) -> Int8(1,112,12544:4,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.079872 [TensorRT] VERBOSE: Tactic: 256 time 0.069792 [TensorRT] VERBOSE: Tactic: 512 time 0.070528 [TensorRT] VERBOSE: Tactic: -32 time 0.095232 [TensorRT] VERBOSE: Tactic: -64 time 0.0936 [TensorRT] VERBOSE: Tactic: -128 time 0.089152 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.069792 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.023904 [TensorRT] VERBOSE: Tactic: 1 time 0.019456 [TensorRT] VERBOSE: Tactic: 2 time 0.018432 [TensorRT] VERBOSE: Tactic: 3 time 0.016928 [TensorRT] VERBOSE: Tactic: 4 time 0.018432 [TensorRT] VERBOSE: Tactic: 5 time 0.01904 [TensorRT] VERBOSE: Tactic: 6 time 0.017408 [TensorRT] VERBOSE: Tactic: 7 time 0.01824 [TensorRT] VERBOSE: Tactic: 8 time 0.024576 [TensorRT] VERBOSE: Tactic: 9 time 0.024224 [TensorRT] VERBOSE: Tactic: 10 time 0.037984 [TensorRT] VERBOSE: Tactic: 11 time 0.029152 [TensorRT] VERBOSE: Tactic: 12 time 0.025824 [TensorRT] VERBOSE: Tactic: 13 time 0.02528 [TensorRT] VERBOSE: Tactic: 14 time 0.023776 [TensorRT] VERBOSE: Tactic: 15 time 0.024704 [TensorRT] VERBOSE: Tactic: 16 time 0.025696 [TensorRT] VERBOSE: Tactic: 17 time 0.024064 [TensorRT] VERBOSE: Tactic: 18 time 0.024 [TensorRT] VERBOSE: Tactic: 19 time 0.02624 [TensorRT] VERBOSE: Tactic: 20 time 0.063968 [TensorRT] VERBOSE: Tactic: 21 time 0.045248 [TensorRT] VERBOSE: Tactic: 22 time 0.033696 [TensorRT] VERBOSE: Tactic: 23 time 0.031264 [TensorRT] VERBOSE: Tactic: 28 time 0.032096 [TensorRT] VERBOSE: Tactic: 29 time 0.040192 [TensorRT] VERBOSE: Tactic: 30 time 0.06128 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.016928 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,12544) -> Int8(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.070464 [TensorRT] VERBOSE: Tactic: 256 time 0.063264 [TensorRT] VERBOSE: Tactic: 512 time 0.063232 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.063232 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.017216 [TensorRT] VERBOSE: Tactic: 11 time 0.019168 [TensorRT] VERBOSE: Tactic: 12 time 0.018432 [TensorRT] VERBOSE: Tactic: 13 time 0.018048 [TensorRT] VERBOSE: Tactic: 14 time 0.018496 [TensorRT] VERBOSE: Tactic: 15 time 0.026528 [TensorRT] VERBOSE: Tactic: 16 time 0.02224 [TensorRT] VERBOSE: Tactic: 17 time 0.023744 [TensorRT] VERBOSE: Tactic: 18 time 0.02544 [TensorRT] VERBOSE: Tactic: 19 time 0.038912 [TensorRT] VERBOSE: Tactic: 20 time 0.018016 [TensorRT] VERBOSE: Tactic: 21 time 0.017664 [TensorRT] VERBOSE: Tactic: 22 time 0.019008 [TensorRT] VERBOSE: Tactic: 23 time 0.019456 [TensorRT] VERBOSE: Tactic: 24 time 0.023776 [TensorRT] VERBOSE: Tactic: 25 time 0.019424 [TensorRT] VERBOSE: Tactic: 26 time 0.01808 [TensorRT] VERBOSE: Tactic: 27 time 0.017728 [TensorRT] VERBOSE: Tactic: 29 time 0.086016 [TensorRT] VERBOSE: Tactic: 30 time 0.049376 [TensorRT] VERBOSE: Tactic: 31 time 0.033024 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.017216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.692064 [TensorRT] VERBOSE: Tactic: 720895 time 0.61232 [TensorRT] VERBOSE: Tactic: 983039 time 0.600736 [TensorRT] VERBOSE: Tactic: 1048575 time 0.60544 [TensorRT] VERBOSE: Tactic: 1703935 time 0.60928 [TensorRT] VERBOSE: Tactic: 1769471 time 0.777088 [TensorRT] VERBOSE: Tactic: 1966079 time 0.698784 [TensorRT] VERBOSE: Tactic: 2031615 time 0.71824 [TensorRT] VERBOSE: Tactic: 2228223 time 0.607904 [TensorRT] VERBOSE: Tactic: 2424831 time 0.67248 [TensorRT] VERBOSE: Tactic: 2621439 time 0.694272 [TensorRT] VERBOSE: Tactic: 2752511 time 0.607232 [TensorRT] VERBOSE: Tactic: 2818047 time 0.91872 [TensorRT] VERBOSE: Tactic: 2883583 time 0.94576 [TensorRT] VERBOSE: Tactic: 3014655 time 0.597056 [TensorRT] VERBOSE: Tactic: 3145727 time 0.595616 [TensorRT] VERBOSE: Tactic: 3473407 time 0.837184 [TensorRT] VERBOSE: Tactic: 3604479 time 0.593792 [TensorRT] VERBOSE: Tactic: 3735551 time 0.851872 [TensorRT] VERBOSE: Tactic: 4390911 time 0.721408 [TensorRT] VERBOSE: Tactic: 5046271 time 0.605856 [TensorRT] VERBOSE: Tactic: 5963775 time 0.71152 [TensorRT] VERBOSE: Tactic: 6160383 time 0.666016 [TensorRT] VERBOSE: Tactic: 6488063 time 0.60096 [TensorRT] VERBOSE: Tactic: 6881279 time 0.699616 [TensorRT] VERBOSE: Tactic: 7274495 time 0.691584 [TensorRT] VERBOSE: Tactic: 7864319 time 0.634784 [TensorRT] VERBOSE: Tactic: 7995391 time 0.60256 [TensorRT] VERBOSE: Tactic: 8585215 time 0.679872 [TensorRT] VERBOSE: Tactic: 8847359 time 0.897824 [TensorRT] VERBOSE: Tactic: 8978431 time 0.683904 [TensorRT] VERBOSE: Tactic: 9043967 time 0.602464 [TensorRT] VERBOSE: Tactic: 9175039 time 0.584992 [TensorRT] VERBOSE: Tactic: 9502719 time 0.73664 [TensorRT] VERBOSE: Tactic: 9830399 time 0.791008 [TensorRT] VERBOSE: Tactic: 9961471 time 0.791552 [TensorRT] VERBOSE: Tactic: 10027007 time 0.594624 [TensorRT] VERBOSE: Tactic: 10092543 time 0.724256 [TensorRT] VERBOSE: Tactic: 10289151 time 0.715776 [TensorRT] VERBOSE: Tactic: 10485759 time 0.598048 [TensorRT] VERBOSE: Tactic: 10682367 time 0.634496 [TensorRT] VERBOSE: Tactic: 10813439 time 0.590304 [TensorRT] VERBOSE: Fastest Tactic: 9175039 Time: 0.584992 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.743904 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.2432 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.388096 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.742368 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.811264 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.38288 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.391168 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.451136 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.42576 [TensorRT] VERBOSE: Fastest Tactic: 2775507031594384867 Time: 0.2432 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.622368 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 14450688, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 9748480, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 205312, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 149504, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.622368 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,100352) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.20704 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.132992 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.122048 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.113568 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.13104 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.12784 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.118592 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.112224 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.206144 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.278496 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.112224 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,100352) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.134816 [TensorRT] VERBOSE: Tactic: 720895 time 0.148672 [TensorRT] VERBOSE: Tactic: 983039 time 0.133504 [TensorRT] VERBOSE: Tactic: 1048575 time 0.155264 [TensorRT] VERBOSE: Tactic: 1703935 time 0.166336 [TensorRT] VERBOSE: Tactic: 1769471 time 0.250336 [TensorRT] VERBOSE: Tactic: 1966079 time 0.149248 [TensorRT] VERBOSE: Tactic: 2031615 time 0.15168 [TensorRT] VERBOSE: Tactic: 2228223 time 0.223648 [TensorRT] VERBOSE: Tactic: 2621439 time 0.216928 [TensorRT] VERBOSE: Tactic: 2752511 time 0.15632 [TensorRT] VERBOSE: Tactic: 2818047 time 0.265088 [TensorRT] VERBOSE: Tactic: 2883583 time 0.233056 [TensorRT] VERBOSE: Tactic: 3014655 time 0.179872 [TensorRT] VERBOSE: Tactic: 3145727 time 0.148448 [TensorRT] VERBOSE: Tactic: 3473407 time 0.230752 [TensorRT] VERBOSE: Tactic: 3604479 time 0.139008 [TensorRT] VERBOSE: Tactic: 3735551 time 0.220192 [TensorRT] VERBOSE: Tactic: 4390911 time 0.1616 [TensorRT] VERBOSE: Tactic: 5046271 time 0.144224 [TensorRT] VERBOSE: Tactic: 5963775 time 0.148544 [TensorRT] VERBOSE: Tactic: 6160383 time 0.255072 [TensorRT] VERBOSE: Tactic: 6488063 time 0.159744 [TensorRT] VERBOSE: Tactic: 6881279 time 0.143968 [TensorRT] VERBOSE: Tactic: 7274495 time 0.190464 [TensorRT] VERBOSE: Tactic: 7864319 time 0.18624 [TensorRT] VERBOSE: Tactic: 7995391 time 0.137152 [TensorRT] VERBOSE: Tactic: 8585215 time 0.1464 [TensorRT] VERBOSE: Tactic: 8847359 time 0.21328 [TensorRT] VERBOSE: Tactic: 8978431 time 0.151552 [TensorRT] VERBOSE: Tactic: 9043967 time 0.157344 [TensorRT] VERBOSE: Tactic: 9175039 time 0.140288 [TensorRT] VERBOSE: Tactic: 9502719 time 0.162336 [TensorRT] VERBOSE: Tactic: 9830399 time 0.24064 [TensorRT] VERBOSE: Tactic: 10027007 time 0.149504 [TensorRT] VERBOSE: Tactic: 10092543 time 0.166176 [TensorRT] VERBOSE: Tactic: 10289151 time 0.1528 [TensorRT] VERBOSE: Tactic: 10485759 time 0.148512 [TensorRT] VERBOSE: Tactic: 10682367 time 0.195008 [TensorRT] VERBOSE: Tactic: 10813439 time 0.140224 [TensorRT] VERBOSE: Fastest Tactic: 983039 Time: 0.133504 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.107264 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.1064 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.124704 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.201728 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.11904 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.198112 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.11344 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.247552 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.11216 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.10608 [TensorRT] VERBOSE: Fastest Tactic: -1370999262391786833 Time: 0.10608 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1370999262391786833 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,100352) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.116288 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.117472 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.10672 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.112448 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.105472 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.115808 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.197632 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.108064 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.199264 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.245024 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.105472 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,12544) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,12544) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.12784 [TensorRT] VERBOSE: Tactic: 720895 time 0.129504 [TensorRT] VERBOSE: Tactic: 983039 time 0.126272 [TensorRT] VERBOSE: Tactic: 1048575 time 0.147872 [TensorRT] VERBOSE: Tactic: 1703935 time 0.150304 [TensorRT] VERBOSE: Tactic: 1769471 time 0.233472 [TensorRT] VERBOSE: Tactic: 1966079 time 0.122912 [TensorRT] VERBOSE: Tactic: 2031615 time 0.127168 [TensorRT] VERBOSE: Tactic: 2228223 time 0.2232 [TensorRT] VERBOSE: Tactic: 2621439 time 0.203744 [TensorRT] VERBOSE: Tactic: 2752511 time 0.134752 [TensorRT] VERBOSE: Tactic: 2818047 time 0.255424 [TensorRT] VERBOSE: Tactic: 2883583 time 0.222624 [TensorRT] VERBOSE: Tactic: 3014655 time 0.172096 [TensorRT] VERBOSE: Tactic: 3145727 time 0.135584 [TensorRT] VERBOSE: Tactic: 3473407 time 0.229056 [TensorRT] VERBOSE: Tactic: 3604479 time 0.1288 [TensorRT] VERBOSE: Tactic: 3735551 time 0.218912 [TensorRT] VERBOSE: Tactic: 4390911 time 0.13136 [TensorRT] VERBOSE: Tactic: 5046271 time 0.140192 [TensorRT] VERBOSE: Tactic: 5963775 time 0.124704 [TensorRT] VERBOSE: Tactic: 6160383 time 0.274656 [TensorRT] VERBOSE: Tactic: 6488063 time 0.152512 [TensorRT] VERBOSE: Tactic: 6881279 time 0.127552 [TensorRT] VERBOSE: Tactic: 7274495 time 0.182208 [TensorRT] VERBOSE: Tactic: 7864319 time 0.180992 [TensorRT] VERBOSE: Tactic: 7995391 time 0.116256 [TensorRT] VERBOSE: Tactic: 8585215 time 0.142272 [TensorRT] VERBOSE: Tactic: 8847359 time 0.20384 [TensorRT] VERBOSE: Tactic: 8978431 time 0.117632 [TensorRT] VERBOSE: Tactic: 9043967 time 0.14976 [TensorRT] VERBOSE: Tactic: 9175039 time 0.129696 [TensorRT] VERBOSE: Tactic: 9502719 time 0.131936 [TensorRT] VERBOSE: Tactic: 9830399 time 0.220032 [TensorRT] VERBOSE: Tactic: 10027007 time 0.14816 [TensorRT] VERBOSE: Tactic: 10092543 time 0.130144 [TensorRT] VERBOSE: Tactic: 10289151 time 0.122432 [TensorRT] VERBOSE: Tactic: 10485759 time 0.149248 [TensorRT] VERBOSE: Tactic: 10682367 time 0.191744 [TensorRT] VERBOSE: Tactic: 10813439 time 0.117056 [TensorRT] VERBOSE: Fastest Tactic: 7995391 Time: 0.116256 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.084608 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.057632 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.101024 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.055904 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.053984 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.089376 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.101312 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.053792 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.056864 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.053472 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.100544 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.082432 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.053472 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816), Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.154752 [TensorRT] VERBOSE: Tactic: 256 time 0.155296 [TensorRT] VERBOSE: Tactic: 512 time 0.158944 [TensorRT] VERBOSE: Tactic: -32 time 0.216416 [TensorRT] VERBOSE: Tactic: -64 time 0.181216 [TensorRT] VERBOSE: Tactic: -128 time 0.176928 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.154752 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.086112 [TensorRT] VERBOSE: Tactic: 1 time 0.088384 [TensorRT] VERBOSE: Tactic: 2 time 0.086208 [TensorRT] VERBOSE: Tactic: 3 time 0.089088 [TensorRT] VERBOSE: Tactic: 4 time 0.085664 [TensorRT] VERBOSE: Tactic: 5 time 0.084576 [TensorRT] VERBOSE: Tactic: 6 time 0.097312 [TensorRT] VERBOSE: Tactic: 7 time 0.088384 [TensorRT] VERBOSE: Tactic: 8 time 0.08704 [TensorRT] VERBOSE: Tactic: 9 time 0.089408 [TensorRT] VERBOSE: Tactic: 28 time 0.088608 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.084576 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088), Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.154688 [TensorRT] VERBOSE: Tactic: 256 time 0.156672 [TensorRT] VERBOSE: Tactic: 512 time 0.158976 [TensorRT] VERBOSE: Tactic: -32 time 0.217408 [TensorRT] VERBOSE: Tactic: -64 time 0.182784 [TensorRT] VERBOSE: Tactic: -128 time 0.176704 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.154688 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.15824 [TensorRT] VERBOSE: Tactic: 25 time 0.160768 [TensorRT] VERBOSE: Tactic: 26 time 0.166496 [TensorRT] VERBOSE: Tactic: 27 time 0.167936 [TensorRT] VERBOSE: Tactic: 31 time 0.1536 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.1536 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704), Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.196352 [TensorRT] VERBOSE: Tactic: 256 time 0.178688 [TensorRT] VERBOSE: Tactic: 512 time 0.18224 [TensorRT] VERBOSE: Tactic: -32 time 0.23808 [TensorRT] VERBOSE: Tactic: -64 time 0.249856 [TensorRT] VERBOSE: Tactic: -128 time 0.244608 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.178688 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.052224 [TensorRT] VERBOSE: Tactic: 1 time 0.043744 [TensorRT] VERBOSE: Tactic: 2 time 0.047264 [TensorRT] VERBOSE: Tactic: 3 time 0.041888 [TensorRT] VERBOSE: Tactic: 4 time 0.050944 [TensorRT] VERBOSE: Tactic: 5 time 0.053984 [TensorRT] VERBOSE: Tactic: 6 time 0.042432 [TensorRT] VERBOSE: Tactic: 7 time 0.054496 [TensorRT] VERBOSE: Tactic: 8 time 0.055072 [TensorRT] VERBOSE: Tactic: 9 time 0.074048 [TensorRT] VERBOSE: Tactic: 10 time 0.08608 [TensorRT] VERBOSE: Tactic: 11 time 0.0672 [TensorRT] VERBOSE: Tactic: 12 time 0.061216 [TensorRT] VERBOSE: Tactic: 13 time 0.057504 [TensorRT] VERBOSE: Tactic: 14 time 0.061056 [TensorRT] VERBOSE: Tactic: 15 time 0.060608 [TensorRT] VERBOSE: Tactic: 16 time 0.056672 [TensorRT] VERBOSE: Tactic: 17 time 0.058272 [TensorRT] VERBOSE: Tactic: 18 time 0.065984 [TensorRT] VERBOSE: Tactic: 19 time 0.072704 [TensorRT] VERBOSE: Tactic: 20 time 0.140224 [TensorRT] VERBOSE: Tactic: 21 time 0.103328 [TensorRT] VERBOSE: Tactic: 22 time 0.078944 [TensorRT] VERBOSE: Tactic: 23 time 0.065792 [TensorRT] VERBOSE: Tactic: 28 time 0.089536 [TensorRT] VERBOSE: Tactic: 29 time 0.092512 [TensorRT] VERBOSE: Tactic: 30 time 0.13648 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.041888 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088), Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.197408 [TensorRT] VERBOSE: Tactic: 256 time 0.1792 [TensorRT] VERBOSE: Tactic: 512 time 0.182592 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.1792 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.047392 [TensorRT] VERBOSE: Tactic: 11 time 0.047136 [TensorRT] VERBOSE: Tactic: 12 time 0.054048 [TensorRT] VERBOSE: Tactic: 13 time 0.048512 [TensorRT] VERBOSE: Tactic: 14 time 0.056096 [TensorRT] VERBOSE: Tactic: 15 time 0.07568 [TensorRT] VERBOSE: Tactic: 16 time 0.0512 [TensorRT] VERBOSE: Tactic: 17 time 0.057056 [TensorRT] VERBOSE: Tactic: 18 time 0.071584 [TensorRT] VERBOSE: Tactic: 19 time 0.105344 [TensorRT] VERBOSE: Tactic: 20 time 0.046688 [TensorRT] VERBOSE: Tactic: 21 time 0.043136 [TensorRT] VERBOSE: Tactic: 22 time 0.044608 [TensorRT] VERBOSE: Tactic: 23 time 0.049824 [TensorRT] VERBOSE: Tactic: 24 time 0.055296 [TensorRT] VERBOSE: Tactic: 25 time 0.049152 [TensorRT] VERBOSE: Tactic: 26 time 0.05104 [TensorRT] VERBOSE: Tactic: 27 time 0.048128 [TensorRT] VERBOSE: Tactic: 29 time 0.25824 [TensorRT] VERBOSE: Tactic: 30 time 0.14416 [TensorRT] VERBOSE: Tactic: 31 time 0.092992 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.043136 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.640992 [TensorRT] VERBOSE: Tactic: 655359 time 0.55488 [TensorRT] VERBOSE: Tactic: 786431 time 0.591872 [TensorRT] VERBOSE: Tactic: 851967 time 0.5904 [TensorRT] VERBOSE: Tactic: 1179647 time 0.585408 [TensorRT] VERBOSE: Tactic: 1310719 time 0.80448 [TensorRT] VERBOSE: Tactic: 1376255 time 0.599744 [TensorRT] VERBOSE: Tactic: 1441791 time 0.60912 [TensorRT] VERBOSE: Tactic: 1507327 time 0.535456 [TensorRT] VERBOSE: Tactic: 1638399 time 0.589824 [TensorRT] VERBOSE: Tactic: 1835007 time 0.60112 [TensorRT] VERBOSE: Tactic: 1900543 time 0.563072 [TensorRT] VERBOSE: Tactic: 2097151 time 0.599776 [TensorRT] VERBOSE: Tactic: 2162687 time 0.587872 [TensorRT] VERBOSE: Tactic: 2293759 time 0.599904 [TensorRT] VERBOSE: Tactic: 2359295 time 0.562112 [TensorRT] VERBOSE: Tactic: 2686975 time 0.57968 [TensorRT] VERBOSE: Tactic: 3080191 time 0.553024 [TensorRT] VERBOSE: Tactic: 3342335 time 0.558016 [TensorRT] VERBOSE: Tactic: 3407871 time 0.5752 [TensorRT] VERBOSE: Tactic: 3538943 time 0.57744 [TensorRT] VERBOSE: Tactic: 3670015 time 0.647936 [TensorRT] VERBOSE: Tactic: 3932159 time 0.57408 [TensorRT] VERBOSE: Tactic: 3997695 time 0.596896 [TensorRT] VERBOSE: Tactic: 4063231 time 0.578208 [TensorRT] VERBOSE: Tactic: 4194303 time 0.571168 [TensorRT] VERBOSE: Tactic: 4259839 time 0.594784 [TensorRT] VERBOSE: Tactic: 4325375 time 0.582176 [TensorRT] VERBOSE: Tactic: 4521983 time 0.569056 [TensorRT] VERBOSE: Tactic: 4587519 time 0.58224 [TensorRT] VERBOSE: Tactic: 4653055 time 0.565248 [TensorRT] VERBOSE: Tactic: 4915199 time 0.58096 [TensorRT] VERBOSE: Tactic: 4980735 time 0.5696 [TensorRT] VERBOSE: Tactic: 5177343 time 0.598016 [TensorRT] VERBOSE: Tactic: 5242879 time 0.585888 [TensorRT] VERBOSE: Tactic: 5373951 time 0.626688 [TensorRT] VERBOSE: Tactic: 5439487 time 0.68304 [TensorRT] VERBOSE: Tactic: 5570559 time 0.55648 [TensorRT] VERBOSE: Tactic: 5636095 time 0.578752 [TensorRT] VERBOSE: Tactic: 5701631 time 0.594592 [TensorRT] VERBOSE: Tactic: 5767167 time 1.32042 [TensorRT] VERBOSE: Tactic: 5832703 time 0.579168 [TensorRT] VERBOSE: Tactic: 5898239 time 0.563328 [TensorRT] VERBOSE: Tactic: 6029311 time 0.59232 [TensorRT] VERBOSE: Tactic: 6225919 time 0.586592 [TensorRT] VERBOSE: Tactic: 6291455 time 0.586752 [TensorRT] VERBOSE: Tactic: 6422527 time 0.565984 [TensorRT] VERBOSE: Tactic: 6750207 time 0.635808 [TensorRT] VERBOSE: Tactic: 6815743 time 0.619776 [TensorRT] VERBOSE: Tactic: 6946815 time 0.661952 [TensorRT] VERBOSE: Tactic: 7012351 time 0.596448 [TensorRT] VERBOSE: Tactic: 7077887 time 0.572608 [TensorRT] VERBOSE: Tactic: 7143423 time 0.681056 [TensorRT] VERBOSE: Tactic: 7208959 time 0.592448 [TensorRT] VERBOSE: Tactic: 7340031 time 0.56976 [TensorRT] VERBOSE: Tactic: 7405567 time 0.579456 [TensorRT] VERBOSE: Tactic: 7536639 time 0.646144 [TensorRT] VERBOSE: Tactic: 7602175 time 0.598176 [TensorRT] VERBOSE: Tactic: 7733247 time 0.564704 [TensorRT] VERBOSE: Tactic: 7798783 time 0.590208 [TensorRT] VERBOSE: Tactic: 8191999 time 0.680224 [TensorRT] VERBOSE: Tactic: 8257535 time 0.588512 [TensorRT] VERBOSE: Tactic: 8323071 time 0.61952 [TensorRT] VERBOSE: Tactic: 8650751 time 0.613504 [TensorRT] VERBOSE: Tactic: 8716287 time 0.627616 [TensorRT] VERBOSE: Tactic: 9109503 time 0.610368 [TensorRT] VERBOSE: Tactic: 9568255 time 0.580192 [TensorRT] VERBOSE: Tactic: 9895935 time 0.567488 [TensorRT] VERBOSE: Tactic: 10223615 time 0.5776 [TensorRT] VERBOSE: Tactic: 10354687 time 0.586016 [TensorRT] VERBOSE: Tactic: 10551295 time 0.605184 [TensorRT] VERBOSE: Tactic: 10747903 time 0.56048 [TensorRT] VERBOSE: Tactic: 10944511 time 0.571936 [TensorRT] VERBOSE: Fastest Tactic: 1507327 Time: 0.535456 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.196192 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.192896 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.123424 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.194592 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.104 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.10144 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.106464 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.153504 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.124128 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.10144 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.229408 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 3211264, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 4456448, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 92160, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.229408 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.096736 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.072736 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.066528 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.062016 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.07184 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.0696 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.061344 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.061536 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.072544 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.095232 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.068224 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.09488 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.061344 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.125376 [TensorRT] VERBOSE: Tactic: 655359 time 0.113056 [TensorRT] VERBOSE: Tactic: 786431 time 0.1104 [TensorRT] VERBOSE: Tactic: 851967 time 0.199264 [TensorRT] VERBOSE: Tactic: 1179647 time 0.125184 [TensorRT] VERBOSE: Tactic: 1310719 time 0.112128 [TensorRT] VERBOSE: Tactic: 1376255 time 0.11472 [TensorRT] VERBOSE: Tactic: 1441791 time 0.136416 [TensorRT] VERBOSE: Tactic: 1507327 time 0.139936 [TensorRT] VERBOSE: Tactic: 1638399 time 0.133696 [TensorRT] VERBOSE: Tactic: 1835007 time 0.112128 [TensorRT] VERBOSE: Tactic: 1900543 time 0.126848 [TensorRT] VERBOSE: Tactic: 2162687 time 0.128832 [TensorRT] VERBOSE: Tactic: 2293759 time 0.11264 [TensorRT] VERBOSE: Tactic: 2359295 time 0.12288 [TensorRT] VERBOSE: Tactic: 2686975 time 0.119136 [TensorRT] VERBOSE: Tactic: 3080191 time 0.129376 [TensorRT] VERBOSE: Tactic: 3342335 time 0.137216 [TensorRT] VERBOSE: Tactic: 3407871 time 0.106848 [TensorRT] VERBOSE: Tactic: 3538943 time 0.109824 [TensorRT] VERBOSE: Tactic: 3670015 time 0.128448 [TensorRT] VERBOSE: Tactic: 3932159 time 0.114368 [TensorRT] VERBOSE: Tactic: 3997695 time 0.113376 [TensorRT] VERBOSE: Tactic: 4063231 time 0.193536 [TensorRT] VERBOSE: Tactic: 4194303 time 0.105952 [TensorRT] VERBOSE: Tactic: 4325375 time 0.137568 [TensorRT] VERBOSE: Tactic: 4521983 time 0.11968 [TensorRT] VERBOSE: Tactic: 4587519 time 0.10752 [TensorRT] VERBOSE: Tactic: 4653055 time 0.127872 [TensorRT] VERBOSE: Tactic: 4915199 time 0.105952 [TensorRT] VERBOSE: Tactic: 4980735 time 0.130272 [TensorRT] VERBOSE: Tactic: 5177343 time 0.128192 [TensorRT] VERBOSE: Tactic: 5242879 time 0.107904 [TensorRT] VERBOSE: Tactic: 5373951 time 0.137312 [TensorRT] VERBOSE: Tactic: 5439487 time 0.138784 [TensorRT] VERBOSE: Tactic: 5570559 time 0.13392 [TensorRT] VERBOSE: Tactic: 5636095 time 0.193408 [TensorRT] VERBOSE: Tactic: 5701631 time 0.115648 [TensorRT] VERBOSE: Tactic: 5767167 time 0.231328 [TensorRT] VERBOSE: Tactic: 5832703 time 0.106496 [TensorRT] VERBOSE: Tactic: 5898239 time 0.122496 [TensorRT] VERBOSE: Tactic: 6029311 time 0.112672 [TensorRT] VERBOSE: Tactic: 6225919 time 0.115328 [TensorRT] VERBOSE: Tactic: 6291455 time 0.125024 [TensorRT] VERBOSE: Tactic: 6422527 time 0.12208 [TensorRT] VERBOSE: Tactic: 6750207 time 0.129824 [TensorRT] VERBOSE: Tactic: 6815743 time 0.1208 [TensorRT] VERBOSE: Tactic: 6946815 time 0.13232 [TensorRT] VERBOSE: Tactic: 7077887 time 0.111904 [TensorRT] VERBOSE: Tactic: 7143423 time 0.13408 [TensorRT] VERBOSE: Tactic: 7208959 time 0.110304 [TensorRT] VERBOSE: Tactic: 7340031 time 0.125984 [TensorRT] VERBOSE: Tactic: 7405567 time 0.117696 [TensorRT] VERBOSE: Tactic: 7536639 time 0.122688 [TensorRT] VERBOSE: Tactic: 7602175 time 0.108768 [TensorRT] VERBOSE: Tactic: 7733247 time 0.108352 [TensorRT] VERBOSE: Tactic: 7798783 time 0.110944 [TensorRT] VERBOSE: Tactic: 8191999 time 0.126144 [TensorRT] VERBOSE: Tactic: 8257535 time 0.108256 [TensorRT] VERBOSE: Tactic: 8323071 time 0.115264 [TensorRT] VERBOSE: Tactic: 8650751 time 0.115072 [TensorRT] VERBOSE: Tactic: 8716287 time 0.128448 [TensorRT] VERBOSE: Tactic: 9568255 time 0.105856 [TensorRT] VERBOSE: Tactic: 9895935 time 0.105312 [TensorRT] VERBOSE: Tactic: 10223615 time 0.120192 [TensorRT] VERBOSE: Tactic: 10354687 time 0.150496 [TensorRT] VERBOSE: Tactic: 10551295 time 0.116672 [TensorRT] VERBOSE: Tactic: 10747903 time 0.10608 [TensorRT] VERBOSE: Tactic: 10944511 time 0.129152 [TensorRT] VERBOSE: Fastest Tactic: 9895935 Time: 0.105312 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.03888 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.070656 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.039968 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.040736 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.054848 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.070784 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.046944 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.044672 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.071392 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.045056 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.053024 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.051584 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.03888 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3145259992339075399 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.068768 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.055616 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.0464 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.039552 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.044352 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.038656 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.051744 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.052512 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.067904 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.046208 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.039904 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.069152 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.038656 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.066848 [TensorRT] VERBOSE: Tactic: 655359 time 0.091232 [TensorRT] VERBOSE: Tactic: 786431 time 0.081024 [TensorRT] VERBOSE: Tactic: 851967 time 0.193984 [TensorRT] VERBOSE: Tactic: 1179647 time 0.11104 [TensorRT] VERBOSE: Tactic: 1310719 time 0.068608 [TensorRT] VERBOSE: Tactic: 1376255 time 0.067424 [TensorRT] VERBOSE: Tactic: 1441791 time 0.12032 [TensorRT] VERBOSE: Tactic: 1507327 time 0.125952 [TensorRT] VERBOSE: Tactic: 1638399 time 0.121696 [TensorRT] VERBOSE: Tactic: 1835007 time 0.08688 [TensorRT] VERBOSE: Tactic: 1900543 time 0.111072 [TensorRT] VERBOSE: Tactic: 2162687 time 0.073184 [TensorRT] VERBOSE: Tactic: 2293759 time 0.07056 [TensorRT] VERBOSE: Tactic: 2359295 time 0.07776 [TensorRT] VERBOSE: Tactic: 2686975 time 0.07168 [TensorRT] VERBOSE: Tactic: 3080191 time 0.11264 [TensorRT] VERBOSE: Tactic: 3342335 time 0.122272 [TensorRT] VERBOSE: Tactic: 3407871 time 0.075776 [TensorRT] VERBOSE: Tactic: 3538943 time 0.087968 [TensorRT] VERBOSE: Tactic: 3670015 time 0.087072 [TensorRT] VERBOSE: Tactic: 3932159 time 0.099744 [TensorRT] VERBOSE: Tactic: 3997695 time 0.08704 [TensorRT] VERBOSE: Tactic: 4063231 time 0.190464 [TensorRT] VERBOSE: Tactic: 4194303 time 0.076576 [TensorRT] VERBOSE: Tactic: 4325375 time 0.1304 [TensorRT] VERBOSE: Tactic: 4521983 time 0.110784 [TensorRT] VERBOSE: Tactic: 4587519 time 0.085632 [TensorRT] VERBOSE: Tactic: 4653055 time 0.118528 [TensorRT] VERBOSE: Tactic: 4915199 time 0.082944 [TensorRT] VERBOSE: Tactic: 4980735 time 0.12224 [TensorRT] VERBOSE: Tactic: 5177343 time 0.111104 [TensorRT] VERBOSE: Tactic: 5242879 time 0.077344 [TensorRT] VERBOSE: Tactic: 5373951 time 0.117184 [TensorRT] VERBOSE: Tactic: 5439487 time 0.104736 [TensorRT] VERBOSE: Tactic: 5570559 time 0.11728 [TensorRT] VERBOSE: Tactic: 5636095 time 0.19072 [TensorRT] VERBOSE: Tactic: 5701631 time 0.068096 [TensorRT] VERBOSE: Tactic: 5767167 time 0.215136 [TensorRT] VERBOSE: Tactic: 5832703 time 0.073248 [TensorRT] VERBOSE: Tactic: 5898239 time 0.110016 [TensorRT] VERBOSE: Tactic: 6029311 time 0.069376 [TensorRT] VERBOSE: Tactic: 6225919 time 0.088896 [TensorRT] VERBOSE: Tactic: 6291455 time 0.11168 [TensorRT] VERBOSE: Tactic: 6422527 time 0.109152 [TensorRT] VERBOSE: Tactic: 6750207 time 0.115072 [TensorRT] VERBOSE: Tactic: 6815743 time 0.082624 [TensorRT] VERBOSE: Tactic: 6946815 time 0.098304 [TensorRT] VERBOSE: Tactic: 7077887 time 0.081824 [TensorRT] VERBOSE: Tactic: 7143423 time 0.118336 [TensorRT] VERBOSE: Tactic: 7208959 time 0.07392 [TensorRT] VERBOSE: Tactic: 7340031 time 0.109056 [TensorRT] VERBOSE: Tactic: 7405567 time 0.096224 [TensorRT] VERBOSE: Tactic: 7536639 time 0.094016 [TensorRT] VERBOSE: Tactic: 7602175 time 0.081536 [TensorRT] VERBOSE: Tactic: 7733247 time 0.080768 [TensorRT] VERBOSE: Tactic: 7798783 time 0.079968 [TensorRT] VERBOSE: Tactic: 8191999 time 0.115552 [TensorRT] VERBOSE: Tactic: 8257535 time 0.077536 [TensorRT] VERBOSE: Tactic: 8323071 time 0.09216 [TensorRT] VERBOSE: Tactic: 8650751 time 0.08192 [TensorRT] VERBOSE: Tactic: 8716287 time 0.093728 [TensorRT] VERBOSE: Tactic: 9568255 time 0.083616 [TensorRT] VERBOSE: Tactic: 9895935 time 0.076128 [TensorRT] VERBOSE: Tactic: 10223615 time 0.07072 [TensorRT] VERBOSE: Tactic: 10354687 time 0.14032 [TensorRT] VERBOSE: Tactic: 10551295 time 0.08336 [TensorRT] VERBOSE: Tactic: 10747903 time 0.081216 [TensorRT] VERBOSE: Tactic: 10944511 time 0.122816 [TensorRT] VERBOSE: Fastest Tactic: 589823 Time: 0.066848 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.046976 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.059424 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.046208 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.034016 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.058336 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.033184 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.032768 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.032224 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.03184 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.033792 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.05952 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.047392 [TensorRT] VERBOSE: Fastest Tactic: -1383447415429797909 Time: 0.03184 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1383447415429797909 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.119712 [TensorRT] VERBOSE: Tactic: 0 time 0.060768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.060768 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.144064 [TensorRT] VERBOSE: Tactic: 0 time 0.385024 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.144064 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.180192 [TensorRT] VERBOSE: Tactic: 0 time 0.099328 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.099328 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.17408 [TensorRT] VERBOSE: Tactic: 0 time 0.408384 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.17408 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.331136 [TensorRT] VERBOSE: Tactic: 0 time 0.350528 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.331136 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.148256 [TensorRT] VERBOSE: Tactic: 0 time 0.06528 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.06528 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.184608 [TensorRT] VERBOSE: Tactic: 0 time 0.360448 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.184608 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.175936 [TensorRT] VERBOSE: Tactic: 0 time 0.81248 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.175936 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.139392 [TensorRT] VERBOSE: Tactic: 256 time 0.138752 [TensorRT] VERBOSE: Tactic: 512 time 0.143488 [TensorRT] VERBOSE: Tactic: -32 time 0.173952 [TensorRT] VERBOSE: Tactic: -64 time 0.144736 [TensorRT] VERBOSE: Tactic: -128 time 0.13952 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.138752 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.074752 [TensorRT] VERBOSE: Tactic: 1 time 0.0672 [TensorRT] VERBOSE: Tactic: 2 time 0.06 [TensorRT] VERBOSE: Tactic: 3 time 0.071072 [TensorRT] VERBOSE: Tactic: 4 time 0.062528 [TensorRT] VERBOSE: Tactic: 5 time 0.060576 [TensorRT] VERBOSE: Tactic: 6 time 0.07056 [TensorRT] VERBOSE: Tactic: 7 time 0.063136 [TensorRT] VERBOSE: Tactic: 8 time 0.060896 [TensorRT] VERBOSE: Tactic: 9 time 0.059968 [TensorRT] VERBOSE: Tactic: 28 time 0.074464 [TensorRT] VERBOSE: Fastest Tactic: 9 Time: 0.059968 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.139936 [TensorRT] VERBOSE: Tactic: 256 time 0.139488 [TensorRT] VERBOSE: Tactic: 512 time 0.140832 [TensorRT] VERBOSE: Tactic: -32 time 0.171392 [TensorRT] VERBOSE: Tactic: -64 time 0.1432 [TensorRT] VERBOSE: Tactic: -128 time 0.139584 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.139488 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.097056 [TensorRT] VERBOSE: Tactic: 25 time 0.09776 [TensorRT] VERBOSE: Tactic: 26 time 0.09664 [TensorRT] VERBOSE: Tactic: 27 time 0.09728 [TensorRT] VERBOSE: Tactic: 31 time 0.095232 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.095232 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.156672 [TensorRT] VERBOSE: Tactic: 256 time 0.133568 [TensorRT] VERBOSE: Tactic: 512 time 0.134848 [TensorRT] VERBOSE: Tactic: -32 time 0.167584 [TensorRT] VERBOSE: Tactic: -64 time 0.178144 [TensorRT] VERBOSE: Tactic: -128 time 0.178272 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.133568 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.041344 [TensorRT] VERBOSE: Tactic: 1 time 0.032096 [TensorRT] VERBOSE: Tactic: 2 time 0.031648 [TensorRT] VERBOSE: Tactic: 3 time 0.028256 [TensorRT] VERBOSE: Tactic: 4 time 0.029856 [TensorRT] VERBOSE: Tactic: 5 time 0.034816 [TensorRT] VERBOSE: Tactic: 6 time 0.029152 [TensorRT] VERBOSE: Tactic: 7 time 0.030816 [TensorRT] VERBOSE: Tactic: 8 time 0.038912 [TensorRT] VERBOSE: Tactic: 9 time 0.03664 [TensorRT] VERBOSE: Tactic: 10 time 0.071168 [TensorRT] VERBOSE: Tactic: 11 time 0.055648 [TensorRT] VERBOSE: Tactic: 12 time 0.047424 [TensorRT] VERBOSE: Tactic: 13 time 0.04272 [TensorRT] VERBOSE: Tactic: 14 time 0.039552 [TensorRT] VERBOSE: Tactic: 15 time 0.040736 [TensorRT] VERBOSE: Tactic: 16 time 0.041408 [TensorRT] VERBOSE: Tactic: 17 time 0.038912 [TensorRT] VERBOSE: Tactic: 18 time 0.04256 [TensorRT] VERBOSE: Tactic: 19 time 0.044576 [TensorRT] VERBOSE: Tactic: 20 time 0.1232 [TensorRT] VERBOSE: Tactic: 21 time 0.085056 [TensorRT] VERBOSE: Tactic: 22 time 0.060864 [TensorRT] VERBOSE: Tactic: 23 time 0.055872 [TensorRT] VERBOSE: Tactic: 28 time 0.05872 [TensorRT] VERBOSE: Tactic: 29 time 0.075904 [TensorRT] VERBOSE: Tactic: 30 time 0.11744 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.028256 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.157376 [TensorRT] VERBOSE: Tactic: 256 time 0.13184 [TensorRT] VERBOSE: Tactic: 512 time 0.134144 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.13184 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.029344 [TensorRT] VERBOSE: Tactic: 11 time 0.02976 [TensorRT] VERBOSE: Tactic: 12 time 0.03232 [TensorRT] VERBOSE: Tactic: 13 time 0.032224 [TensorRT] VERBOSE: Tactic: 14 time 0.032096 [TensorRT] VERBOSE: Tactic: 15 time 0.044032 [TensorRT] VERBOSE: Tactic: 16 time 0.029792 [TensorRT] VERBOSE: Tactic: 17 time 0.03264 [TensorRT] VERBOSE: Tactic: 18 time 0.044736 [TensorRT] VERBOSE: Tactic: 19 time 0.060512 [TensorRT] VERBOSE: Tactic: 20 time 0.032512 [TensorRT] VERBOSE: Tactic: 21 time 0.028768 [TensorRT] VERBOSE: Tactic: 22 time 0.03072 [TensorRT] VERBOSE: Tactic: 23 time 0.031968 [TensorRT] VERBOSE: Tactic: 24 time 0.043712 [TensorRT] VERBOSE: Tactic: 25 time 0.034752 [TensorRT] VERBOSE: Tactic: 26 time 0.029056 [TensorRT] VERBOSE: Tactic: 27 time 0.029248 [TensorRT] VERBOSE: Tactic: 29 time 0.164928 [TensorRT] VERBOSE: Tactic: 30 time 0.093728 [TensorRT] VERBOSE: Tactic: 31 time 0.06128 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.028768 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.142784 [TensorRT] VERBOSE: Tactic: 0 time 0.388416 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.142784 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.17664 [TensorRT] VERBOSE: Tactic: 0 time 0.036224 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.036224 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.176992 [TensorRT] VERBOSE: Tactic: 0 time 0.353536 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.176992 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.32448 [TensorRT] VERBOSE: Tactic: 0 time 0.342432 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.32448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.184768 [TensorRT] VERBOSE: Tactic: 0 time 0.35328 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.184768 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.175808 [TensorRT] VERBOSE: Tactic: 0 time 0.703456 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.175808 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.1792 [TensorRT] VERBOSE: Tactic: 0 time 0.095872 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.095872 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.177184 [TensorRT] VERBOSE: Tactic: 0 time 0.397312 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.177184 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.1736 [TensorRT] VERBOSE: Tactic: 0 time 0.023552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.175936 [TensorRT] VERBOSE: Tactic: 0 time 0.150624 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.150624 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.170624 [TensorRT] VERBOSE: Tactic: 0 time 0.581376 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.170624 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.172832 [TensorRT] VERBOSE: Tactic: 0 time 0.040544 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040544 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.340352 [TensorRT] VERBOSE: Tactic: 0 time 0.070688 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.070688 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.338592 [TensorRT] VERBOSE: Tactic: 0 time 0.735136 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.338592 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.35584 [TensorRT] VERBOSE: Tactic: 0 time 0.72768 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.35584 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.348448 [TensorRT] VERBOSE: Tactic: 0 time 1.38854 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.348448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.3432 [TensorRT] VERBOSE: Tactic: 0 time 0.068416 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.068416 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.334944 [TensorRT] VERBOSE: Tactic: 0 time 0.223776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.223776 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.815328 [TensorRT] VERBOSE: Tactic: 655359 time 0.730496 [TensorRT] VERBOSE: Tactic: 786431 time 0.692256 [TensorRT] VERBOSE: Tactic: 851967 time 0.8344 [TensorRT] VERBOSE: Tactic: 1179647 time 0.673504 [TensorRT] VERBOSE: Tactic: 1310719 time 1.17325 [TensorRT] VERBOSE: Tactic: 1376255 time 0.72688 [TensorRT] VERBOSE: Tactic: 1441791 time 0.793856 [TensorRT] VERBOSE: Tactic: 1507327 time 0.726976 [TensorRT] VERBOSE: Tactic: 1638399 time 0.700864 [TensorRT] VERBOSE: Tactic: 1835007 time 0.714752 [TensorRT] VERBOSE: Tactic: 1900543 time 0.78448 [TensorRT] VERBOSE: Tactic: 2097151 time 0.7072 [TensorRT] VERBOSE: Tactic: 2162687 time 0.686368 [TensorRT] VERBOSE: Tactic: 2293759 time 0.709984 [TensorRT] VERBOSE: Tactic: 2359295 time 0.623264 [TensorRT] VERBOSE: Tactic: 2686975 time 0.662528 [TensorRT] VERBOSE: Tactic: 3080191 time 0.732384 [TensorRT] VERBOSE: Tactic: 3342335 time 0.748832 [TensorRT] VERBOSE: Tactic: 3407871 time 0.664576 [TensorRT] VERBOSE: Tactic: 3538943 time 0.655808 [TensorRT] VERBOSE: Tactic: 3670015 time 0.903712 [TensorRT] VERBOSE: Tactic: 3932159 time 0.772896 [TensorRT] VERBOSE: Tactic: 3997695 time 0.708384 [TensorRT] VERBOSE: Tactic: 4063231 time 0.784384 [TensorRT] VERBOSE: Tactic: 4194303 time 0.653344 [TensorRT] VERBOSE: Tactic: 4259839 time 0.673344 [TensorRT] VERBOSE: Tactic: 4325375 time 0.66336 [TensorRT] VERBOSE: Tactic: 4521983 time 0.664576 [TensorRT] VERBOSE: Tactic: 4587519 time 0.6616 [TensorRT] VERBOSE: Tactic: 4653055 time 0.622528 [TensorRT] VERBOSE: Tactic: 4915199 time 0.659264 [TensorRT] VERBOSE: Tactic: 4980735 time 0.647776 [TensorRT] VERBOSE: Tactic: 5177343 time 0.71248 [TensorRT] VERBOSE: Tactic: 5242879 time 0.674848 [TensorRT] VERBOSE: Tactic: 5373951 time 0.819232 [TensorRT] VERBOSE: Tactic: 5439487 time 0.997376 [TensorRT] VERBOSE: Tactic: 5570559 time 0.740672 [TensorRT] VERBOSE: Tactic: 5636095 time 0.793504 [TensorRT] VERBOSE: Tactic: 5701631 time 0.68448 [TensorRT] VERBOSE: Tactic: 5767167 time 4.13693 [TensorRT] VERBOSE: Tactic: 5832703 time 0.673632 [TensorRT] VERBOSE: Tactic: 5898239 time 0.63584 [TensorRT] VERBOSE: Tactic: 6029311 time 0.693216 [TensorRT] VERBOSE: Tactic: 6225919 time 0.6728 [TensorRT] VERBOSE: Tactic: 6291455 time 0.672256 [TensorRT] VERBOSE: Tactic: 6422527 time 0.738816 [TensorRT] VERBOSE: Tactic: 6750207 time 0.792096 [TensorRT] VERBOSE: Tactic: 6815743 time 0.795552 [TensorRT] VERBOSE: Tactic: 6946815 time 0.948224 [TensorRT] VERBOSE: Tactic: 7012351 time 0.708928 [TensorRT] VERBOSE: Tactic: 7077887 time 0.658368 [TensorRT] VERBOSE: Tactic: 7143423 time 0.957248 [TensorRT] VERBOSE: Tactic: 7208959 time 0.6928 [TensorRT] VERBOSE: Tactic: 7340031 time 0.646752 [TensorRT] VERBOSE: Tactic: 7405567 time 0.664448 [TensorRT] VERBOSE: Tactic: 7536639 time 0.819936 [TensorRT] VERBOSE: Tactic: 7602175 time 0.724672 [TensorRT] VERBOSE: Tactic: 7733247 time 0.635296 [TensorRT] VERBOSE: Tactic: 7798783 time 0.693248 [TensorRT] VERBOSE: Tactic: 8191999 time 0.922624 [TensorRT] VERBOSE: Tactic: 8257535 time 0.680384 [TensorRT] VERBOSE: Tactic: 8323071 time 0.763712 [TensorRT] VERBOSE: Tactic: 8650751 time 0.766208 [TensorRT] VERBOSE: Tactic: 8716287 time 0.806464 [TensorRT] VERBOSE: Tactic: 9109503 time 0.72992 [TensorRT] VERBOSE: Tactic: 9568255 time 0.66064 [TensorRT] VERBOSE: Tactic: 9895935 time 0.652288 [TensorRT] VERBOSE: Tactic: 10223615 time 0.65536 [TensorRT] VERBOSE: Tactic: 10354687 time 0.670176 [TensorRT] VERBOSE: Tactic: 10551295 time 0.7448 [TensorRT] VERBOSE: Tactic: 10747903 time 0.629504 [TensorRT] VERBOSE: Tactic: 10944511 time 0.652544 [TensorRT] VERBOSE: Fastest Tactic: 4653055 Time: 0.622528 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.355392 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.347712 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.218112 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.350272 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.189408 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.179872 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.1888 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.264416 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.215456 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.179872 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.347296 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 6422528, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 6963200, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 108544, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.347296 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,401408) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.123072 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.094496 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.088384 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.071776 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.0976 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.08704 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.071072 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.072288 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.091872 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.11952 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.091296 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.118944 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.071072 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,401408) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.169984 [TensorRT] VERBOSE: Tactic: 655359 time 0.1704 [TensorRT] VERBOSE: Tactic: 786431 time 0.139904 [TensorRT] VERBOSE: Tactic: 851967 time 0.279648 [TensorRT] VERBOSE: Tactic: 1179647 time 0.17152 [TensorRT] VERBOSE: Tactic: 1310719 time 0.129024 [TensorRT] VERBOSE: Tactic: 1376255 time 0.140224 [TensorRT] VERBOSE: Tactic: 1441791 time 0.189728 [TensorRT] VERBOSE: Tactic: 1507327 time 0.209504 [TensorRT] VERBOSE: Tactic: 1638399 time 0.182048 [TensorRT] VERBOSE: Tactic: 1835007 time 0.142752 [TensorRT] VERBOSE: Tactic: 1900543 time 0.206368 [TensorRT] VERBOSE: Tactic: 2097151 time 0.175104 [TensorRT] VERBOSE: Tactic: 2162687 time 0.171712 [TensorRT] VERBOSE: Tactic: 2293759 time 0.140448 [TensorRT] VERBOSE: Tactic: 2359295 time 0.173952 [TensorRT] VERBOSE: Tactic: 2686975 time 0.155008 [TensorRT] VERBOSE: Tactic: 3080191 time 0.192224 [TensorRT] VERBOSE: Tactic: 3342335 time 0.207872 [TensorRT] VERBOSE: Tactic: 3407871 time 0.137696 [TensorRT] VERBOSE: Tactic: 3538943 time 0.145568 [TensorRT] VERBOSE: Tactic: 3670015 time 0.185408 [TensorRT] VERBOSE: Tactic: 3932159 time 0.183264 [TensorRT] VERBOSE: Tactic: 3997695 time 0.149728 [TensorRT] VERBOSE: Tactic: 4063231 time 0.26656 [TensorRT] VERBOSE: Tactic: 4194303 time 0.128032 [TensorRT] VERBOSE: Tactic: 4259839 time 0.1984 [TensorRT] VERBOSE: Tactic: 4325375 time 0.22016 [TensorRT] VERBOSE: Tactic: 4521983 time 0.202976 [TensorRT] VERBOSE: Tactic: 4587519 time 0.136032 [TensorRT] VERBOSE: Tactic: 4653055 time 0.180096 [TensorRT] VERBOSE: Tactic: 4915199 time 0.13184 [TensorRT] VERBOSE: Tactic: 4980735 time 0.213056 [TensorRT] VERBOSE: Tactic: 5177343 time 0.177184 [TensorRT] VERBOSE: Tactic: 5242879 time 0.139744 [TensorRT] VERBOSE: Tactic: 5373951 time 0.20128 [TensorRT] VERBOSE: Tactic: 5439487 time 0.207936 [TensorRT] VERBOSE: Tactic: 5570559 time 0.200608 [TensorRT] VERBOSE: Tactic: 5636095 time 0.268288 [TensorRT] VERBOSE: Tactic: 5701631 time 0.148544 [TensorRT] VERBOSE: Tactic: 5767167 time 0.473056 [TensorRT] VERBOSE: Tactic: 5832703 time 0.13072 [TensorRT] VERBOSE: Tactic: 5898239 time 0.168448 [TensorRT] VERBOSE: Tactic: 6029311 time 0.141248 [TensorRT] VERBOSE: Tactic: 6225919 time 0.150912 [TensorRT] VERBOSE: Tactic: 6291455 time 0.171488 [TensorRT] VERBOSE: Tactic: 6422527 time 0.184224 [TensorRT] VERBOSE: Tactic: 6750207 time 0.180224 [TensorRT] VERBOSE: Tactic: 6815743 time 0.165184 [TensorRT] VERBOSE: Tactic: 6946815 time 0.19328 [TensorRT] VERBOSE: Tactic: 7012351 time 0.174432 [TensorRT] VERBOSE: Tactic: 7077887 time 0.145184 [TensorRT] VERBOSE: Tactic: 7143423 time 0.195104 [TensorRT] VERBOSE: Tactic: 7208959 time 0.144928 [TensorRT] VERBOSE: Tactic: 7340031 time 0.174848 [TensorRT] VERBOSE: Tactic: 7405567 time 0.150784 [TensorRT] VERBOSE: Tactic: 7536639 time 0.170848 [TensorRT] VERBOSE: Tactic: 7602175 time 0.141696 [TensorRT] VERBOSE: Tactic: 7733247 time 0.142464 [TensorRT] VERBOSE: Tactic: 7798783 time 0.13904 [TensorRT] VERBOSE: Tactic: 8191999 time 0.186368 [TensorRT] VERBOSE: Tactic: 8257535 time 0.141728 [TensorRT] VERBOSE: Tactic: 8323071 time 0.153152 [TensorRT] VERBOSE: Tactic: 8650751 time 0.157152 [TensorRT] VERBOSE: Tactic: 8716287 time 0.181856 [TensorRT] VERBOSE: Tactic: 9109503 time 0.21696 [TensorRT] VERBOSE: Tactic: 9568255 time 0.134624 [TensorRT] VERBOSE: Tactic: 9895935 time 0.128192 [TensorRT] VERBOSE: Tactic: 10223615 time 0.152832 [TensorRT] VERBOSE: Tactic: 10354687 time 0.224768 [TensorRT] VERBOSE: Tactic: 10551295 time 0.153024 [TensorRT] VERBOSE: Tactic: 10747903 time 0.13712 [TensorRT] VERBOSE: Tactic: 10944511 time 0.211968 [TensorRT] VERBOSE: Fastest Tactic: 4194303 Time: 0.128032 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.054144 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.101536 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.058656 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.057344 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.07632 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.101408 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.069632 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.069024 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.1024 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.066176 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.073216 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.070816 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.054144 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3145259992339075399 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,401408) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.098112 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.075296 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.069248 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.056096 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.06688 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.056352 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.070688 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.073184 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.098848 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.069056 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.057728 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.0992 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.056096 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,50176) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,50176) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,50176) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.106816 [TensorRT] VERBOSE: Tactic: 655359 time 0.148352 [TensorRT] VERBOSE: Tactic: 786431 time 0.124736 [TensorRT] VERBOSE: Tactic: 851967 time 0.26784 [TensorRT] VERBOSE: Tactic: 1179647 time 0.158016 [TensorRT] VERBOSE: Tactic: 1310719 time 0.10224 [TensorRT] VERBOSE: Tactic: 1376255 time 0.113664 [TensorRT] VERBOSE: Tactic: 1441791 time 0.170592 [TensorRT] VERBOSE: Tactic: 1507327 time 0.187232 [TensorRT] VERBOSE: Tactic: 1638399 time 0.167936 [TensorRT] VERBOSE: Tactic: 1835007 time 0.1392 [TensorRT] VERBOSE: Tactic: 1900543 time 0.169632 [TensorRT] VERBOSE: Tactic: 2097151 time 0.209344 [TensorRT] VERBOSE: Tactic: 2162687 time 0.124192 [TensorRT] VERBOSE: Tactic: 2293759 time 0.120672 [TensorRT] VERBOSE: Tactic: 2359295 time 0.126496 [TensorRT] VERBOSE: Tactic: 2686975 time 0.121152 [TensorRT] VERBOSE: Tactic: 3080191 time 0.173216 [TensorRT] VERBOSE: Tactic: 3342335 time 0.181568 [TensorRT] VERBOSE: Tactic: 3407871 time 0.127008 [TensorRT] VERBOSE: Tactic: 3538943 time 0.137216 [TensorRT] VERBOSE: Tactic: 3670015 time 0.142464 [TensorRT] VERBOSE: Tactic: 3932159 time 0.165216 [TensorRT] VERBOSE: Tactic: 3997695 time 0.132896 [TensorRT] VERBOSE: Tactic: 4063231 time 0.26 [TensorRT] VERBOSE: Tactic: 4194303 time 0.115392 [TensorRT] VERBOSE: Tactic: 4259839 time 0.184064 [TensorRT] VERBOSE: Tactic: 4325375 time 0.217344 [TensorRT] VERBOSE: Tactic: 4521983 time 0.198656 [TensorRT] VERBOSE: Tactic: 4587519 time 0.12432 [TensorRT] VERBOSE: Tactic: 4653055 time 0.169312 [TensorRT] VERBOSE: Tactic: 4915199 time 0.12224 [TensorRT] VERBOSE: Tactic: 4980735 time 0.210816 [TensorRT] VERBOSE: Tactic: 5177343 time 0.159008 [TensorRT] VERBOSE: Tactic: 5242879 time 0.129856 [TensorRT] VERBOSE: Tactic: 5373951 time 0.17312 [TensorRT] VERBOSE: Tactic: 5439487 time 0.176832 [TensorRT] VERBOSE: Tactic: 5570559 time 0.178944 [TensorRT] VERBOSE: Tactic: 5636095 time 0.258208 [TensorRT] VERBOSE: Tactic: 5701631 time 0.114592 [TensorRT] VERBOSE: Tactic: 5767167 time 0.4208 [TensorRT] VERBOSE: Tactic: 5832703 time 0.121888 [TensorRT] VERBOSE: Tactic: 5898239 time 0.155744 [TensorRT] VERBOSE: Tactic: 6029311 time 0.12128 [TensorRT] VERBOSE: Tactic: 6225919 time 0.141248 [TensorRT] VERBOSE: Tactic: 6291455 time 0.15888 [TensorRT] VERBOSE: Tactic: 6422527 time 0.16976 [TensorRT] VERBOSE: Tactic: 6750207 time 0.17648 [TensorRT] VERBOSE: Tactic: 6815743 time 0.143488 [TensorRT] VERBOSE: Tactic: 6946815 time 0.162112 [TensorRT] VERBOSE: Tactic: 7012351 time 0.20528 [TensorRT] VERBOSE: Tactic: 7077887 time 0.130272 [TensorRT] VERBOSE: Tactic: 7143423 time 0.21504 [TensorRT] VERBOSE: Tactic: 7208959 time 0.120736 [TensorRT] VERBOSE: Tactic: 7340031 time 0.15664 [TensorRT] VERBOSE: Tactic: 7405567 time 0.130592 [TensorRT] VERBOSE: Tactic: 7536639 time 0.165504 [TensorRT] VERBOSE: Tactic: 7602175 time 0.129376 [TensorRT] VERBOSE: Tactic: 7733247 time 0.124992 [TensorRT] VERBOSE: Tactic: 7798783 time 0.125472 [TensorRT] VERBOSE: Tactic: 8191999 time 0.191776 [TensorRT] VERBOSE: Tactic: 8257535 time 0.114848 [TensorRT] VERBOSE: Tactic: 8323071 time 0.151776 [TensorRT] VERBOSE: Tactic: 8650751 time 0.130048 [TensorRT] VERBOSE: Tactic: 8716287 time 0.154784 [TensorRT] VERBOSE: Tactic: 9109503 time 0.159712 [TensorRT] VERBOSE: Tactic: 9568255 time 0.122656 [TensorRT] VERBOSE: Tactic: 9895935 time 0.113984 [TensorRT] VERBOSE: Tactic: 10223615 time 0.118784 [TensorRT] VERBOSE: Tactic: 10354687 time 0.220512 [TensorRT] VERBOSE: Tactic: 10551295 time 0.137088 [TensorRT] VERBOSE: Tactic: 10747903 time 0.126336 [TensorRT] VERBOSE: Tactic: 10944511 time 0.210464 [TensorRT] VERBOSE: Fastest Tactic: 1310719 Time: 0.10224 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.059616 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.073472 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.057344 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.045056 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.074304 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.042528 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.04544 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.041184 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.040544 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.045824 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.07168 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.05536 [TensorRT] VERBOSE: Fastest Tactic: -1383447415429797909 Time: 0.040544 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1383447415429797909 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.116512 [TensorRT] VERBOSE: Tactic: 256 time 0.117504 [TensorRT] VERBOSE: Tactic: 512 time 0.121664 [TensorRT] VERBOSE: Tactic: -32 time 0.172096 [TensorRT] VERBOSE: Tactic: -64 time 0.142784 [TensorRT] VERBOSE: Tactic: -128 time 0.137472 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.116512 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.069664 [TensorRT] VERBOSE: Tactic: 1 time 0.064512 [TensorRT] VERBOSE: Tactic: 2 time 0.05952 [TensorRT] VERBOSE: Tactic: 3 time 0.064416 [TensorRT] VERBOSE: Tactic: 4 time 0.05728 [TensorRT] VERBOSE: Tactic: 5 time 0.056832 [TensorRT] VERBOSE: Tactic: 6 time 0.063616 [TensorRT] VERBOSE: Tactic: 7 time 0.058784 [TensorRT] VERBOSE: Tactic: 8 time 0.058144 [TensorRT] VERBOSE: Tactic: 9 time 0.060192 [TensorRT] VERBOSE: Tactic: 28 time 0.069952 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.056832 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.11728 [TensorRT] VERBOSE: Tactic: 256 time 0.116 [TensorRT] VERBOSE: Tactic: 512 time 0.119808 [TensorRT] VERBOSE: Tactic: -32 time 0.172192 [TensorRT] VERBOSE: Tactic: -64 time 0.140448 [TensorRT] VERBOSE: Tactic: -128 time 0.137344 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.116 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.096256 [TensorRT] VERBOSE: Tactic: 25 time 0.094496 [TensorRT] VERBOSE: Tactic: 26 time 0.095328 [TensorRT] VERBOSE: Tactic: 27 time 0.09584 [TensorRT] VERBOSE: Tactic: 31 time 0.095072 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.094496 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.157216 [TensorRT] VERBOSE: Tactic: 256 time 0.131936 [TensorRT] VERBOSE: Tactic: 512 time 0.133984 [TensorRT] VERBOSE: Tactic: -32 time 0.166304 [TensorRT] VERBOSE: Tactic: -64 time 0.179136 [TensorRT] VERBOSE: Tactic: -128 time 0.176992 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.131936 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.04224 [TensorRT] VERBOSE: Tactic: 1 time 0.032032 [TensorRT] VERBOSE: Tactic: 2 time 0.030496 [TensorRT] VERBOSE: Tactic: 3 time 0.028064 [TensorRT] VERBOSE: Tactic: 4 time 0.030112 [TensorRT] VERBOSE: Tactic: 5 time 0.031744 [TensorRT] VERBOSE: Tactic: 6 time 0.027936 [TensorRT] VERBOSE: Tactic: 7 time 0.030176 [TensorRT] VERBOSE: Tactic: 8 time 0.036864 [TensorRT] VERBOSE: Tactic: 9 time 0.037888 [TensorRT] VERBOSE: Tactic: 10 time 0.071104 [TensorRT] VERBOSE: Tactic: 11 time 0.05296 [TensorRT] VERBOSE: Tactic: 12 time 0.047104 [TensorRT] VERBOSE: Tactic: 13 time 0.042176 [TensorRT] VERBOSE: Tactic: 14 time 0.040096 [TensorRT] VERBOSE: Tactic: 15 time 0.040416 [TensorRT] VERBOSE: Tactic: 16 time 0.04128 [TensorRT] VERBOSE: Tactic: 17 time 0.038656 [TensorRT] VERBOSE: Tactic: 18 time 0.042848 [TensorRT] VERBOSE: Tactic: 19 time 0.043968 [TensorRT] VERBOSE: Tactic: 20 time 0.123328 [TensorRT] VERBOSE: Tactic: 21 time 0.086112 [TensorRT] VERBOSE: Tactic: 22 time 0.061408 [TensorRT] VERBOSE: Tactic: 23 time 0.052864 [TensorRT] VERBOSE: Tactic: 28 time 0.058368 [TensorRT] VERBOSE: Tactic: 29 time 0.076 [TensorRT] VERBOSE: Tactic: 30 time 0.11776 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.027936 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.155488 [TensorRT] VERBOSE: Tactic: 256 time 0.132576 [TensorRT] VERBOSE: Tactic: 512 time 0.133344 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.132576 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.02928 [TensorRT] VERBOSE: Tactic: 11 time 0.030144 [TensorRT] VERBOSE: Tactic: 12 time 0.031104 [TensorRT] VERBOSE: Tactic: 13 time 0.032704 [TensorRT] VERBOSE: Tactic: 14 time 0.030528 [TensorRT] VERBOSE: Tactic: 15 time 0.040416 [TensorRT] VERBOSE: Tactic: 16 time 0.030432 [TensorRT] VERBOSE: Tactic: 17 time 0.03392 [TensorRT] VERBOSE: Tactic: 18 time 0.045344 [TensorRT] VERBOSE: Tactic: 19 time 0.059328 [TensorRT] VERBOSE: Tactic: 20 time 0.031936 [TensorRT] VERBOSE: Tactic: 21 time 0.028256 [TensorRT] VERBOSE: Tactic: 22 time 0.028576 [TensorRT] VERBOSE: Tactic: 23 time 0.032768 [TensorRT] VERBOSE: Tactic: 24 time 0.04256 [TensorRT] VERBOSE: Tactic: 25 time 0.034592 [TensorRT] VERBOSE: Tactic: 26 time 0.029696 [TensorRT] VERBOSE: Tactic: 27 time 0.03008 [TensorRT] VERBOSE: Tactic: 29 time 0.164704 [TensorRT] VERBOSE: Tactic: 30 time 0.093376 [TensorRT] VERBOSE: Tactic: 31 time 0.060736 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.028256 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.56768 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.56768 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.452 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.437568 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.449408 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.492192 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.409728 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.415232 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.528416 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.44992 [TensorRT] VERBOSE: Fastest Tactic: 6808617066150061604 Time: 0.409728 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.616992 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 7225344, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 37322752, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 313856, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.616992 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.127232 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.134144 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.132448 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.117216 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.126976 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.135584 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.120224 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.117088 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.128 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.150112 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.117088 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.155648 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.155648 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.11232 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.11248 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.1232 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.121024 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.12448 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.122112 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.121536 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.137024 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.119968 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.113472 [TensorRT] VERBOSE: Fastest Tactic: 4438325421691896755 Time: 0.11232 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4438325421691896755 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.123328 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.12752 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.114688 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.121152 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.110784 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.118784 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.122048 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.113024 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.121248 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.135584 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.110784 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.144096 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.144096 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.047936 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.0528 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.051264 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.051744 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.047648 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.049504 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.053664 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.050784 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.05168 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.048 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.048128 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.046336 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.046336 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.07392 [TensorRT] VERBOSE: Tactic: 0 time 0.176928 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.07392 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.093312 [TensorRT] VERBOSE: Tactic: 0 time 0.020608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.08928 [TensorRT] VERBOSE: Tactic: 0 time 0.1176 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.08928 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.126624 [TensorRT] VERBOSE: Tactic: 0 time 0.092416 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.092416 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.095072 [TensorRT] VERBOSE: Tactic: 0 time 0.082176 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.082176 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.089888 [TensorRT] VERBOSE: Tactic: 0 time 0.161856 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.089888 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.091648 [TensorRT] VERBOSE: Tactic: 0 time 0.032128 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.032128 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.091872 [TensorRT] VERBOSE: Tactic: 0 time 0.1752 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.091872 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.088064 [TensorRT] VERBOSE: Tactic: 0 time 0.019072 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019072 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.091904 [TensorRT] VERBOSE: Tactic: 0 time 0.057024 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.057024 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.084928 [TensorRT] VERBOSE: Tactic: 0 time 0.190112 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.084928 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.089856 [TensorRT] VERBOSE: Tactic: 0 time 0.055232 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.055232 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061632 [TensorRT] VERBOSE: Tactic: 256 time 0.060512 [TensorRT] VERBOSE: Tactic: 512 time 0.06336 [TensorRT] VERBOSE: Tactic: -32 time 0.091552 [TensorRT] VERBOSE: Tactic: -64 time 0.076992 [TensorRT] VERBOSE: Tactic: -128 time 0.07328 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.060512 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.035968 [TensorRT] VERBOSE: Tactic: 1 time 0.034912 [TensorRT] VERBOSE: Tactic: 2 time 0.031712 [TensorRT] VERBOSE: Tactic: 3 time 0.03456 [TensorRT] VERBOSE: Tactic: 4 time 0.031488 [TensorRT] VERBOSE: Tactic: 5 time 0.03168 [TensorRT] VERBOSE: Tactic: 6 time 0.03664 [TensorRT] VERBOSE: Tactic: 7 time 0.034304 [TensorRT] VERBOSE: Tactic: 8 time 0.03232 [TensorRT] VERBOSE: Tactic: 9 time 0.033024 [TensorRT] VERBOSE: Tactic: 28 time 0.037664 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.031488 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061792 [TensorRT] VERBOSE: Tactic: 256 time 0.06144 [TensorRT] VERBOSE: Tactic: 512 time 0.062688 [TensorRT] VERBOSE: Tactic: -32 time 0.094016 [TensorRT] VERBOSE: Tactic: -64 time 0.0776 [TensorRT] VERBOSE: Tactic: -128 time 0.073728 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.06144 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.0496 [TensorRT] VERBOSE: Tactic: 25 time 0.05024 [TensorRT] VERBOSE: Tactic: 26 time 0.049856 [TensorRT] VERBOSE: Tactic: 27 time 0.050912 [TensorRT] VERBOSE: Tactic: 31 time 0.050304 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.0496 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.081664 [TensorRT] VERBOSE: Tactic: 256 time 0.069536 [TensorRT] VERBOSE: Tactic: 512 time 0.070912 [TensorRT] VERBOSE: Tactic: -32 time 0.08784 [TensorRT] VERBOSE: Tactic: -64 time 0.096384 [TensorRT] VERBOSE: Tactic: -128 time 0.099328 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.069536 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.023776 [TensorRT] VERBOSE: Tactic: 1 time 0.019232 [TensorRT] VERBOSE: Tactic: 2 time 0.0192 [TensorRT] VERBOSE: Tactic: 3 time 0.019136 [TensorRT] VERBOSE: Tactic: 4 time 0.018048 [TensorRT] VERBOSE: Tactic: 5 time 0.019456 [TensorRT] VERBOSE: Tactic: 6 time 0.017984 [TensorRT] VERBOSE: Tactic: 7 time 0.017856 [TensorRT] VERBOSE: Tactic: 8 time 0.02432 [TensorRT] VERBOSE: Tactic: 9 time 0.025312 [TensorRT] VERBOSE: Tactic: 10 time 0.038912 [TensorRT] VERBOSE: Tactic: 11 time 0.029216 [TensorRT] VERBOSE: Tactic: 12 time 0.02656 [TensorRT] VERBOSE: Tactic: 13 time 0.024672 [TensorRT] VERBOSE: Tactic: 14 time 0.024256 [TensorRT] VERBOSE: Tactic: 15 time 0.0248 [TensorRT] VERBOSE: Tactic: 16 time 0.02512 [TensorRT] VERBOSE: Tactic: 17 time 0.02416 [TensorRT] VERBOSE: Tactic: 18 time 0.025504 [TensorRT] VERBOSE: Tactic: 19 time 0.02528 [TensorRT] VERBOSE: Tactic: 20 time 0.063616 [TensorRT] VERBOSE: Tactic: 21 time 0.046496 [TensorRT] VERBOSE: Tactic: 22 time 0.034112 [TensorRT] VERBOSE: Tactic: 23 time 0.031744 [TensorRT] VERBOSE: Tactic: 28 time 0.031904 [TensorRT] VERBOSE: Tactic: 29 time 0.040576 [TensorRT] VERBOSE: Tactic: 30 time 0.062048 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.017856 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.081088 [TensorRT] VERBOSE: Tactic: 256 time 0.070304 [TensorRT] VERBOSE: Tactic: 512 time 0.071168 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.070304 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.017408 [TensorRT] VERBOSE: Tactic: 11 time 0.018976 [TensorRT] VERBOSE: Tactic: 12 time 0.0184 [TensorRT] VERBOSE: Tactic: 13 time 0.01792 [TensorRT] VERBOSE: Tactic: 14 time 0.017984 [TensorRT] VERBOSE: Tactic: 15 time 0.027104 [TensorRT] VERBOSE: Tactic: 16 time 0.022528 [TensorRT] VERBOSE: Tactic: 17 time 0.023616 [TensorRT] VERBOSE: Tactic: 18 time 0.025248 [TensorRT] VERBOSE: Tactic: 19 time 0.041216 [TensorRT] VERBOSE: Tactic: 20 time 0.018464 [TensorRT] VERBOSE: Tactic: 21 time 0.018848 [TensorRT] VERBOSE: Tactic: 22 time 0.017952 [TensorRT] VERBOSE: Tactic: 23 time 0.017568 [TensorRT] VERBOSE: Tactic: 24 time 0.024448 [TensorRT] VERBOSE: Tactic: 25 time 0.020416 [TensorRT] VERBOSE: Tactic: 26 time 0.01808 [TensorRT] VERBOSE: Tactic: 27 time 0.017472 [TensorRT] VERBOSE: Tactic: 29 time 0.086016 [TensorRT] VERBOSE: Tactic: 30 time 0.049216 [TensorRT] VERBOSE: Tactic: 31 time 0.034176 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.017408 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.330304 [TensorRT] VERBOSE: Tactic: 655359 time 0.3608 [TensorRT] VERBOSE: Tactic: 786431 time 0.275872 [TensorRT] VERBOSE: Tactic: 851967 time 0.329056 [TensorRT] VERBOSE: Tactic: 1179647 time 0.287456 [TensorRT] VERBOSE: Tactic: 1310719 time 0.489024 [TensorRT] VERBOSE: Tactic: 1376255 time 0.315776 [TensorRT] VERBOSE: Tactic: 1441791 time 0.394688 [TensorRT] VERBOSE: Tactic: 1507327 time 0.335872 [TensorRT] VERBOSE: Tactic: 1638399 time 0.291136 [TensorRT] VERBOSE: Tactic: 1835007 time 0.288576 [TensorRT] VERBOSE: Tactic: 1900543 time 0.358912 [TensorRT] VERBOSE: Tactic: 2097151 time 0.287008 [TensorRT] VERBOSE: Tactic: 2162687 time 0.282336 [TensorRT] VERBOSE: Tactic: 2293759 time 0.316928 [TensorRT] VERBOSE: Tactic: 2359295 time 0.267776 [TensorRT] VERBOSE: Tactic: 2686975 time 0.28352 [TensorRT] VERBOSE: Tactic: 3080191 time 0.340736 [TensorRT] VERBOSE: Tactic: 3342335 time 0.326656 [TensorRT] VERBOSE: Tactic: 3407871 time 0.281728 [TensorRT] VERBOSE: Tactic: 3538943 time 0.277632 [TensorRT] VERBOSE: Tactic: 3670015 time 0.40912 [TensorRT] VERBOSE: Tactic: 3932159 time 0.3544 [TensorRT] VERBOSE: Tactic: 3997695 time 0.290304 [TensorRT] VERBOSE: Tactic: 4063231 time 0.327232 [TensorRT] VERBOSE: Tactic: 4194303 time 0.24992 [TensorRT] VERBOSE: Tactic: 4259839 time 0.26832 [TensorRT] VERBOSE: Tactic: 4325375 time 0.259648 [TensorRT] VERBOSE: Tactic: 4521983 time 0.297568 [TensorRT] VERBOSE: Tactic: 4587519 time 0.25584 [TensorRT] VERBOSE: Tactic: 4653055 time 0.264896 [TensorRT] VERBOSE: Tactic: 4915199 time 0.253568 [TensorRT] VERBOSE: Tactic: 4980735 time 0.267744 [TensorRT] VERBOSE: Tactic: 5177343 time 0.299232 [TensorRT] VERBOSE: Tactic: 5242879 time 0.279232 [TensorRT] VERBOSE: Tactic: 5373951 time 0.366304 [TensorRT] VERBOSE: Tactic: 5439487 time 0.413056 [TensorRT] VERBOSE: Tactic: 5570559 time 0.342912 [TensorRT] VERBOSE: Tactic: 5636095 time 0.328256 [TensorRT] VERBOSE: Tactic: 5701631 time 0.290848 [TensorRT] VERBOSE: Tactic: 5767167 time 1.23091 [TensorRT] VERBOSE: Tactic: 5832703 time 0.274464 [TensorRT] VERBOSE: Tactic: 5898239 time 0.268352 [TensorRT] VERBOSE: Tactic: 6029311 time 0.288512 [TensorRT] VERBOSE: Tactic: 6225919 time 0.28016 [TensorRT] VERBOSE: Tactic: 6291455 time 0.28832 [TensorRT] VERBOSE: Tactic: 6422527 time 0.336032 [TensorRT] VERBOSE: Tactic: 6750207 time 0.316 [TensorRT] VERBOSE: Tactic: 6815743 time 0.33792 [TensorRT] VERBOSE: Tactic: 6946815 time 0.386432 [TensorRT] VERBOSE: Tactic: 7012351 time 0.28496 [TensorRT] VERBOSE: Tactic: 7077887 time 0.269856 [TensorRT] VERBOSE: Tactic: 7143423 time 0.395648 [TensorRT] VERBOSE: Tactic: 7208959 time 0.288352 [TensorRT] VERBOSE: Tactic: 7340031 time 0.287488 [TensorRT] VERBOSE: Tactic: 7405567 time 0.283136 [TensorRT] VERBOSE: Tactic: 7536639 time 0.34384 [TensorRT] VERBOSE: Tactic: 7602175 time 0.26576 [TensorRT] VERBOSE: Tactic: 7733247 time 0.267808 [TensorRT] VERBOSE: Tactic: 7798783 time 0.277504 [TensorRT] VERBOSE: Tactic: 8191999 time 0.359264 [TensorRT] VERBOSE: Tactic: 8257535 time 0.277344 [TensorRT] VERBOSE: Tactic: 8323071 time 0.298464 [TensorRT] VERBOSE: Tactic: 8650751 time 0.30288 [TensorRT] VERBOSE: Tactic: 8716287 time 0.351712 [TensorRT] VERBOSE: Tactic: 9109503 time 0.311648 [TensorRT] VERBOSE: Tactic: 9568255 time 0.25376 [TensorRT] VERBOSE: Tactic: 9895935 time 0.250528 [TensorRT] VERBOSE: Tactic: 10223615 time 0.278112 [TensorRT] VERBOSE: Tactic: 10354687 time 0.266976 [TensorRT] VERBOSE: Tactic: 10551295 time 0.297472 [TensorRT] VERBOSE: Tactic: 10747903 time 0.258336 [TensorRT] VERBOSE: Tactic: 10944511 time 0.268256 [TensorRT] VERBOSE: Fastest Tactic: 4194303 Time: 0.24992 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.115808 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.116512 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.117216 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.116192 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.107328 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.10336 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.10928 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.149504 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.123904 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.10336 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.183264 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 1605632, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 6127616, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.182336 [TensorRT] VERBOSE: Fastest Tactic: 57 Time: 0.182336 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.045728 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.055104 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.0448 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.042912 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.054688 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.046496 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.042752 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.041472 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.052416 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.04528 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.04592 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.044608 [TensorRT] VERBOSE: Fastest Tactic: -7924103240988931433 Time: 0.041472 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7924103240988931433 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.089312 [TensorRT] VERBOSE: Tactic: 655359 time 0.078688 [TensorRT] VERBOSE: Tactic: 786431 time 0.073024 [TensorRT] VERBOSE: Tactic: 851967 time 0.088384 [TensorRT] VERBOSE: Tactic: 1179647 time 0.085632 [TensorRT] VERBOSE: Tactic: 1310719 time 0.073728 [TensorRT] VERBOSE: Tactic: 1376255 time 0.08112 [TensorRT] VERBOSE: Tactic: 1441791 time 0.096704 [TensorRT] VERBOSE: Tactic: 1507327 time 0.075168 [TensorRT] VERBOSE: Tactic: 1638399 time 0.088288 [TensorRT] VERBOSE: Tactic: 1835007 time 0.074112 [TensorRT] VERBOSE: Tactic: 1900543 time 0.080896 [TensorRT] VERBOSE: Tactic: 2097151 time 0.086944 [TensorRT] VERBOSE: Tactic: 2162687 time 0.094656 [TensorRT] VERBOSE: Tactic: 2293759 time 0.08128 [TensorRT] VERBOSE: Tactic: 2359295 time 0.09792 [TensorRT] VERBOSE: Tactic: 2686975 time 0.086016 [TensorRT] VERBOSE: Tactic: 3080191 time 0.074336 [TensorRT] VERBOSE: Tactic: 3342335 time 0.077024 [TensorRT] VERBOSE: Tactic: 3407871 time 0.076928 [TensorRT] VERBOSE: Tactic: 3538943 time 0.07728 [TensorRT] VERBOSE: Tactic: 3670015 time 0.087648 [TensorRT] VERBOSE: Tactic: 3932159 time 0.073216 [TensorRT] VERBOSE: Tactic: 3997695 time 0.07648 [TensorRT] VERBOSE: Tactic: 4063231 time 0.083328 [TensorRT] VERBOSE: Tactic: 4194303 time 0.068096 [TensorRT] VERBOSE: Tactic: 4259839 time 0.094528 [TensorRT] VERBOSE: Tactic: 4325375 time 0.11264 [TensorRT] VERBOSE: Tactic: 4521983 time 0.107648 [TensorRT] VERBOSE: Tactic: 4587519 time 0.072704 [TensorRT] VERBOSE: Tactic: 4653055 time 0.097344 [TensorRT] VERBOSE: Tactic: 4915199 time 0.067744 [TensorRT] VERBOSE: Tactic: 4980735 time 0.109888 [TensorRT] VERBOSE: Tactic: 5177343 time 0.088384 [TensorRT] VERBOSE: Tactic: 5242879 time 0.072896 [TensorRT] VERBOSE: Tactic: 5373951 time 0.09568 [TensorRT] VERBOSE: Tactic: 5439487 time 0.092352 [TensorRT] VERBOSE: Tactic: 5570559 time 0.075776 [TensorRT] VERBOSE: Tactic: 5636095 time 0.083008 [TensorRT] VERBOSE: Tactic: 5701631 time 0.080448 [TensorRT] VERBOSE: Tactic: 5767167 time 0.172672 [TensorRT] VERBOSE: Tactic: 5832703 time 0.071488 [TensorRT] VERBOSE: Tactic: 5898239 time 0.085856 [TensorRT] VERBOSE: Tactic: 6029311 time 0.077536 [TensorRT] VERBOSE: Tactic: 6225919 time 0.075392 [TensorRT] VERBOSE: Tactic: 6291455 time 0.085952 [TensorRT] VERBOSE: Tactic: 6422527 time 0.071168 [TensorRT] VERBOSE: Tactic: 6750207 time 0.086016 [TensorRT] VERBOSE: Tactic: 6815743 time 0.081824 [TensorRT] VERBOSE: Tactic: 6946815 time 0.087136 [TensorRT] VERBOSE: Tactic: 7012351 time 0.08608 [TensorRT] VERBOSE: Tactic: 7077887 time 0.071872 [TensorRT] VERBOSE: Tactic: 7143423 time 0.093696 [TensorRT] VERBOSE: Tactic: 7208959 time 0.075872 [TensorRT] VERBOSE: Tactic: 7340031 time 0.086624 [TensorRT] VERBOSE: Tactic: 7405567 time 0.074752 [TensorRT] VERBOSE: Tactic: 7536639 time 0.087168 [TensorRT] VERBOSE: Tactic: 7602175 time 0.0712 [TensorRT] VERBOSE: Tactic: 7733247 time 0.07104 [TensorRT] VERBOSE: Tactic: 7798783 time 0.073856 [TensorRT] VERBOSE: Tactic: 8191999 time 0.09104 [TensorRT] VERBOSE: Tactic: 8257535 time 0.069248 [TensorRT] VERBOSE: Tactic: 8323071 time 0.075872 [TensorRT] VERBOSE: Tactic: 8650751 time 0.076992 [TensorRT] VERBOSE: Tactic: 8716287 time 0.087936 [TensorRT] VERBOSE: Tactic: 9109503 time 0.104288 [TensorRT] VERBOSE: Tactic: 9568255 time 0.066432 [TensorRT] VERBOSE: Tactic: 9895935 time 0.068352 [TensorRT] VERBOSE: Tactic: 10223615 time 0.087264 [TensorRT] VERBOSE: Tactic: 10354687 time 0.11376 [TensorRT] VERBOSE: Tactic: 10551295 time 0.07584 [TensorRT] VERBOSE: Tactic: 10747903 time 0.071008 [TensorRT] VERBOSE: Tactic: 10944511 time 0.110592 [TensorRT] VERBOSE: Fastest Tactic: 9568255 Time: 0.066432 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.034624 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.037024 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.035328 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.03472 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.044736 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.037824 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.03856 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.03888 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.037632 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.036768 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.041984 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.041984 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.034624 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3145259992339075399 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.03792 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.044128 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.039968 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.034432 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.036864 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.034848 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.040224 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.041984 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.037888 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.03584 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.0352 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.037888 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.034432 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.056384 [TensorRT] VERBOSE: Tactic: 655359 time 0.047136 [TensorRT] VERBOSE: Tactic: 786431 time 0.068576 [TensorRT] VERBOSE: Tactic: 851967 time 0.077856 [TensorRT] VERBOSE: Tactic: 1179647 time 0.08128 [TensorRT] VERBOSE: Tactic: 1310719 time 0.056128 [TensorRT] VERBOSE: Tactic: 1376255 time 0.0648 [TensorRT] VERBOSE: Tactic: 1441791 time 0.08784 [TensorRT] VERBOSE: Tactic: 1507327 time 0.05616 [TensorRT] VERBOSE: Tactic: 1638399 time 0.087424 [TensorRT] VERBOSE: Tactic: 1835007 time 0.074816 [TensorRT] VERBOSE: Tactic: 1900543 time 0.055232 [TensorRT] VERBOSE: Tactic: 2097151 time 0.101728 [TensorRT] VERBOSE: Tactic: 2162687 time 0.071264 [TensorRT] VERBOSE: Tactic: 2293759 time 0.071136 [TensorRT] VERBOSE: Tactic: 2359295 time 0.067552 [TensorRT] VERBOSE: Tactic: 2686975 time 0.06656 [TensorRT] VERBOSE: Tactic: 3080191 time 0.050112 [TensorRT] VERBOSE: Tactic: 3342335 time 0.0568 [TensorRT] VERBOSE: Tactic: 3407871 time 0.0712 [TensorRT] VERBOSE: Tactic: 3538943 time 0.076768 [TensorRT] VERBOSE: Tactic: 3670015 time 0.052416 [TensorRT] VERBOSE: Tactic: 3932159 time 0.048736 [TensorRT] VERBOSE: Tactic: 3997695 time 0.073472 [TensorRT] VERBOSE: Tactic: 4063231 time 0.072704 [TensorRT] VERBOSE: Tactic: 4194303 time 0.061344 [TensorRT] VERBOSE: Tactic: 4259839 time 0.093984 [TensorRT] VERBOSE: Tactic: 4325375 time 0.112064 [TensorRT] VERBOSE: Tactic: 4521983 time 0.10768 [TensorRT] VERBOSE: Tactic: 4587519 time 0.069088 [TensorRT] VERBOSE: Tactic: 4653055 time 0.092352 [TensorRT] VERBOSE: Tactic: 4915199 time 0.062784 [TensorRT] VERBOSE: Tactic: 4980735 time 0.109376 [TensorRT] VERBOSE: Tactic: 5177343 time 0.081696 [TensorRT] VERBOSE: Tactic: 5242879 time 0.068064 [TensorRT] VERBOSE: Tactic: 5373951 time 0.087616 [TensorRT] VERBOSE: Tactic: 5439487 time 0.089792 [TensorRT] VERBOSE: Tactic: 5570559 time 0.050848 [TensorRT] VERBOSE: Tactic: 5636095 time 0.072864 [TensorRT] VERBOSE: Tactic: 5701631 time 0.063552 [TensorRT] VERBOSE: Tactic: 5767167 time 0.191456 [TensorRT] VERBOSE: Tactic: 5832703 time 0.063904 [TensorRT] VERBOSE: Tactic: 5898239 time 0.079808 [TensorRT] VERBOSE: Tactic: 6029311 time 0.064768 [TensorRT] VERBOSE: Tactic: 6225919 time 0.07328 [TensorRT] VERBOSE: Tactic: 6291455 time 0.081824 [TensorRT] VERBOSE: Tactic: 6422527 time 0.049152 [TensorRT] VERBOSE: Tactic: 6750207 time 0.0896 [TensorRT] VERBOSE: Tactic: 6815743 time 0.073856 [TensorRT] VERBOSE: Tactic: 6946815 time 0.082496 [TensorRT] VERBOSE: Tactic: 7012351 time 0.103808 [TensorRT] VERBOSE: Tactic: 7077887 time 0.067072 [TensorRT] VERBOSE: Tactic: 7143423 time 0.11248 [TensorRT] VERBOSE: Tactic: 7208959 time 0.065216 [TensorRT] VERBOSE: Tactic: 7340031 time 0.0784 [TensorRT] VERBOSE: Tactic: 7405567 time 0.065952 [TensorRT] VERBOSE: Tactic: 7536639 time 0.08608 [TensorRT] VERBOSE: Tactic: 7602175 time 0.066816 [TensorRT] VERBOSE: Tactic: 7733247 time 0.064448 [TensorRT] VERBOSE: Tactic: 7798783 time 0.06944 [TensorRT] VERBOSE: Tactic: 8191999 time 0.098016 [TensorRT] VERBOSE: Tactic: 8257535 time 0.059168 [TensorRT] VERBOSE: Tactic: 8323071 time 0.078144 [TensorRT] VERBOSE: Tactic: 8650751 time 0.06784 [TensorRT] VERBOSE: Tactic: 8716287 time 0.079424 [TensorRT] VERBOSE: Tactic: 9109503 time 0.080288 [TensorRT] VERBOSE: Tactic: 9568255 time 0.064992 [TensorRT] VERBOSE: Tactic: 9895935 time 0.060672 [TensorRT] VERBOSE: Tactic: 10223615 time 0.068096 [TensorRT] VERBOSE: Tactic: 10354687 time 0.111776 [TensorRT] VERBOSE: Tactic: 10551295 time 0.071968 [TensorRT] VERBOSE: Tactic: 10747903 time 0.064384 [TensorRT] VERBOSE: Tactic: 10944511 time 0.110592 [TensorRT] VERBOSE: Fastest Tactic: 655359 Time: 0.047136 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.023552 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.024576 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.023808 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.02624 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.024896 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.025472 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.026048 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.02544 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.024736 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.025152 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.0248 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.023616 [TensorRT] VERBOSE: Fastest Tactic: 66319348402778770 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 66319348402778770 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061664 [TensorRT] VERBOSE: Tactic: 256 time 0.062176 [TensorRT] VERBOSE: Tactic: 512 time 0.062496 [TensorRT] VERBOSE: Tactic: -32 time 0.093184 [TensorRT] VERBOSE: Tactic: -64 time 0.078048 [TensorRT] VERBOSE: Tactic: -128 time 0.071712 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.061664 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.03712 [TensorRT] VERBOSE: Tactic: 1 time 0.03584 [TensorRT] VERBOSE: Tactic: 2 time 0.031168 [TensorRT] VERBOSE: Tactic: 3 time 0.035936 [TensorRT] VERBOSE: Tactic: 4 time 0.032 [TensorRT] VERBOSE: Tactic: 5 time 0.03248 [TensorRT] VERBOSE: Tactic: 6 time 0.037888 [TensorRT] VERBOSE: Tactic: 7 time 0.03312 [TensorRT] VERBOSE: Tactic: 8 time 0.032448 [TensorRT] VERBOSE: Tactic: 9 time 0.033216 [TensorRT] VERBOSE: Tactic: 28 time 0.036448 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.031168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061056 [TensorRT] VERBOSE: Tactic: 256 time 0.061184 [TensorRT] VERBOSE: Tactic: 512 time 0.062464 [TensorRT] VERBOSE: Tactic: -32 time 0.091136 [TensorRT] VERBOSE: Tactic: -64 time 0.078848 [TensorRT] VERBOSE: Tactic: -128 time 0.073824 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.061056 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.048992 [TensorRT] VERBOSE: Tactic: 25 time 0.049248 [TensorRT] VERBOSE: Tactic: 26 time 0.050688 [TensorRT] VERBOSE: Tactic: 27 time 0.052096 [TensorRT] VERBOSE: Tactic: 31 time 0.051616 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.048992 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] WARNING: No implementation of layer LeakyRelu_32 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.07168 [TensorRT] VERBOSE: Tactic: 0 time 0.177056 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.07168 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.131072 [TensorRT] VERBOSE: Tactic: 0 time 0.091136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.091136 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.03472 [TensorRT] VERBOSE: Tactic: 0 time 0.01936 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01936 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04096 [TensorRT] VERBOSE: Tactic: 0 time 0.09264 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04096 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050912 [TensorRT] VERBOSE: Tactic: 0 time 0.029344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029344 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0512 [TensorRT] VERBOSE: Tactic: 0 time 0.06192 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.0512 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.068768 [TensorRT] VERBOSE: Tactic: 0 time 0.049152 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.049152 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.041664 [TensorRT] VERBOSE: Tactic: 0 time 0.019488 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019488 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051552 [TensorRT] VERBOSE: Tactic: 0 time 0.042816 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042816 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04976 [TensorRT] VERBOSE: Tactic: 0 time 0.08192 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04976 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050304 [TensorRT] VERBOSE: Tactic: 0 time 0.012864 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012864 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048832 [TensorRT] VERBOSE: Tactic: 0 time 0.06096 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048832 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.066432 [TensorRT] VERBOSE: Tactic: 0 time 0.047648 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047648 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05184 [TensorRT] VERBOSE: Tactic: 0 time 0.042368 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042368 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0504 [TensorRT] VERBOSE: Tactic: 0 time 0.078368 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.0504 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049536 [TensorRT] VERBOSE: Tactic: 0 time 0.018112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.018112 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.045216 [TensorRT] VERBOSE: Tactic: 0 time 0.008256 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.008256 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049376 [TensorRT] VERBOSE: Tactic: 0 time 0.03072 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.03072 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047648 [TensorRT] VERBOSE: Tactic: 0 time 0.013312 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013312 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.136928 [TensorRT] VERBOSE: Tactic: 655359 time 0.141632 [TensorRT] VERBOSE: Tactic: 786431 time 0.11728 [TensorRT] VERBOSE: Tactic: 851967 time 0.142336 [TensorRT] VERBOSE: Tactic: 1179647 time 0.121408 [TensorRT] VERBOSE: Tactic: 1310719 time 0.168064 [TensorRT] VERBOSE: Tactic: 1376255 time 0.13952 [TensorRT] VERBOSE: Tactic: 1441791 time 0.147232 [TensorRT] VERBOSE: Tactic: 1507327 time 0.128 [TensorRT] VERBOSE: Tactic: 1638399 time 0.120672 [TensorRT] VERBOSE: Tactic: 1835007 time 0.121248 [TensorRT] VERBOSE: Tactic: 1900543 time 0.149184 [TensorRT] VERBOSE: Tactic: 2097151 time 0.123904 [TensorRT] VERBOSE: Tactic: 2162687 time 0.128128 [TensorRT] VERBOSE: Tactic: 2293759 time 0.139936 [TensorRT] VERBOSE: Tactic: 2359295 time 0.121888 [TensorRT] VERBOSE: Tactic: 2686975 time 0.127904 [TensorRT] VERBOSE: Tactic: 3080191 time 0.130656 [TensorRT] VERBOSE: Tactic: 3342335 time 0.132064 [TensorRT] VERBOSE: Tactic: 3407871 time 0.124928 [TensorRT] VERBOSE: Tactic: 3538943 time 0.11936 [TensorRT] VERBOSE: Tactic: 3670015 time 0.176032 [TensorRT] VERBOSE: Tactic: 3932159 time 0.13728 [TensorRT] VERBOSE: Tactic: 3997695 time 0.120992 [TensorRT] VERBOSE: Tactic: 4063231 time 0.138656 [TensorRT] VERBOSE: Tactic: 4194303 time 0.114688 [TensorRT] VERBOSE: Tactic: 4259839 time 0.117056 [TensorRT] VERBOSE: Tactic: 4325375 time 0.116704 [TensorRT] VERBOSE: Tactic: 4521983 time 0.1352 [TensorRT] VERBOSE: Tactic: 4587519 time 0.113664 [TensorRT] VERBOSE: Tactic: 4653055 time 0.115072 [TensorRT] VERBOSE: Tactic: 4915199 time 0.114368 [TensorRT] VERBOSE: Tactic: 4980735 time 0.120384 [TensorRT] VERBOSE: Tactic: 5177343 time 0.12784 [TensorRT] VERBOSE: Tactic: 5242879 time 0.121632 [TensorRT] VERBOSE: Tactic: 5373951 time 0.137792 [TensorRT] VERBOSE: Tactic: 5439487 time 0.14928 [TensorRT] VERBOSE: Tactic: 5570559 time 0.132512 [TensorRT] VERBOSE: Tactic: 5636095 time 0.138624 [TensorRT] VERBOSE: Tactic: 5701631 time 0.123456 [TensorRT] VERBOSE: Tactic: 5767167 time 0.261824 [TensorRT] VERBOSE: Tactic: 5832703 time 0.12288 [TensorRT] VERBOSE: Tactic: 5898239 time 0.120768 [TensorRT] VERBOSE: Tactic: 6029311 time 0.121408 [TensorRT] VERBOSE: Tactic: 6225919 time 0.118272 [TensorRT] VERBOSE: Tactic: 6291455 time 0.123136 [TensorRT] VERBOSE: Tactic: 6422527 time 0.1304 [TensorRT] VERBOSE: Tactic: 6750207 time 0.126528 [TensorRT] VERBOSE: Tactic: 6815743 time 0.136 [TensorRT] VERBOSE: Tactic: 6946815 time 0.146336 [TensorRT] VERBOSE: Tactic: 7012351 time 0.121664 [TensorRT] VERBOSE: Tactic: 7077887 time 0.118464 [TensorRT] VERBOSE: Tactic: 7143423 time 0.149184 [TensorRT] VERBOSE: Tactic: 7208959 time 0.1232 [TensorRT] VERBOSE: Tactic: 7340031 time 0.121856 [TensorRT] VERBOSE: Tactic: 7405567 time 0.12288 [TensorRT] VERBOSE: Tactic: 7536639 time 0.138176 [TensorRT] VERBOSE: Tactic: 7602175 time 0.115488 [TensorRT] VERBOSE: Tactic: 7733247 time 0.118816 [TensorRT] VERBOSE: Tactic: 7798783 time 0.119392 [TensorRT] VERBOSE: Tactic: 8191999 time 0.135168 [TensorRT] VERBOSE: Tactic: 8257535 time 0.120544 [TensorRT] VERBOSE: Tactic: 8323071 time 0.122272 [TensorRT] VERBOSE: Tactic: 8650751 time 0.124832 [TensorRT] VERBOSE: Tactic: 8716287 time 0.136672 [TensorRT] VERBOSE: Tactic: 9109503 time 0.127616 [TensorRT] VERBOSE: Tactic: 9568255 time 0.114752 [TensorRT] VERBOSE: Tactic: 9895935 time 0.11296 [TensorRT] VERBOSE: Tactic: 10223615 time 0.125952 [TensorRT] VERBOSE: Tactic: 10354687 time 0.114464 [TensorRT] VERBOSE: Tactic: 10551295 time 0.126752 [TensorRT] VERBOSE: Tactic: 10747903 time 0.117792 [TensorRT] VERBOSE: Tactic: 10944511 time 0.12368 [TensorRT] VERBOSE: Fastest Tactic: 9895935 Time: 0.11296 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.063424 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.066784 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.041984 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.065504 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.04096 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.03984 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.040032 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.04768 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.042944 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.03984 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.072448 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 802816, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 2506752, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.072352 [TensorRT] VERBOSE: Fastest Tactic: 57 Time: 0.072352 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.033376 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.030144 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.023232 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.021376 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.02864 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.022752 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.021824 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.02208 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.028672 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.034208 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.021344 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.032768 [TensorRT] VERBOSE: Fastest Tactic: -3908975881807046106 Time: 0.021344 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3908975881807046106 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.034528 [TensorRT] VERBOSE: Tactic: 655359 time 0.03072 [TensorRT] VERBOSE: Tactic: 786431 time 0.033536 [TensorRT] VERBOSE: Tactic: 851967 time 0.050368 [TensorRT] VERBOSE: Tactic: 1179647 time 0.035168 [TensorRT] VERBOSE: Tactic: 1310719 time 0.034528 [TensorRT] VERBOSE: Tactic: 1376255 time 0.036 [TensorRT] VERBOSE: Tactic: 1441791 time 0.038336 [TensorRT] VERBOSE: Tactic: 1507327 time 0.033792 [TensorRT] VERBOSE: Tactic: 1638399 time 0.03504 [TensorRT] VERBOSE: Tactic: 1835007 time 0.032672 [TensorRT] VERBOSE: Tactic: 1900543 time 0.033792 [TensorRT] VERBOSE: Tactic: 2162687 time 0.039072 [TensorRT] VERBOSE: Tactic: 2293759 time 0.036096 [TensorRT] VERBOSE: Tactic: 2359295 time 0.0384 [TensorRT] VERBOSE: Tactic: 2686975 time 0.037888 [TensorRT] VERBOSE: Tactic: 3080191 time 0.030944 [TensorRT] VERBOSE: Tactic: 3342335 time 0.03536 [TensorRT] VERBOSE: Tactic: 3407871 time 0.032096 [TensorRT] VERBOSE: Tactic: 3538943 time 0.032032 [TensorRT] VERBOSE: Tactic: 3670015 time 0.038304 [TensorRT] VERBOSE: Tactic: 3932159 time 0.031232 [TensorRT] VERBOSE: Tactic: 3997695 time 0.033792 [TensorRT] VERBOSE: Tactic: 4063231 time 0.047136 [TensorRT] VERBOSE: Tactic: 4194303 time 0.031776 [TensorRT] VERBOSE: Tactic: 4325375 time 0.038976 [TensorRT] VERBOSE: Tactic: 4521983 time 0.039232 [TensorRT] VERBOSE: Tactic: 4587519 time 0.032032 [TensorRT] VERBOSE: Tactic: 4653055 time 0.037952 [TensorRT] VERBOSE: Tactic: 4915199 time 0.031968 [TensorRT] VERBOSE: Tactic: 4980735 time 0.037856 [TensorRT] VERBOSE: Tactic: 5177343 time 0.034784 [TensorRT] VERBOSE: Tactic: 5242879 time 0.031584 [TensorRT] VERBOSE: Tactic: 5373951 time 0.036864 [TensorRT] VERBOSE: Tactic: 5439487 time 0.0376 [TensorRT] VERBOSE: Tactic: 5570559 time 0.032064 [TensorRT] VERBOSE: Tactic: 5636095 time 0.046912 [TensorRT] VERBOSE: Tactic: 5701631 time 0.035136 [TensorRT] VERBOSE: Tactic: 5767167 time 0.04992 [TensorRT] VERBOSE: Tactic: 5832703 time 0.03216 [TensorRT] VERBOSE: Tactic: 5898239 time 0.034208 [TensorRT] VERBOSE: Tactic: 6029311 time 0.033312 [TensorRT] VERBOSE: Tactic: 6225919 time 0.0328 [TensorRT] VERBOSE: Tactic: 6291455 time 0.034688 [TensorRT] VERBOSE: Tactic: 6422527 time 0.030496 [TensorRT] VERBOSE: Tactic: 6750207 time 0.033984 [TensorRT] VERBOSE: Tactic: 6815743 time 0.034528 [TensorRT] VERBOSE: Tactic: 6946815 time 0.036416 [TensorRT] VERBOSE: Tactic: 7077887 time 0.032064 [TensorRT] VERBOSE: Tactic: 7143423 time 0.036832 [TensorRT] VERBOSE: Tactic: 7208959 time 0.033184 [TensorRT] VERBOSE: Tactic: 7340031 time 0.034816 [TensorRT] VERBOSE: Tactic: 7405567 time 0.032896 [TensorRT] VERBOSE: Tactic: 7536639 time 0.034816 [TensorRT] VERBOSE: Tactic: 7602175 time 0.03216 [TensorRT] VERBOSE: Tactic: 7733247 time 0.031648 [TensorRT] VERBOSE: Tactic: 7798783 time 0.033696 [TensorRT] VERBOSE: Tactic: 8191999 time 0.034176 [TensorRT] VERBOSE: Tactic: 8257535 time 0.032576 [TensorRT] VERBOSE: Tactic: 8323071 time 0.032672 [TensorRT] VERBOSE: Tactic: 8650751 time 0.033312 [TensorRT] VERBOSE: Tactic: 8716287 time 0.035552 [TensorRT] VERBOSE: Tactic: 9568255 time 0.031968 [TensorRT] VERBOSE: Tactic: 9895935 time 0.032128 [TensorRT] VERBOSE: Tactic: 10223615 time 0.03728 [TensorRT] VERBOSE: Tactic: 10354687 time 0.041504 [TensorRT] VERBOSE: Tactic: 10551295 time 0.033792 [TensorRT] VERBOSE: Tactic: 10747903 time 0.032768 [TensorRT] VERBOSE: Tactic: 10944511 time 0.037408 [TensorRT] VERBOSE: Fastest Tactic: 6422527 Time: 0.030496 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.015936 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.025408 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.016096 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.016192 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.020384 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.025088 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.01616 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.015968 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.025408 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.01568 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.019552 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.019648 [TensorRT] VERBOSE: Fastest Tactic: -6282183216199417697 Time: 0.01568 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6282183216199417697 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.024416 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.019968 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.016384 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.014688 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.016288 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.015392 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.019584 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.019456 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.023872 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.015616 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.015296 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.025504 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.014688 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.021184 [TensorRT] VERBOSE: Tactic: 655359 time 0.026496 [TensorRT] VERBOSE: Tactic: 786431 time 0.025632 [TensorRT] VERBOSE: Tactic: 851967 time 0.048128 [TensorRT] VERBOSE: Tactic: 1179647 time 0.030528 [TensorRT] VERBOSE: Tactic: 1310719 time 0.024256 [TensorRT] VERBOSE: Tactic: 1376255 time 0.023904 [TensorRT] VERBOSE: Tactic: 1441791 time 0.033344 [TensorRT] VERBOSE: Tactic: 1507327 time 0.033312 [TensorRT] VERBOSE: Tactic: 1638399 time 0.031776 [TensorRT] VERBOSE: Tactic: 1835007 time 0.026176 [TensorRT] VERBOSE: Tactic: 1900543 time 0.030144 [TensorRT] VERBOSE: Tactic: 2162687 time 0.0256 [TensorRT] VERBOSE: Tactic: 2293759 time 0.025632 [TensorRT] VERBOSE: Tactic: 2359295 time 0.026112 [TensorRT] VERBOSE: Tactic: 2686975 time 0.025632 [TensorRT] VERBOSE: Tactic: 3080191 time 0.02896 [TensorRT] VERBOSE: Tactic: 3342335 time 0.033696 [TensorRT] VERBOSE: Tactic: 3407871 time 0.025408 [TensorRT] VERBOSE: Tactic: 3538943 time 0.027296 [TensorRT] VERBOSE: Tactic: 3670015 time 0.029632 [TensorRT] VERBOSE: Tactic: 3932159 time 0.028768 [TensorRT] VERBOSE: Tactic: 3997695 time 0.027264 [TensorRT] VERBOSE: Tactic: 4063231 time 0.045664 [TensorRT] VERBOSE: Tactic: 4194303 time 0.02416 [TensorRT] VERBOSE: Tactic: 4325375 time 0.037504 [TensorRT] VERBOSE: Tactic: 4521983 time 0.035776 [TensorRT] VERBOSE: Tactic: 4587519 time 0.025632 [TensorRT] VERBOSE: Tactic: 4653055 time 0.034816 [TensorRT] VERBOSE: Tactic: 4915199 time 0.024256 [TensorRT] VERBOSE: Tactic: 4980735 time 0.036064 [TensorRT] VERBOSE: Tactic: 5177343 time 0.031008 [TensorRT] VERBOSE: Tactic: 5242879 time 0.02416 [TensorRT] VERBOSE: Tactic: 5373951 time 0.031904 [TensorRT] VERBOSE: Tactic: 5439487 time 0.029728 [TensorRT] VERBOSE: Tactic: 5570559 time 0.03008 [TensorRT] VERBOSE: Tactic: 5636095 time 0.04608 [TensorRT] VERBOSE: Tactic: 5701631 time 0.024256 [TensorRT] VERBOSE: Tactic: 5767167 time 0.053056 [TensorRT] VERBOSE: Tactic: 5832703 time 0.022816 [TensorRT] VERBOSE: Tactic: 5898239 time 0.030048 [TensorRT] VERBOSE: Tactic: 6029311 time 0.022944 [TensorRT] VERBOSE: Tactic: 6225919 time 0.026208 [TensorRT] VERBOSE: Tactic: 6291455 time 0.030752 [TensorRT] VERBOSE: Tactic: 6422527 time 0.028928 [TensorRT] VERBOSE: Tactic: 6750207 time 0.030112 [TensorRT] VERBOSE: Tactic: 6815743 time 0.024544 [TensorRT] VERBOSE: Tactic: 6946815 time 0.027584 [TensorRT] VERBOSE: Tactic: 7077887 time 0.024032 [TensorRT] VERBOSE: Tactic: 7143423 time 0.033504 [TensorRT] VERBOSE: Tactic: 7208959 time 0.02304 [TensorRT] VERBOSE: Tactic: 7340031 time 0.030112 [TensorRT] VERBOSE: Tactic: 7405567 time 0.025664 [TensorRT] VERBOSE: Tactic: 7536639 time 0.028192 [TensorRT] VERBOSE: Tactic: 7602175 time 0.024416 [TensorRT] VERBOSE: Tactic: 7733247 time 0.02288 [TensorRT] VERBOSE: Tactic: 7798783 time 0.025632 [TensorRT] VERBOSE: Tactic: 8191999 time 0.032576 [TensorRT] VERBOSE: Tactic: 8257535 time 0.022592 [TensorRT] VERBOSE: Tactic: 8323071 time 0.027392 [TensorRT] VERBOSE: Tactic: 8650751 time 0.023872 [TensorRT] VERBOSE: Tactic: 8716287 time 0.026624 [TensorRT] VERBOSE: Tactic: 9568255 time 0.02384 [TensorRT] VERBOSE: Tactic: 9895935 time 0.023712 [TensorRT] VERBOSE: Tactic: 10223615 time 0.02528 [TensorRT] VERBOSE: Tactic: 10354687 time 0.038912 [TensorRT] VERBOSE: Tactic: 10551295 time 0.026208 [TensorRT] VERBOSE: Tactic: 10747903 time 0.02384 [TensorRT] VERBOSE: Tactic: 10944511 time 0.036608 [TensorRT] VERBOSE: Fastest Tactic: 589823 Time: 0.021184 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.017664 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.01984 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.017728 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.01248 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.019328 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.01296 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.012672 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.0128 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.013312 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.013024 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.019296 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.017088 [TensorRT] VERBOSE: Fastest Tactic: 7039764449991095921 Time: 0.01248 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7039764449991095921 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040512 [TensorRT] VERBOSE: Tactic: 0 time 0.09216 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040512 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051136 [TensorRT] VERBOSE: Tactic: 0 time 0.09088 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.051136 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04656 [TensorRT] VERBOSE: Tactic: 0 time 0.09728 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04656 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.034496 [TensorRT] VERBOSE: Tactic: 256 time 0.032864 [TensorRT] VERBOSE: Tactic: 512 time 0.034752 [TensorRT] VERBOSE: Tactic: -32 time 0.051008 [TensorRT] VERBOSE: Tactic: -64 time 0.046592 [TensorRT] VERBOSE: Tactic: -128 time 0.04208 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.032864 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.02048 [TensorRT] VERBOSE: Tactic: 1 time 0.020032 [TensorRT] VERBOSE: Tactic: 2 time 0.0192 [TensorRT] VERBOSE: Tactic: 3 time 0.01984 [TensorRT] VERBOSE: Tactic: 4 time 0.018816 [TensorRT] VERBOSE: Tactic: 5 time 0.017728 [TensorRT] VERBOSE: Tactic: 6 time 0.021248 [TensorRT] VERBOSE: Tactic: 7 time 0.018656 [TensorRT] VERBOSE: Tactic: 8 time 0.01888 [TensorRT] VERBOSE: Tactic: 9 time 0.018432 [TensorRT] VERBOSE: Tactic: 28 time 0.019936 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.017728 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033344 [TensorRT] VERBOSE: Tactic: 256 time 0.033376 [TensorRT] VERBOSE: Tactic: 512 time 0.034848 [TensorRT] VERBOSE: Tactic: -32 time 0.050656 [TensorRT] VERBOSE: Tactic: -64 time 0.047744 [TensorRT] VERBOSE: Tactic: -128 time 0.040704 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.033344 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.025952 [TensorRT] VERBOSE: Tactic: 25 time 0.026624 [TensorRT] VERBOSE: Tactic: 26 time 0.027648 [TensorRT] VERBOSE: Tactic: 27 time 0.023104 [TensorRT] VERBOSE: Tactic: 31 time 0.027136 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.023104 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.041856 [TensorRT] VERBOSE: Tactic: 256 time 0.036864 [TensorRT] VERBOSE: Tactic: 512 time 0.03712 [TensorRT] VERBOSE: Tactic: -32 time 0.049536 [TensorRT] VERBOSE: Tactic: -64 time 0.047104 [TensorRT] VERBOSE: Tactic: -128 time 0.047616 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036864 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013216 [TensorRT] VERBOSE: Tactic: 1 time 0.011392 [TensorRT] VERBOSE: Tactic: 2 time 0.012832 [TensorRT] VERBOSE: Tactic: 3 time 0.010976 [TensorRT] VERBOSE: Tactic: 4 time 0.012288 [TensorRT] VERBOSE: Tactic: 5 time 0.012288 [TensorRT] VERBOSE: Tactic: 6 time 0.01008 [TensorRT] VERBOSE: Tactic: 7 time 0.011456 [TensorRT] VERBOSE: Tactic: 8 time 0.014144 [TensorRT] VERBOSE: Tactic: 9 time 0.01552 [TensorRT] VERBOSE: Tactic: 10 time 0.02128 [TensorRT] VERBOSE: Tactic: 11 time 0.016544 [TensorRT] VERBOSE: Tactic: 12 time 0.016704 [TensorRT] VERBOSE: Tactic: 13 time 0.013984 [TensorRT] VERBOSE: Tactic: 14 time 0.01488 [TensorRT] VERBOSE: Tactic: 15 time 0.015296 [TensorRT] VERBOSE: Tactic: 16 time 0.013792 [TensorRT] VERBOSE: Tactic: 17 time 0.011904 [TensorRT] VERBOSE: Tactic: 18 time 0.014176 [TensorRT] VERBOSE: Tactic: 19 time 0.016192 [TensorRT] VERBOSE: Tactic: 20 time 0.03376 [TensorRT] VERBOSE: Tactic: 21 time 0.02432 [TensorRT] VERBOSE: Tactic: 22 time 0.017888 [TensorRT] VERBOSE: Tactic: 23 time 0.014944 [TensorRT] VERBOSE: Tactic: 28 time 0.017472 [TensorRT] VERBOSE: Tactic: 29 time 0.022592 [TensorRT] VERBOSE: Tactic: 30 time 0.032 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.01008 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.043008 [TensorRT] VERBOSE: Tactic: 256 time 0.036416 [TensorRT] VERBOSE: Tactic: 512 time 0.037216 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036416 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.010912 [TensorRT] VERBOSE: Tactic: 11 time 0.011264 [TensorRT] VERBOSE: Tactic: 12 time 0.012 [TensorRT] VERBOSE: Tactic: 13 time 0.012032 [TensorRT] VERBOSE: Tactic: 14 time 0.013312 [TensorRT] VERBOSE: Tactic: 15 time 0.014752 [TensorRT] VERBOSE: Tactic: 16 time 0.016416 [TensorRT] VERBOSE: Tactic: 17 time 0.014912 [TensorRT] VERBOSE: Tactic: 18 time 0.019872 [TensorRT] VERBOSE: Tactic: 19 time 0.022176 [TensorRT] VERBOSE: Tactic: 20 time 0.011296 [TensorRT] VERBOSE: Tactic: 21 time 0.012352 [TensorRT] VERBOSE: Tactic: 22 time 0.010624 [TensorRT] VERBOSE: Tactic: 23 time 0.013312 [TensorRT] VERBOSE: Tactic: 24 time 0.013952 [TensorRT] VERBOSE: Tactic: 25 time 0.01184 [TensorRT] VERBOSE: Tactic: 26 time 0.010976 [TensorRT] VERBOSE: Tactic: 27 time 0.01024 [TensorRT] VERBOSE: Tactic: 29 time 0.046848 [TensorRT] VERBOSE: Tactic: 30 time 0.0272 [TensorRT] VERBOSE: Tactic: 31 time 0.0184 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.01024 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.2608 [TensorRT] VERBOSE: Tactic: 720895 time 0.265216 [TensorRT] VERBOSE: Tactic: 983039 time 0.227744 [TensorRT] VERBOSE: Tactic: 1048575 time 0.249824 [TensorRT] VERBOSE: Tactic: 1703935 time 0.230752 [TensorRT] VERBOSE: Tactic: 1769471 time 0.315904 [TensorRT] VERBOSE: Tactic: 1966079 time 0.286624 [TensorRT] VERBOSE: Tactic: 2031615 time 0.320512 [TensorRT] VERBOSE: Tactic: 2228223 time 0.26448 [TensorRT] VERBOSE: Tactic: 2424831 time 0.26272 [TensorRT] VERBOSE: Tactic: 2621439 time 0.268224 [TensorRT] VERBOSE: Tactic: 2752511 time 0.251904 [TensorRT] VERBOSE: Tactic: 2818047 time 0.43904 [TensorRT] VERBOSE: Tactic: 2883583 time 0.48688 [TensorRT] VERBOSE: Tactic: 3014655 time 0.224288 [TensorRT] VERBOSE: Tactic: 3145727 time 0.23264 [TensorRT] VERBOSE: Tactic: 3473407 time 0.42784 [TensorRT] VERBOSE: Tactic: 3604479 time 0.220064 [TensorRT] VERBOSE: Tactic: 3735551 time 0.42368 [TensorRT] VERBOSE: Tactic: 4390911 time 0.280352 [TensorRT] VERBOSE: Tactic: 5046271 time 0.226464 [TensorRT] VERBOSE: Tactic: 5963775 time 0.279808 [TensorRT] VERBOSE: Tactic: 6160383 time 0.259776 [TensorRT] VERBOSE: Tactic: 6488063 time 0.239296 [TensorRT] VERBOSE: Tactic: 6881279 time 0.266336 [TensorRT] VERBOSE: Tactic: 7274495 time 0.26512 [TensorRT] VERBOSE: Tactic: 7864319 time 0.245952 [TensorRT] VERBOSE: Tactic: 7995391 time 0.249472 [TensorRT] VERBOSE: Tactic: 8585215 time 0.270336 [TensorRT] VERBOSE: Tactic: 8847359 time 0.330112 [TensorRT] VERBOSE: Tactic: 8978431 time 0.276896 [TensorRT] VERBOSE: Tactic: 9043967 time 0.221824 [TensorRT] VERBOSE: Tactic: 9175039 time 0.222048 [TensorRT] VERBOSE: Tactic: 9502719 time 0.27792 [TensorRT] VERBOSE: Tactic: 9830399 time 0.397216 [TensorRT] VERBOSE: Tactic: 9961471 time 0.302304 [TensorRT] VERBOSE: Tactic: 10027007 time 0.230848 [TensorRT] VERBOSE: Tactic: 10092543 time 0.280096 [TensorRT] VERBOSE: Tactic: 10289151 time 0.292256 [TensorRT] VERBOSE: Tactic: 10485759 time 0.219968 [TensorRT] VERBOSE: Tactic: 10682367 time 0.246208 [TensorRT] VERBOSE: Tactic: 10813439 time 0.224608 [TensorRT] VERBOSE: Fastest Tactic: 10485759 Time: 0.219968 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.449344 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.12208 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.26384 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.44688 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.47744 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.236992 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.24064 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.251456 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.25088 [TensorRT] VERBOSE: Fastest Tactic: 2775507031594384867 Time: 0.12208 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.308192 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 7225344, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 18939904, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 410112, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 1920000, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.308192 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.12464 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.082464 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.075776 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.070752 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.080864 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.08016 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.077088 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.069952 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.123232 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.144352 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.069952 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.062624 [TensorRT] VERBOSE: Tactic: 720895 time 0.071392 [TensorRT] VERBOSE: Tactic: 983039 time 0.059232 [TensorRT] VERBOSE: Tactic: 1048575 time 0.070112 [TensorRT] VERBOSE: Tactic: 1703935 time 0.070592 [TensorRT] VERBOSE: Tactic: 1769471 time 0.091136 [TensorRT] VERBOSE: Tactic: 1966079 time 0.075008 [TensorRT] VERBOSE: Tactic: 2031615 time 0.075328 [TensorRT] VERBOSE: Tactic: 2228223 time 0.105792 [TensorRT] VERBOSE: Tactic: 2424831 time 0.129696 [TensorRT] VERBOSE: Tactic: 2621439 time 0.08176 [TensorRT] VERBOSE: Tactic: 2752511 time 0.073312 [TensorRT] VERBOSE: Tactic: 2818047 time 0.12064 [TensorRT] VERBOSE: Tactic: 2883583 time 0.125952 [TensorRT] VERBOSE: Tactic: 3014655 time 0.071136 [TensorRT] VERBOSE: Tactic: 3145727 time 0.06496 [TensorRT] VERBOSE: Tactic: 3473407 time 0.11472 [TensorRT] VERBOSE: Tactic: 3604479 time 0.058592 [TensorRT] VERBOSE: Tactic: 3735551 time 0.110656 [TensorRT] VERBOSE: Tactic: 4390911 time 0.075552 [TensorRT] VERBOSE: Tactic: 5046271 time 0.065248 [TensorRT] VERBOSE: Tactic: 5963775 time 0.066112 [TensorRT] VERBOSE: Tactic: 6160383 time 0.121856 [TensorRT] VERBOSE: Tactic: 6488063 time 0.072608 [TensorRT] VERBOSE: Tactic: 6881279 time 0.0672 [TensorRT] VERBOSE: Tactic: 7274495 time 0.071776 [TensorRT] VERBOSE: Tactic: 7864319 time 0.079264 [TensorRT] VERBOSE: Tactic: 7995391 time 0.065664 [TensorRT] VERBOSE: Tactic: 8585215 time 0.069856 [TensorRT] VERBOSE: Tactic: 8847359 time 0.076096 [TensorRT] VERBOSE: Tactic: 8978431 time 0.07664 [TensorRT] VERBOSE: Tactic: 9043967 time 0.066016 [TensorRT] VERBOSE: Tactic: 9175039 time 0.058016 [TensorRT] VERBOSE: Tactic: 9502719 time 0.07584 [TensorRT] VERBOSE: Tactic: 9830399 time 0.11248 [TensorRT] VERBOSE: Tactic: 9961471 time 0.111616 [TensorRT] VERBOSE: Tactic: 10027007 time 0.068128 [TensorRT] VERBOSE: Tactic: 10092543 time 0.075936 [TensorRT] VERBOSE: Tactic: 10289151 time 0.07488 [TensorRT] VERBOSE: Tactic: 10485759 time 0.06928 [TensorRT] VERBOSE: Tactic: 10682367 time 0.071968 [TensorRT] VERBOSE: Tactic: 10813439 time 0.05984 [TensorRT] VERBOSE: Fastest Tactic: 9175039 Time: 0.058016 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.068896 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.066144 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.07024 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.119744 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.071104 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.118848 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.068256 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.132352 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.069632 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.06736 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.066144 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9175039 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.070976 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.071872 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.067552 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.067552 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.065632 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.068896 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.118784 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.06832 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.120128 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.132064 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.065632 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.06432 [TensorRT] VERBOSE: Tactic: 720895 time 0.069568 [TensorRT] VERBOSE: Tactic: 983039 time 0.058432 [TensorRT] VERBOSE: Tactic: 1048575 time 0.070336 [TensorRT] VERBOSE: Tactic: 1703935 time 0.0696 [TensorRT] VERBOSE: Tactic: 1769471 time 0.086016 [TensorRT] VERBOSE: Tactic: 1966079 time 0.07136 [TensorRT] VERBOSE: Tactic: 2031615 time 0.074624 [TensorRT] VERBOSE: Tactic: 2228223 time 0.104192 [TensorRT] VERBOSE: Tactic: 2424831 time 0.130656 [TensorRT] VERBOSE: Tactic: 2621439 time 0.078272 [TensorRT] VERBOSE: Tactic: 2752511 time 0.073536 [TensorRT] VERBOSE: Tactic: 2818047 time 0.121728 [TensorRT] VERBOSE: Tactic: 2883583 time 0.119264 [TensorRT] VERBOSE: Tactic: 3014655 time 0.070944 [TensorRT] VERBOSE: Tactic: 3145727 time 0.064448 [TensorRT] VERBOSE: Tactic: 3473407 time 0.115424 [TensorRT] VERBOSE: Tactic: 3604479 time 0.059392 [TensorRT] VERBOSE: Tactic: 3735551 time 0.112064 [TensorRT] VERBOSE: Tactic: 4390911 time 0.066432 [TensorRT] VERBOSE: Tactic: 5046271 time 0.067584 [TensorRT] VERBOSE: Tactic: 5963775 time 0.06864 [TensorRT] VERBOSE: Tactic: 6160383 time 0.135008 [TensorRT] VERBOSE: Tactic: 6488063 time 0.067872 [TensorRT] VERBOSE: Tactic: 6881279 time 0.06816 [TensorRT] VERBOSE: Tactic: 7274495 time 0.06976 [TensorRT] VERBOSE: Tactic: 7864319 time 0.079392 [TensorRT] VERBOSE: Tactic: 7995391 time 0.060576 [TensorRT] VERBOSE: Tactic: 8585215 time 0.072096 [TensorRT] VERBOSE: Tactic: 8847359 time 0.07552 [TensorRT] VERBOSE: Tactic: 8978431 time 0.061824 [TensorRT] VERBOSE: Tactic: 9043967 time 0.066848 [TensorRT] VERBOSE: Tactic: 9175039 time 0.05856 [TensorRT] VERBOSE: Tactic: 9502719 time 0.062304 [TensorRT] VERBOSE: Tactic: 9830399 time 0.111424 [TensorRT] VERBOSE: Tactic: 9961471 time 0.118304 [TensorRT] VERBOSE: Tactic: 10027007 time 0.069536 [TensorRT] VERBOSE: Tactic: 10092543 time 0.06448 [TensorRT] VERBOSE: Tactic: 10289151 time 0.070656 [TensorRT] VERBOSE: Tactic: 10485759 time 0.069056 [TensorRT] VERBOSE: Tactic: 10682367 time 0.072256 [TensorRT] VERBOSE: Tactic: 10813439 time 0.057248 [TensorRT] VERBOSE: Fastest Tactic: 10813439 Time: 0.057248 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.0416 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.02592 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.044128 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.025088 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.024224 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.04224 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.044096 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.024544 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.025664 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.023808 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.042912 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.040384 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.023808 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704), Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.043104 [TensorRT] VERBOSE: Tactic: 256 time 0.041984 [TensorRT] VERBOSE: Tactic: 512 time 0.04336 [TensorRT] VERBOSE: Tactic: -32 time 0.063136 [TensorRT] VERBOSE: Tactic: -64 time 0.058368 [TensorRT] VERBOSE: Tactic: -128 time 0.05264 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.041984 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.024608 [TensorRT] VERBOSE: Tactic: 1 time 0.024576 [TensorRT] VERBOSE: Tactic: 2 time 0.02336 [TensorRT] VERBOSE: Tactic: 3 time 0.025216 [TensorRT] VERBOSE: Tactic: 4 time 0.025312 [TensorRT] VERBOSE: Tactic: 5 time 0.024832 [TensorRT] VERBOSE: Tactic: 6 time 0.0264 [TensorRT] VERBOSE: Tactic: 7 time 0.026176 [TensorRT] VERBOSE: Tactic: 8 time 0.024224 [TensorRT] VERBOSE: Tactic: 9 time 0.024576 [TensorRT] VERBOSE: Tactic: 28 time 0.024992 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.02336 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272), Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.043584 [TensorRT] VERBOSE: Tactic: 256 time 0.044128 [TensorRT] VERBOSE: Tactic: 512 time 0.042944 [TensorRT] VERBOSE: Tactic: -32 time 0.061984 [TensorRT] VERBOSE: Tactic: -64 time 0.058336 [TensorRT] VERBOSE: Tactic: -128 time 0.052512 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.042944 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.042528 [TensorRT] VERBOSE: Tactic: 25 time 0.042688 [TensorRT] VERBOSE: Tactic: 26 time 0.043584 [TensorRT] VERBOSE: Tactic: 27 time 0.044032 [TensorRT] VERBOSE: Tactic: 31 time 0.04256 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.042528 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176), Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.053024 [TensorRT] VERBOSE: Tactic: 256 time 0.05104 [TensorRT] VERBOSE: Tactic: 512 time 0.05232 [TensorRT] VERBOSE: Tactic: -32 time 0.078848 [TensorRT] VERBOSE: Tactic: -64 time 0.072352 [TensorRT] VERBOSE: Tactic: -128 time 0.071744 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.05104 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.017408 [TensorRT] VERBOSE: Tactic: 1 time 0.015232 [TensorRT] VERBOSE: Tactic: 2 time 0.0168 [TensorRT] VERBOSE: Tactic: 3 time 0.01504 [TensorRT] VERBOSE: Tactic: 4 time 0.018432 [TensorRT] VERBOSE: Tactic: 5 time 0.018752 [TensorRT] VERBOSE: Tactic: 6 time 0.016512 [TensorRT] VERBOSE: Tactic: 7 time 0.015712 [TensorRT] VERBOSE: Tactic: 8 time 0.022016 [TensorRT] VERBOSE: Tactic: 9 time 0.02576 [TensorRT] VERBOSE: Tactic: 10 time 0.025536 [TensorRT] VERBOSE: Tactic: 11 time 0.021504 [TensorRT] VERBOSE: Tactic: 12 time 0.02 [TensorRT] VERBOSE: Tactic: 13 time 0.020512 [TensorRT] VERBOSE: Tactic: 14 time 0.022624 [TensorRT] VERBOSE: Tactic: 15 time 0.020544 [TensorRT] VERBOSE: Tactic: 16 time 0.0208 [TensorRT] VERBOSE: Tactic: 17 time 0.022528 [TensorRT] VERBOSE: Tactic: 18 time 0.0248 [TensorRT] VERBOSE: Tactic: 19 time 0.023648 [TensorRT] VERBOSE: Tactic: 20 time 0.039136 [TensorRT] VERBOSE: Tactic: 21 time 0.029632 [TensorRT] VERBOSE: Tactic: 22 time 0.024576 [TensorRT] VERBOSE: Tactic: 23 time 0.021184 [TensorRT] VERBOSE: Tactic: 28 time 0.027328 [TensorRT] VERBOSE: Tactic: 29 time 0.027584 [TensorRT] VERBOSE: Tactic: 30 time 0.03872 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.01504 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272), Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.052864 [TensorRT] VERBOSE: Tactic: 256 time 0.050176 [TensorRT] VERBOSE: Tactic: 512 time 0.052352 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.050176 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.017824 [TensorRT] VERBOSE: Tactic: 11 time 0.017664 [TensorRT] VERBOSE: Tactic: 12 time 0.018752 [TensorRT] VERBOSE: Tactic: 13 time 0.02176 [TensorRT] VERBOSE: Tactic: 14 time 0.019488 [TensorRT] VERBOSE: Tactic: 15 time 0.022528 [TensorRT] VERBOSE: Tactic: 16 time 0.027968 [TensorRT] VERBOSE: Tactic: 17 time 0.024576 [TensorRT] VERBOSE: Tactic: 18 time 0.026624 [TensorRT] VERBOSE: Tactic: 19 time 0.037344 [TensorRT] VERBOSE: Tactic: 20 time 0.017248 [TensorRT] VERBOSE: Tactic: 21 time 0.016192 [TensorRT] VERBOSE: Tactic: 22 time 0.016288 [TensorRT] VERBOSE: Tactic: 23 time 0.021504 [TensorRT] VERBOSE: Tactic: 24 time 0.017408 [TensorRT] VERBOSE: Tactic: 25 time 0.017408 [TensorRT] VERBOSE: Tactic: 26 time 0.016928 [TensorRT] VERBOSE: Tactic: 27 time 0.02048 [TensorRT] VERBOSE: Tactic: 29 time 0.073216 [TensorRT] VERBOSE: Tactic: 30 time 0.040352 [TensorRT] VERBOSE: Tactic: 31 time 0.028064 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.016192 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040384 [TensorRT] VERBOSE: Tactic: 0 time 0.090496 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040384 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0512 [TensorRT] VERBOSE: Tactic: 0 time 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04944 [TensorRT] VERBOSE: Tactic: 0 time 0.060128 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04944 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.065856 [TensorRT] VERBOSE: Tactic: 0 time 0.04768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04768 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05328 [TensorRT] VERBOSE: Tactic: 0 time 0.043328 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.043328 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048352 [TensorRT] VERBOSE: Tactic: 0 time 0.078944 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048352 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05216 [TensorRT] VERBOSE: Tactic: 0 time 0.017344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017344 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049728 [TensorRT] VERBOSE: Tactic: 0 time 0.08944 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049728 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.045056 [TensorRT] VERBOSE: Tactic: 0 time 0.008064 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.008064 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05088 [TensorRT] VERBOSE: Tactic: 0 time 0.030592 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.030592 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047168 [TensorRT] VERBOSE: Tactic: 0 time 0.097856 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.047168 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047584 [TensorRT] VERBOSE: Tactic: 0 time 0.013632 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013632 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032896 [TensorRT] VERBOSE: Tactic: 256 time 0.033792 [TensorRT] VERBOSE: Tactic: 512 time 0.034752 [TensorRT] VERBOSE: Tactic: -32 time 0.049248 [TensorRT] VERBOSE: Tactic: -64 time 0.045408 [TensorRT] VERBOSE: Tactic: -128 time 0.039936 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.032896 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.020384 [TensorRT] VERBOSE: Tactic: 1 time 0.019072 [TensorRT] VERBOSE: Tactic: 2 time 0.018496 [TensorRT] VERBOSE: Tactic: 3 time 0.02016 [TensorRT] VERBOSE: Tactic: 4 time 0.019168 [TensorRT] VERBOSE: Tactic: 5 time 0.01792 [TensorRT] VERBOSE: Tactic: 6 time 0.01968 [TensorRT] VERBOSE: Tactic: 7 time 0.017696 [TensorRT] VERBOSE: Tactic: 8 time 0.01744 [TensorRT] VERBOSE: Tactic: 9 time 0.019008 [TensorRT] VERBOSE: Tactic: 28 time 0.019808 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.01744 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033792 [TensorRT] VERBOSE: Tactic: 256 time 0.032768 [TensorRT] VERBOSE: Tactic: 512 time 0.034112 [TensorRT] VERBOSE: Tactic: -32 time 0.051776 [TensorRT] VERBOSE: Tactic: -64 time 0.047136 [TensorRT] VERBOSE: Tactic: -128 time 0.040608 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.032768 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.02704 [TensorRT] VERBOSE: Tactic: 25 time 0.027104 [TensorRT] VERBOSE: Tactic: 26 time 0.026848 [TensorRT] VERBOSE: Tactic: 27 time 0.02432 [TensorRT] VERBOSE: Tactic: 31 time 0.026496 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.02432 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.042336 [TensorRT] VERBOSE: Tactic: 256 time 0.03648 [TensorRT] VERBOSE: Tactic: 512 time 0.037536 [TensorRT] VERBOSE: Tactic: -32 time 0.049152 [TensorRT] VERBOSE: Tactic: -64 time 0.053792 [TensorRT] VERBOSE: Tactic: -128 time 0.048096 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.03648 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013984 [TensorRT] VERBOSE: Tactic: 1 time 0.011936 [TensorRT] VERBOSE: Tactic: 2 time 0.012 [TensorRT] VERBOSE: Tactic: 3 time 0.010144 [TensorRT] VERBOSE: Tactic: 4 time 0.012288 [TensorRT] VERBOSE: Tactic: 5 time 0.01216 [TensorRT] VERBOSE: Tactic: 6 time 0.010176 [TensorRT] VERBOSE: Tactic: 7 time 0.011456 [TensorRT] VERBOSE: Tactic: 8 time 0.014464 [TensorRT] VERBOSE: Tactic: 9 time 0.016448 [TensorRT] VERBOSE: Tactic: 10 time 0.021248 [TensorRT] VERBOSE: Tactic: 11 time 0.017664 [TensorRT] VERBOSE: Tactic: 12 time 0.016256 [TensorRT] VERBOSE: Tactic: 13 time 0.014656 [TensorRT] VERBOSE: Tactic: 14 time 0.014592 [TensorRT] VERBOSE: Tactic: 15 time 0.014528 [TensorRT] VERBOSE: Tactic: 16 time 0.013408 [TensorRT] VERBOSE: Tactic: 17 time 0.013312 [TensorRT] VERBOSE: Tactic: 18 time 0.015744 [TensorRT] VERBOSE: Tactic: 19 time 0.015904 [TensorRT] VERBOSE: Tactic: 20 time 0.033216 [TensorRT] VERBOSE: Tactic: 21 time 0.023872 [TensorRT] VERBOSE: Tactic: 22 time 0.017856 [TensorRT] VERBOSE: Tactic: 23 time 0.014848 [TensorRT] VERBOSE: Tactic: 28 time 0.017728 [TensorRT] VERBOSE: Tactic: 29 time 0.022528 [TensorRT] VERBOSE: Tactic: 30 time 0.032736 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.010144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.043008 [TensorRT] VERBOSE: Tactic: 256 time 0.035904 [TensorRT] VERBOSE: Tactic: 512 time 0.037248 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.035904 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011104 [TensorRT] VERBOSE: Tactic: 11 time 0.010496 [TensorRT] VERBOSE: Tactic: 12 time 0.012224 [TensorRT] VERBOSE: Tactic: 13 time 0.011936 [TensorRT] VERBOSE: Tactic: 14 time 0.013568 [TensorRT] VERBOSE: Tactic: 15 time 0.01536 [TensorRT] VERBOSE: Tactic: 16 time 0.016064 [TensorRT] VERBOSE: Tactic: 17 time 0.015776 [TensorRT] VERBOSE: Tactic: 18 time 0.019328 [TensorRT] VERBOSE: Tactic: 19 time 0.022528 [TensorRT] VERBOSE: Tactic: 20 time 0.012576 [TensorRT] VERBOSE: Tactic: 21 time 0.011808 [TensorRT] VERBOSE: Tactic: 22 time 0.0104 [TensorRT] VERBOSE: Tactic: 23 time 0.011616 [TensorRT] VERBOSE: Tactic: 24 time 0.013952 [TensorRT] VERBOSE: Tactic: 25 time 0.012384 [TensorRT] VERBOSE: Tactic: 26 time 0.011072 [TensorRT] VERBOSE: Tactic: 27 time 0.01024 [TensorRT] VERBOSE: Tactic: 29 time 0.047584 [TensorRT] VERBOSE: Tactic: 30 time 0.026688 [TensorRT] VERBOSE: Tactic: 31 time 0.018752 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.01024 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_53 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_53 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_53 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_53 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_53 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704), Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.042688 [TensorRT] VERBOSE: Tactic: 256 time 0.044672 [TensorRT] VERBOSE: Tactic: 512 time 0.043616 [TensorRT] VERBOSE: Tactic: -32 time 0.065792 [TensorRT] VERBOSE: Tactic: -64 time 0.058656 [TensorRT] VERBOSE: Tactic: -128 time 0.051168 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.042688 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.02528 [TensorRT] VERBOSE: Tactic: 1 time 0.025312 [TensorRT] VERBOSE: Tactic: 2 time 0.0248 [TensorRT] VERBOSE: Tactic: 3 time 0.026912 [TensorRT] VERBOSE: Tactic: 4 time 0.025856 [TensorRT] VERBOSE: Tactic: 5 time 0.024544 [TensorRT] VERBOSE: Tactic: 6 time 0.02672 [TensorRT] VERBOSE: Tactic: 7 time 0.026336 [TensorRT] VERBOSE: Tactic: 8 time 0.024576 [TensorRT] VERBOSE: Tactic: 9 time 0.024608 [TensorRT] VERBOSE: Tactic: 28 time 0.024928 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.024544 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272), Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.04304 [TensorRT] VERBOSE: Tactic: 256 time 0.043328 [TensorRT] VERBOSE: Tactic: 512 time 0.044032 [TensorRT] VERBOSE: Tactic: -32 time 0.063488 [TensorRT] VERBOSE: Tactic: -64 time 0.059392 [TensorRT] VERBOSE: Tactic: -128 time 0.051904 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.04304 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.042336 [TensorRT] VERBOSE: Tactic: 25 time 0.045056 [TensorRT] VERBOSE: Tactic: 26 time 0.043616 [TensorRT] VERBOSE: Tactic: 27 time 0.044864 [TensorRT] VERBOSE: Tactic: 31 time 0.04 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.04 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176), Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0528 [TensorRT] VERBOSE: Tactic: 256 time 0.0512 [TensorRT] VERBOSE: Tactic: 512 time 0.052672 [TensorRT] VERBOSE: Tactic: -32 time 0.076512 [TensorRT] VERBOSE: Tactic: -64 time 0.083808 [TensorRT] VERBOSE: Tactic: -128 time 0.07168 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.0512 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.017728 [TensorRT] VERBOSE: Tactic: 1 time 0.01536 [TensorRT] VERBOSE: Tactic: 2 time 0.01696 [TensorRT] VERBOSE: Tactic: 3 time 0.015584 [TensorRT] VERBOSE: Tactic: 4 time 0.018112 [TensorRT] VERBOSE: Tactic: 5 time 0.017696 [TensorRT] VERBOSE: Tactic: 6 time 0.016384 [TensorRT] VERBOSE: Tactic: 7 time 0.016608 [TensorRT] VERBOSE: Tactic: 8 time 0.021888 [TensorRT] VERBOSE: Tactic: 9 time 0.0256 [TensorRT] VERBOSE: Tactic: 10 time 0.026144 [TensorRT] VERBOSE: Tactic: 11 time 0.021728 [TensorRT] VERBOSE: Tactic: 12 time 0.020192 [TensorRT] VERBOSE: Tactic: 13 time 0.019776 [TensorRT] VERBOSE: Tactic: 14 time 0.022016 [TensorRT] VERBOSE: Tactic: 15 time 0.020608 [TensorRT] VERBOSE: Tactic: 16 time 0.02016 [TensorRT] VERBOSE: Tactic: 17 time 0.022432 [TensorRT] VERBOSE: Tactic: 18 time 0.025376 [TensorRT] VERBOSE: Tactic: 19 time 0.023296 [TensorRT] VERBOSE: Tactic: 20 time 0.038912 [TensorRT] VERBOSE: Tactic: 21 time 0.029696 [TensorRT] VERBOSE: Tactic: 22 time 0.023072 [TensorRT] VERBOSE: Tactic: 23 time 0.02304 [TensorRT] VERBOSE: Tactic: 28 time 0.026624 [TensorRT] VERBOSE: Tactic: 29 time 0.026624 [TensorRT] VERBOSE: Tactic: 30 time 0.037856 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.01536 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272), Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.053248 [TensorRT] VERBOSE: Tactic: 256 time 0.050464 [TensorRT] VERBOSE: Tactic: 512 time 0.052672 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.050464 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.017376 [TensorRT] VERBOSE: Tactic: 11 time 0.01744 [TensorRT] VERBOSE: Tactic: 12 time 0.018912 [TensorRT] VERBOSE: Tactic: 13 time 0.020896 [TensorRT] VERBOSE: Tactic: 14 time 0.020416 [TensorRT] VERBOSE: Tactic: 15 time 0.023296 [TensorRT] VERBOSE: Tactic: 16 time 0.02816 [TensorRT] VERBOSE: Tactic: 17 time 0.024 [TensorRT] VERBOSE: Tactic: 18 time 0.0256 [TensorRT] VERBOSE: Tactic: 19 time 0.03648 [TensorRT] VERBOSE: Tactic: 20 time 0.016416 [TensorRT] VERBOSE: Tactic: 21 time 0.016384 [TensorRT] VERBOSE: Tactic: 22 time 0.015168 [TensorRT] VERBOSE: Tactic: 23 time 0.02048 [TensorRT] VERBOSE: Tactic: 24 time 0.018048 [TensorRT] VERBOSE: Tactic: 25 time 0.017856 [TensorRT] VERBOSE: Tactic: 26 time 0.016384 [TensorRT] VERBOSE: Tactic: 27 time 0.021408 [TensorRT] VERBOSE: Tactic: 29 time 0.07216 [TensorRT] VERBOSE: Tactic: 30 time 0.041856 [TensorRT] VERBOSE: Tactic: 31 time 0.028448 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.015168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.035584 [TensorRT] VERBOSE: Tactic: 0 time 0.018816 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.018816 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039936 [TensorRT] VERBOSE: Tactic: 0 time 0.09296 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.039936 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050176 [TensorRT] VERBOSE: Tactic: 0 time 0.029568 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029568 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048864 [TensorRT] VERBOSE: Tactic: 0 time 0.061216 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048864 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.06656 [TensorRT] VERBOSE: Tactic: 0 time 0.046816 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.046816 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.041856 [TensorRT] VERBOSE: Tactic: 0 time 0.019552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019552 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051264 [TensorRT] VERBOSE: Tactic: 0 time 0.043008 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.043008 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05056 [TensorRT] VERBOSE: Tactic: 0 time 0.083072 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.05056 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.039008 [TensorRT] VERBOSE: Tactic: 256 time 0.03952 [TensorRT] VERBOSE: Tactic: 512 time 0.039936 [TensorRT] VERBOSE: Tactic: -32 time 0.052224 [TensorRT] VERBOSE: Tactic: -64 time 0.047776 [TensorRT] VERBOSE: Tactic: -128 time 0.041984 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.039008 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.022496 [TensorRT] VERBOSE: Tactic: 1 time 0.02048 [TensorRT] VERBOSE: Tactic: 2 time 0.018368 [TensorRT] VERBOSE: Tactic: 3 time 0.020672 [TensorRT] VERBOSE: Tactic: 4 time 0.019104 [TensorRT] VERBOSE: Tactic: 5 time 0.018112 [TensorRT] VERBOSE: Tactic: 6 time 0.021376 [TensorRT] VERBOSE: Tactic: 7 time 0.018496 [TensorRT] VERBOSE: Tactic: 8 time 0.018784 [TensorRT] VERBOSE: Tactic: 9 time 0.019072 [TensorRT] VERBOSE: Tactic: 28 time 0.021952 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.018112 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.039232 [TensorRT] VERBOSE: Tactic: 256 time 0.038112 [TensorRT] VERBOSE: Tactic: 512 time 0.039296 [TensorRT] VERBOSE: Tactic: -32 time 0.05024 [TensorRT] VERBOSE: Tactic: -64 time 0.046784 [TensorRT] VERBOSE: Tactic: -128 time 0.041088 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.038112 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.027104 [TensorRT] VERBOSE: Tactic: 25 time 0.027648 [TensorRT] VERBOSE: Tactic: 26 time 0.027648 [TensorRT] VERBOSE: Tactic: 27 time 0.023872 [TensorRT] VERBOSE: Tactic: 31 time 0.026752 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.023872 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.041376 [TensorRT] VERBOSE: Tactic: 256 time 0.036192 [TensorRT] VERBOSE: Tactic: 512 time 0.037216 [TensorRT] VERBOSE: Tactic: -32 time 0.048832 [TensorRT] VERBOSE: Tactic: -64 time 0.04608 [TensorRT] VERBOSE: Tactic: -128 time 0.047808 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036192 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014528 [TensorRT] VERBOSE: Tactic: 1 time 0.01168 [TensorRT] VERBOSE: Tactic: 2 time 0.012288 [TensorRT] VERBOSE: Tactic: 3 time 0.010368 [TensorRT] VERBOSE: Tactic: 4 time 0.011488 [TensorRT] VERBOSE: Tactic: 5 time 0.012096 [TensorRT] VERBOSE: Tactic: 6 time 0.009952 [TensorRT] VERBOSE: Tactic: 7 time 0.012096 [TensorRT] VERBOSE: Tactic: 8 time 0.014336 [TensorRT] VERBOSE: Tactic: 9 time 0.01536 [TensorRT] VERBOSE: Tactic: 10 time 0.02128 [TensorRT] VERBOSE: Tactic: 11 time 0.01712 [TensorRT] VERBOSE: Tactic: 12 time 0.016352 [TensorRT] VERBOSE: Tactic: 13 time 0.01488 [TensorRT] VERBOSE: Tactic: 14 time 0.014624 [TensorRT] VERBOSE: Tactic: 15 time 0.01536 [TensorRT] VERBOSE: Tactic: 16 time 0.013536 [TensorRT] VERBOSE: Tactic: 17 time 0.013312 [TensorRT] VERBOSE: Tactic: 18 time 0.015296 [TensorRT] VERBOSE: Tactic: 19 time 0.016224 [TensorRT] VERBOSE: Tactic: 20 time 0.0336 [TensorRT] VERBOSE: Tactic: 21 time 0.02464 [TensorRT] VERBOSE: Tactic: 22 time 0.017728 [TensorRT] VERBOSE: Tactic: 23 time 0.016 [TensorRT] VERBOSE: Tactic: 28 time 0.01776 [TensorRT] VERBOSE: Tactic: 29 time 0.022528 [TensorRT] VERBOSE: Tactic: 30 time 0.033184 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.009952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.042528 [TensorRT] VERBOSE: Tactic: 256 time 0.036352 [TensorRT] VERBOSE: Tactic: 512 time 0.037568 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036352 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.010784 [TensorRT] VERBOSE: Tactic: 11 time 0.012416 [TensorRT] VERBOSE: Tactic: 12 time 0.011936 [TensorRT] VERBOSE: Tactic: 13 time 0.011616 [TensorRT] VERBOSE: Tactic: 14 time 0.0136 [TensorRT] VERBOSE: Tactic: 15 time 0.015296 [TensorRT] VERBOSE: Tactic: 16 time 0.01632 [TensorRT] VERBOSE: Tactic: 17 time 0.016192 [TensorRT] VERBOSE: Tactic: 18 time 0.01936 [TensorRT] VERBOSE: Tactic: 19 time 0.022368 [TensorRT] VERBOSE: Tactic: 20 time 0.011904 [TensorRT] VERBOSE: Tactic: 21 time 0.012288 [TensorRT] VERBOSE: Tactic: 22 time 0.010304 [TensorRT] VERBOSE: Tactic: 23 time 0.011392 [TensorRT] VERBOSE: Tactic: 24 time 0.014592 [TensorRT] VERBOSE: Tactic: 25 time 0.012096 [TensorRT] VERBOSE: Tactic: 26 time 0.01184 [TensorRT] VERBOSE: Tactic: 27 time 0.011392 [TensorRT] VERBOSE: Tactic: 29 time 0.046816 [TensorRT] VERBOSE: Tactic: 30 time 0.027456 [TensorRT] VERBOSE: Tactic: 31 time 0.018528 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.010304 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039328 [TensorRT] VERBOSE: Tactic: 0 time 0.09456 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.039328 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050048 [TensorRT] VERBOSE: Tactic: 0 time 0.01264 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01264 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049024 [TensorRT] VERBOSE: Tactic: 0 time 0.061024 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049024 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.066944 [TensorRT] VERBOSE: Tactic: 0 time 0.048064 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.048064 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051648 [TensorRT] VERBOSE: Tactic: 0 time 0.042176 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042176 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049728 [TensorRT] VERBOSE: Tactic: 0 time 0.079488 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049728 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050048 [TensorRT] VERBOSE: Tactic: 0 time 0.028608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0512 [TensorRT] VERBOSE: Tactic: 0 time 0.091008 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.0512 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.046368 [TensorRT] VERBOSE: Tactic: 0 time 0.008192 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.008192 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049952 [TensorRT] VERBOSE: Tactic: 0 time 0.031232 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.031232 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.046976 [TensorRT] VERBOSE: Tactic: 0 time 0.097984 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.046976 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.046464 [TensorRT] VERBOSE: Tactic: 0 time 0.01536 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01536 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061568 [TensorRT] VERBOSE: Tactic: 256 time 0.062016 [TensorRT] VERBOSE: Tactic: 512 time 0.063456 [TensorRT] VERBOSE: Tactic: -32 time 0.09088 [TensorRT] VERBOSE: Tactic: -64 time 0.075808 [TensorRT] VERBOSE: Tactic: -128 time 0.072224 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.061568 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.036832 [TensorRT] VERBOSE: Tactic: 1 time 0.036 [TensorRT] VERBOSE: Tactic: 2 time 0.03248 [TensorRT] VERBOSE: Tactic: 3 time 0.035488 [TensorRT] VERBOSE: Tactic: 4 time 0.033056 [TensorRT] VERBOSE: Tactic: 5 time 0.030752 [TensorRT] VERBOSE: Tactic: 6 time 0.039296 [TensorRT] VERBOSE: Tactic: 7 time 0.034624 [TensorRT] VERBOSE: Tactic: 8 time 0.030784 [TensorRT] VERBOSE: Tactic: 9 time 0.032704 [TensorRT] VERBOSE: Tactic: 28 time 0.036192 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.030752 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061216 [TensorRT] VERBOSE: Tactic: 256 time 0.061024 [TensorRT] VERBOSE: Tactic: 512 time 0.062336 [TensorRT] VERBOSE: Tactic: -32 time 0.092864 [TensorRT] VERBOSE: Tactic: -64 time 0.077312 [TensorRT] VERBOSE: Tactic: -128 time 0.07344 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.061024 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.049952 [TensorRT] VERBOSE: Tactic: 25 time 0.050176 [TensorRT] VERBOSE: Tactic: 26 time 0.050816 [TensorRT] VERBOSE: Tactic: 27 time 0.05008 [TensorRT] VERBOSE: Tactic: 31 time 0.050176 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.049952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.080192 [TensorRT] VERBOSE: Tactic: 256 time 0.068864 [TensorRT] VERBOSE: Tactic: 512 time 0.07056 [TensorRT] VERBOSE: Tactic: -32 time 0.087168 [TensorRT] VERBOSE: Tactic: -64 time 0.097248 [TensorRT] VERBOSE: Tactic: -128 time 0.098592 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.068864 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.02416 [TensorRT] VERBOSE: Tactic: 1 time 0.018944 [TensorRT] VERBOSE: Tactic: 2 time 0.018464 [TensorRT] VERBOSE: Tactic: 3 time 0.017408 [TensorRT] VERBOSE: Tactic: 4 time 0.018432 [TensorRT] VERBOSE: Tactic: 5 time 0.019232 [TensorRT] VERBOSE: Tactic: 6 time 0.016864 [TensorRT] VERBOSE: Tactic: 7 time 0.01936 [TensorRT] VERBOSE: Tactic: 8 time 0.024288 [TensorRT] VERBOSE: Tactic: 9 time 0.025888 [TensorRT] VERBOSE: Tactic: 10 time 0.038208 [TensorRT] VERBOSE: Tactic: 11 time 0.029568 [TensorRT] VERBOSE: Tactic: 12 time 0.027552 [TensorRT] VERBOSE: Tactic: 13 time 0.025408 [TensorRT] VERBOSE: Tactic: 14 time 0.023872 [TensorRT] VERBOSE: Tactic: 15 time 0.023872 [TensorRT] VERBOSE: Tactic: 16 time 0.0256 [TensorRT] VERBOSE: Tactic: 17 time 0.02352 [TensorRT] VERBOSE: Tactic: 18 time 0.02416 [TensorRT] VERBOSE: Tactic: 19 time 0.026432 [TensorRT] VERBOSE: Tactic: 20 time 0.063904 [TensorRT] VERBOSE: Tactic: 21 time 0.045984 [TensorRT] VERBOSE: Tactic: 22 time 0.034208 [TensorRT] VERBOSE: Tactic: 23 time 0.031232 [TensorRT] VERBOSE: Tactic: 28 time 0.031424 [TensorRT] VERBOSE: Tactic: 29 time 0.04112 [TensorRT] VERBOSE: Tactic: 30 time 0.061376 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.016864 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.079744 [TensorRT] VERBOSE: Tactic: 256 time 0.068704 [TensorRT] VERBOSE: Tactic: 512 time 0.072704 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.068704 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.01728 [TensorRT] VERBOSE: Tactic: 11 time 0.018848 [TensorRT] VERBOSE: Tactic: 12 time 0.019008 [TensorRT] VERBOSE: Tactic: 13 time 0.01744 [TensorRT] VERBOSE: Tactic: 14 time 0.02112 [TensorRT] VERBOSE: Tactic: 15 time 0.026368 [TensorRT] VERBOSE: Tactic: 16 time 0.02272 [TensorRT] VERBOSE: Tactic: 17 time 0.023584 [TensorRT] VERBOSE: Tactic: 18 time 0.025632 [TensorRT] VERBOSE: Tactic: 19 time 0.039936 [TensorRT] VERBOSE: Tactic: 20 time 0.018656 [TensorRT] VERBOSE: Tactic: 21 time 0.017792 [TensorRT] VERBOSE: Tactic: 22 time 0.019648 [TensorRT] VERBOSE: Tactic: 23 time 0.017536 [TensorRT] VERBOSE: Tactic: 24 time 0.023936 [TensorRT] VERBOSE: Tactic: 25 time 0.020352 [TensorRT] VERBOSE: Tactic: 26 time 0.017888 [TensorRT] VERBOSE: Tactic: 27 time 0.017888 [TensorRT] VERBOSE: Tactic: 29 time 0.086208 [TensorRT] VERBOSE: Tactic: 30 time 0.04976 [TensorRT] VERBOSE: Tactic: 31 time 0.03312 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.01728 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.570368 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.570368 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.447168 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.512352 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.444096 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.476736 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.460032 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.467808 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.520448 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.514336 [TensorRT] VERBOSE: Fastest Tactic: 3915320020053085238 Time: 0.444096 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.644128 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 3612672, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 145948672, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 1184768, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.644128 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.123168 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.15504 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.143488 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.127552 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.146784 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.147616 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.136064 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.127808 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.12176 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.133952 [TensorRT] VERBOSE: Fastest Tactic: -4973811344878172338 Time: 0.12176 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4973811344878172338 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.162528 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.162528 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.126144 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.123008 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.148416 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.119264 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.144128 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.118784 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.136736 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.126528 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.142368 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.131072 [TensorRT] VERBOSE: Fastest Tactic: -7210942453088153035 Time: 0.118784 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7210942453088153035 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.150944 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.147456 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.130368 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.138208 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.122688 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.141312 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.11872 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.124736 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.120128 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.12912 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.11872 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.13648 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.13648 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.041952 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.044704 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.040992 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.04288 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.041984 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.04224 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.044384 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.042464 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.043488 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.040928 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.040032 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.039456 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.039456 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.042464 [TensorRT] VERBOSE: Tactic: 0 time 0.090656 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.042464 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0512 [TensorRT] VERBOSE: Tactic: 0 time 0.013312 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013312 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047968 [TensorRT] VERBOSE: Tactic: 0 time 0.060672 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.047968 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.073984 [TensorRT] VERBOSE: Tactic: 0 time 0.043616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.043616 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.053248 [TensorRT] VERBOSE: Tactic: 0 time 0.039584 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.039584 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049696 [TensorRT] VERBOSE: Tactic: 0 time 0.075168 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049696 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05072 [TensorRT] VERBOSE: Tactic: 0 time 0.020096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020096 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049536 [TensorRT] VERBOSE: Tactic: 0 time 0.08928 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049536 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04608 [TensorRT] VERBOSE: Tactic: 0 time 0.011616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011616 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049664 [TensorRT] VERBOSE: Tactic: 0 time 0.029984 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029984 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047104 [TensorRT] VERBOSE: Tactic: 0 time 0.091232 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.047104 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047904 [TensorRT] VERBOSE: Tactic: 0 time 0.02832 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02832 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032672 [TensorRT] VERBOSE: Tactic: 256 time 0.033664 [TensorRT] VERBOSE: Tactic: 512 time 0.034816 [TensorRT] VERBOSE: Tactic: -32 time 0.049152 [TensorRT] VERBOSE: Tactic: -64 time 0.046432 [TensorRT] VERBOSE: Tactic: -128 time 0.039968 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.032672 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.02048 [TensorRT] VERBOSE: Tactic: 1 time 0.02048 [TensorRT] VERBOSE: Tactic: 2 time 0.018432 [TensorRT] VERBOSE: Tactic: 3 time 0.021888 [TensorRT] VERBOSE: Tactic: 4 time 0.01808 [TensorRT] VERBOSE: Tactic: 5 time 0.019008 [TensorRT] VERBOSE: Tactic: 6 time 0.022528 [TensorRT] VERBOSE: Tactic: 7 time 0.018336 [TensorRT] VERBOSE: Tactic: 8 time 0.017792 [TensorRT] VERBOSE: Tactic: 9 time 0.018592 [TensorRT] VERBOSE: Tactic: 28 time 0.02096 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.017792 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033952 [TensorRT] VERBOSE: Tactic: 256 time 0.033344 [TensorRT] VERBOSE: Tactic: 512 time 0.034816 [TensorRT] VERBOSE: Tactic: -32 time 0.051488 [TensorRT] VERBOSE: Tactic: -64 time 0.047104 [TensorRT] VERBOSE: Tactic: -128 time 0.04112 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.033344 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.02752 [TensorRT] VERBOSE: Tactic: 25 time 0.02752 [TensorRT] VERBOSE: Tactic: 26 time 0.026848 [TensorRT] VERBOSE: Tactic: 27 time 0.024672 [TensorRT] VERBOSE: Tactic: 31 time 0.027232 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.024672 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.04288 [TensorRT] VERBOSE: Tactic: 256 time 0.036416 [TensorRT] VERBOSE: Tactic: 512 time 0.037216 [TensorRT] VERBOSE: Tactic: -32 time 0.052704 [TensorRT] VERBOSE: Tactic: -64 time 0.055904 [TensorRT] VERBOSE: Tactic: -128 time 0.053984 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036416 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014432 [TensorRT] VERBOSE: Tactic: 1 time 0.012288 [TensorRT] VERBOSE: Tactic: 2 time 0.0128 [TensorRT] VERBOSE: Tactic: 3 time 0.011584 [TensorRT] VERBOSE: Tactic: 4 time 0.01216 [TensorRT] VERBOSE: Tactic: 5 time 0.012288 [TensorRT] VERBOSE: Tactic: 6 time 0.011424 [TensorRT] VERBOSE: Tactic: 7 time 0.011776 [TensorRT] VERBOSE: Tactic: 8 time 0.014624 [TensorRT] VERBOSE: Tactic: 9 time 0.015232 [TensorRT] VERBOSE: Tactic: 10 time 0.021376 [TensorRT] VERBOSE: Tactic: 11 time 0.0168 [TensorRT] VERBOSE: Tactic: 12 time 0.016384 [TensorRT] VERBOSE: Tactic: 13 time 0.01488 [TensorRT] VERBOSE: Tactic: 14 time 0.014848 [TensorRT] VERBOSE: Tactic: 15 time 0.015424 [TensorRT] VERBOSE: Tactic: 16 time 0.01376 [TensorRT] VERBOSE: Tactic: 17 time 0.013216 [TensorRT] VERBOSE: Tactic: 18 time 0.015552 [TensorRT] VERBOSE: Tactic: 19 time 0.016384 [TensorRT] VERBOSE: Tactic: 20 time 0.033088 [TensorRT] VERBOSE: Tactic: 21 time 0.02416 [TensorRT] VERBOSE: Tactic: 22 time 0.017408 [TensorRT] VERBOSE: Tactic: 23 time 0.015904 [TensorRT] VERBOSE: Tactic: 28 time 0.018048 [TensorRT] VERBOSE: Tactic: 29 time 0.023104 [TensorRT] VERBOSE: Tactic: 30 time 0.033248 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.011424 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.041696 [TensorRT] VERBOSE: Tactic: 256 time 0.036352 [TensorRT] VERBOSE: Tactic: 512 time 0.037056 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036352 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.010816 [TensorRT] VERBOSE: Tactic: 11 time 0.011744 [TensorRT] VERBOSE: Tactic: 12 time 0.012096 [TensorRT] VERBOSE: Tactic: 13 time 0.011296 [TensorRT] VERBOSE: Tactic: 14 time 0.013312 [TensorRT] VERBOSE: Tactic: 15 time 0.01568 [TensorRT] VERBOSE: Tactic: 16 time 0.016064 [TensorRT] VERBOSE: Tactic: 17 time 0.015968 [TensorRT] VERBOSE: Tactic: 18 time 0.019616 [TensorRT] VERBOSE: Tactic: 19 time 0.02208 [TensorRT] VERBOSE: Tactic: 20 time 0.011744 [TensorRT] VERBOSE: Tactic: 21 time 0.012128 [TensorRT] VERBOSE: Tactic: 22 time 0.010688 [TensorRT] VERBOSE: Tactic: 23 time 0.012864 [TensorRT] VERBOSE: Tactic: 24 time 0.013568 [TensorRT] VERBOSE: Tactic: 25 time 0.013216 [TensorRT] VERBOSE: Tactic: 26 time 0.01184 [TensorRT] VERBOSE: Tactic: 27 time 0.011328 [TensorRT] VERBOSE: Tactic: 29 time 0.046912 [TensorRT] VERBOSE: Tactic: 30 time 0.026976 [TensorRT] VERBOSE: Tactic: 31 time 0.019584 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.010688 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.243072 [TensorRT] VERBOSE: Tactic: 655359 time 0.26016 [TensorRT] VERBOSE: Tactic: 786431 time 0.207168 [TensorRT] VERBOSE: Tactic: 851967 time 0.232288 [TensorRT] VERBOSE: Tactic: 1179647 time 0.217184 [TensorRT] VERBOSE: Tactic: 1310719 time 0.454656 [TensorRT] VERBOSE: Tactic: 1376255 time 0.270432 [TensorRT] VERBOSE: Tactic: 1441791 time 0.302432 [TensorRT] VERBOSE: Tactic: 1507327 time 0.231936 [TensorRT] VERBOSE: Tactic: 1638399 time 0.236352 [TensorRT] VERBOSE: Tactic: 1835007 time 0.209024 [TensorRT] VERBOSE: Tactic: 1900543 time 0.278176 [TensorRT] VERBOSE: Tactic: 2097151 time 0.215872 [TensorRT] VERBOSE: Tactic: 2162687 time 0.204704 [TensorRT] VERBOSE: Tactic: 2293759 time 0.261344 [TensorRT] VERBOSE: Tactic: 2359295 time 0.195136 [TensorRT] VERBOSE: Tactic: 2686975 time 0.20336 [TensorRT] VERBOSE: Tactic: 3080191 time 0.224928 [TensorRT] VERBOSE: Tactic: 3342335 time 0.230368 [TensorRT] VERBOSE: Tactic: 3407871 time 0.216064 [TensorRT] VERBOSE: Tactic: 3538943 time 0.208896 [TensorRT] VERBOSE: Tactic: 3670015 time 0.280384 [TensorRT] VERBOSE: Tactic: 3932159 time 0.2472 [TensorRT] VERBOSE: Tactic: 3997695 time 0.228288 [TensorRT] VERBOSE: Tactic: 4063231 time 0.212736 [TensorRT] VERBOSE: Tactic: 4194303 time 0.181568 [TensorRT] VERBOSE: Tactic: 4259839 time 0.215776 [TensorRT] VERBOSE: Tactic: 4325375 time 0.205088 [TensorRT] VERBOSE: Tactic: 4521983 time 0.26272 [TensorRT] VERBOSE: Tactic: 4587519 time 0.207872 [TensorRT] VERBOSE: Tactic: 4653055 time 0.199136 [TensorRT] VERBOSE: Tactic: 4915199 time 0.179904 [TensorRT] VERBOSE: Tactic: 4980735 time 0.215264 [TensorRT] VERBOSE: Tactic: 5177343 time 0.229632 [TensorRT] VERBOSE: Tactic: 5242879 time 0.207872 [TensorRT] VERBOSE: Tactic: 5373951 time 0.301056 [TensorRT] VERBOSE: Tactic: 5439487 time 0.3072 [TensorRT] VERBOSE: Tactic: 5570559 time 0.23472 [TensorRT] VERBOSE: Tactic: 5636095 time 0.212992 [TensorRT] VERBOSE: Tactic: 5701631 time 0.20192 [TensorRT] VERBOSE: Tactic: 5767167 time 0.714208 [TensorRT] VERBOSE: Tactic: 5832703 time 0.209664 [TensorRT] VERBOSE: Tactic: 5898239 time 0.193536 [TensorRT] VERBOSE: Tactic: 6029311 time 0.19456 [TensorRT] VERBOSE: Tactic: 6225919 time 0.20336 [TensorRT] VERBOSE: Tactic: 6291455 time 0.214464 [TensorRT] VERBOSE: Tactic: 6422527 time 0.214048 [TensorRT] VERBOSE: Tactic: 6750207 time 0.250176 [TensorRT] VERBOSE: Tactic: 6815743 time 0.235904 [TensorRT] VERBOSE: Tactic: 6946815 time 0.313344 [TensorRT] VERBOSE: Tactic: 7012351 time 0.215424 [TensorRT] VERBOSE: Tactic: 7077887 time 0.202848 [TensorRT] VERBOSE: Tactic: 7143423 time 0.34 [TensorRT] VERBOSE: Tactic: 7208959 time 0.217632 [TensorRT] VERBOSE: Tactic: 7340031 time 0.20368 [TensorRT] VERBOSE: Tactic: 7405567 time 0.199072 [TensorRT] VERBOSE: Tactic: 7536639 time 0.250048 [TensorRT] VERBOSE: Tactic: 7602175 time 0.207328 [TensorRT] VERBOSE: Tactic: 7733247 time 0.192672 [TensorRT] VERBOSE: Tactic: 7798783 time 0.20912 [TensorRT] VERBOSE: Tactic: 8191999 time 0.340864 [TensorRT] VERBOSE: Tactic: 8257535 time 0.211904 [TensorRT] VERBOSE: Tactic: 8323071 time 0.237344 [TensorRT] VERBOSE: Tactic: 8650751 time 0.220224 [TensorRT] VERBOSE: Tactic: 8716287 time 0.244576 [TensorRT] VERBOSE: Tactic: 9109503 time 0.23616 [TensorRT] VERBOSE: Tactic: 9568255 time 0.180544 [TensorRT] VERBOSE: Tactic: 9895935 time 0.174688 [TensorRT] VERBOSE: Tactic: 10223615 time 0.202368 [TensorRT] VERBOSE: Tactic: 10354687 time 0.215616 [TensorRT] VERBOSE: Tactic: 10551295 time 0.2184 [TensorRT] VERBOSE: Tactic: 10747903 time 0.182176 [TensorRT] VERBOSE: Tactic: 10944511 time 0.213152 [TensorRT] VERBOSE: Fastest Tactic: 9895935 Time: 0.174688 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.111264 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.1112 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.120832 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.111936 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.113664 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.110176 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.115776 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.132352 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.1312 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.110176 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.164672 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 802816, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 10862592, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.16672 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.164672 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.038912 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.05024 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.045248 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.040896 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.048448 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.042784 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.039168 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.039232 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.046496 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.037888 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.043104 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.038336 [TensorRT] VERBOSE: Fastest Tactic: -4973811344878172338 Time: 0.037888 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4973811344878172338 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.054144 [TensorRT] VERBOSE: Tactic: 655359 time 0.052224 [TensorRT] VERBOSE: Tactic: 786431 time 0.050912 [TensorRT] VERBOSE: Tactic: 851967 time 0.056928 [TensorRT] VERBOSE: Tactic: 1179647 time 0.070848 [TensorRT] VERBOSE: Tactic: 1310719 time 0.052608 [TensorRT] VERBOSE: Tactic: 1376255 time 0.065664 [TensorRT] VERBOSE: Tactic: 1441791 time 0.07168 [TensorRT] VERBOSE: Tactic: 1507327 time 0.04816 [TensorRT] VERBOSE: Tactic: 1638399 time 0.060608 [TensorRT] VERBOSE: Tactic: 1835007 time 0.050944 [TensorRT] VERBOSE: Tactic: 1900543 time 0.053568 [TensorRT] VERBOSE: Tactic: 2097151 time 0.055776 [TensorRT] VERBOSE: Tactic: 2162687 time 0.07312 [TensorRT] VERBOSE: Tactic: 2293759 time 0.065664 [TensorRT] VERBOSE: Tactic: 2359295 time 0.074368 [TensorRT] VERBOSE: Tactic: 2686975 time 0.068128 [TensorRT] VERBOSE: Tactic: 3080191 time 0.044768 [TensorRT] VERBOSE: Tactic: 3342335 time 0.04816 [TensorRT] VERBOSE: Tactic: 3407871 time 0.066048 [TensorRT] VERBOSE: Tactic: 3538943 time 0.068416 [TensorRT] VERBOSE: Tactic: 3670015 time 0.059744 [TensorRT] VERBOSE: Tactic: 3932159 time 0.0496 [TensorRT] VERBOSE: Tactic: 3997695 time 0.052224 [TensorRT] VERBOSE: Tactic: 4063231 time 0.055296 [TensorRT] VERBOSE: Tactic: 4194303 time 0.045088 [TensorRT] VERBOSE: Tactic: 4259839 time 0.065536 [TensorRT] VERBOSE: Tactic: 4325375 time 0.100128 [TensorRT] VERBOSE: Tactic: 4521983 time 0.09888 [TensorRT] VERBOSE: Tactic: 4587519 time 0.05744 [TensorRT] VERBOSE: Tactic: 4653055 time 0.079968 [TensorRT] VERBOSE: Tactic: 4915199 time 0.045024 [TensorRT] VERBOSE: Tactic: 4980735 time 0.10304 [TensorRT] VERBOSE: Tactic: 5177343 time 0.065696 [TensorRT] VERBOSE: Tactic: 5242879 time 0.057024 [TensorRT] VERBOSE: Tactic: 5373951 time 0.075776 [TensorRT] VERBOSE: Tactic: 5439487 time 0.061408 [TensorRT] VERBOSE: Tactic: 5570559 time 0.044096 [TensorRT] VERBOSE: Tactic: 5636095 time 0.055008 [TensorRT] VERBOSE: Tactic: 5701631 time 0.062176 [TensorRT] VERBOSE: Tactic: 5767167 time 0.102752 [TensorRT] VERBOSE: Tactic: 5832703 time 0.060864 [TensorRT] VERBOSE: Tactic: 5898239 time 0.061024 [TensorRT] VERBOSE: Tactic: 6029311 time 0.060896 [TensorRT] VERBOSE: Tactic: 6225919 time 0.05792 [TensorRT] VERBOSE: Tactic: 6291455 time 0.07168 [TensorRT] VERBOSE: Tactic: 6422527 time 0.044672 [TensorRT] VERBOSE: Tactic: 6750207 time 0.057952 [TensorRT] VERBOSE: Tactic: 6815743 time 0.059808 [TensorRT] VERBOSE: Tactic: 6946815 time 0.062464 [TensorRT] VERBOSE: Tactic: 7012351 time 0.05552 [TensorRT] VERBOSE: Tactic: 7077887 time 0.062464 [TensorRT] VERBOSE: Tactic: 7143423 time 0.077888 [TensorRT] VERBOSE: Tactic: 7208959 time 0.057568 [TensorRT] VERBOSE: Tactic: 7340031 time 0.06144 [TensorRT] VERBOSE: Tactic: 7405567 time 0.05248 [TensorRT] VERBOSE: Tactic: 7536639 time 0.074272 [TensorRT] VERBOSE: Tactic: 7602175 time 0.055584 [TensorRT] VERBOSE: Tactic: 7733247 time 0.054304 [TensorRT] VERBOSE: Tactic: 7798783 time 0.050784 [TensorRT] VERBOSE: Tactic: 8191999 time 0.083328 [TensorRT] VERBOSE: Tactic: 8257535 time 0.046112 [TensorRT] VERBOSE: Tactic: 8323071 time 0.053248 [TensorRT] VERBOSE: Tactic: 8650751 time 0.05104 [TensorRT] VERBOSE: Tactic: 8716287 time 0.064864 [TensorRT] VERBOSE: Tactic: 9109503 time 0.063776 [TensorRT] VERBOSE: Tactic: 9568255 time 0.045376 [TensorRT] VERBOSE: Tactic: 9895935 time 0.044928 [TensorRT] VERBOSE: Tactic: 10223615 time 0.068064 [TensorRT] VERBOSE: Tactic: 10354687 time 0.104992 [TensorRT] VERBOSE: Tactic: 10551295 time 0.053632 [TensorRT] VERBOSE: Tactic: 10747903 time 0.05408 [TensorRT] VERBOSE: Tactic: 10944511 time 0.103008 [TensorRT] VERBOSE: Fastest Tactic: 5570559 Time: 0.044096 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.03456 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.033792 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.034752 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.03552 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.040832 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.033632 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.038624 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.034912 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.034208 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.036736 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.038624 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.039232 [TensorRT] VERBOSE: Fastest Tactic: 6797040896965118050 Time: 0.033632 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6797040896965118050 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.034816 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.040544 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.036928 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.034944 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.035808 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.036064 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.037888 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.0376 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.033728 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.034272 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.035232 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.033728 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.033728 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.046624 [TensorRT] VERBOSE: Tactic: 655359 time 0.047936 [TensorRT] VERBOSE: Tactic: 786431 time 0.060544 [TensorRT] VERBOSE: Tactic: 851967 time 0.049824 [TensorRT] VERBOSE: Tactic: 1179647 time 0.07296 [TensorRT] VERBOSE: Tactic: 1310719 time 0.052032 [TensorRT] VERBOSE: Tactic: 1376255 time 0.063904 [TensorRT] VERBOSE: Tactic: 1441791 time 0.070208 [TensorRT] VERBOSE: Tactic: 1507327 time 0.041888 [TensorRT] VERBOSE: Tactic: 1638399 time 0.062592 [TensorRT] VERBOSE: Tactic: 1835007 time 0.063744 [TensorRT] VERBOSE: Tactic: 1900543 time 0.042528 [TensorRT] VERBOSE: Tactic: 2097151 time 0.067584 [TensorRT] VERBOSE: Tactic: 2162687 time 0.068096 [TensorRT] VERBOSE: Tactic: 2293759 time 0.07104 [TensorRT] VERBOSE: Tactic: 2359295 time 0.065856 [TensorRT] VERBOSE: Tactic: 2686975 time 0.065856 [TensorRT] VERBOSE: Tactic: 3080191 time 0.036864 [TensorRT] VERBOSE: Tactic: 3342335 time 0.041984 [TensorRT] VERBOSE: Tactic: 3407871 time 0.074336 [TensorRT] VERBOSE: Tactic: 3538943 time 0.072704 [TensorRT] VERBOSE: Tactic: 3670015 time 0.049216 [TensorRT] VERBOSE: Tactic: 3932159 time 0.042464 [TensorRT] VERBOSE: Tactic: 3997695 time 0.060544 [TensorRT] VERBOSE: Tactic: 4063231 time 0.048064 [TensorRT] VERBOSE: Tactic: 4194303 time 0.050784 [TensorRT] VERBOSE: Tactic: 4259839 time 0.067872 [TensorRT] VERBOSE: Tactic: 4325375 time 0.105888 [TensorRT] VERBOSE: Tactic: 4521983 time 0.106496 [TensorRT] VERBOSE: Tactic: 4587519 time 0.064032 [TensorRT] VERBOSE: Tactic: 4653055 time 0.083584 [TensorRT] VERBOSE: Tactic: 4915199 time 0.051008 [TensorRT] VERBOSE: Tactic: 4980735 time 0.109152 [TensorRT] VERBOSE: Tactic: 5177343 time 0.066144 [TensorRT] VERBOSE: Tactic: 5242879 time 0.061504 [TensorRT] VERBOSE: Tactic: 5373951 time 0.078272 [TensorRT] VERBOSE: Tactic: 5439487 time 0.07728 [TensorRT] VERBOSE: Tactic: 5570559 time 0.036864 [TensorRT] VERBOSE: Tactic: 5636095 time 0.04912 [TensorRT] VERBOSE: Tactic: 5701631 time 0.063168 [TensorRT] VERBOSE: Tactic: 5767167 time 0.14704 [TensorRT] VERBOSE: Tactic: 5832703 time 0.064672 [TensorRT] VERBOSE: Tactic: 5898239 time 0.062592 [TensorRT] VERBOSE: Tactic: 6029311 time 0.060096 [TensorRT] VERBOSE: Tactic: 6225919 time 0.063264 [TensorRT] VERBOSE: Tactic: 6291455 time 0.072256 [TensorRT] VERBOSE: Tactic: 6422527 time 0.038752 [TensorRT] VERBOSE: Tactic: 6750207 time 0.070688 [TensorRT] VERBOSE: Tactic: 6815743 time 0.066304 [TensorRT] VERBOSE: Tactic: 6946815 time 0.078176 [TensorRT] VERBOSE: Tactic: 7012351 time 0.067072 [TensorRT] VERBOSE: Tactic: 7077887 time 0.06544 [TensorRT] VERBOSE: Tactic: 7143423 time 0.107808 [TensorRT] VERBOSE: Tactic: 7208959 time 0.06032 [TensorRT] VERBOSE: Tactic: 7340031 time 0.061824 [TensorRT] VERBOSE: Tactic: 7405567 time 0.048704 [TensorRT] VERBOSE: Tactic: 7536639 time 0.079392 [TensorRT] VERBOSE: Tactic: 7602175 time 0.06352 [TensorRT] VERBOSE: Tactic: 7733247 time 0.053824 [TensorRT] VERBOSE: Tactic: 7798783 time 0.059808 [TensorRT] VERBOSE: Tactic: 8191999 time 0.09872 [TensorRT] VERBOSE: Tactic: 8257535 time 0.046816 [TensorRT] VERBOSE: Tactic: 8323071 time 0.069664 [TensorRT] VERBOSE: Tactic: 8650751 time 0.058048 [TensorRT] VERBOSE: Tactic: 8716287 time 0.068608 [TensorRT] VERBOSE: Tactic: 9109503 time 0.057088 [TensorRT] VERBOSE: Tactic: 9568255 time 0.050496 [TensorRT] VERBOSE: Tactic: 9895935 time 0.05104 [TensorRT] VERBOSE: Tactic: 10223615 time 0.0656 [TensorRT] VERBOSE: Tactic: 10354687 time 0.107968 [TensorRT] VERBOSE: Tactic: 10551295 time 0.066656 [TensorRT] VERBOSE: Tactic: 10747903 time 0.05536 [TensorRT] VERBOSE: Tactic: 10944511 time 0.109248 [TensorRT] VERBOSE: Fastest Tactic: 3080191 Time: 0.036864 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.017408 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.016128 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.017152 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.017504 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.016768 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.017504 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.017312 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.017248 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.017408 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.017312 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.01776 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.017152 [TensorRT] VERBOSE: Fastest Tactic: 2271687430539765460 Time: 0.016128 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2271687430539765460 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032672 [TensorRT] VERBOSE: Tactic: 256 time 0.034208 [TensorRT] VERBOSE: Tactic: 512 time 0.034816 [TensorRT] VERBOSE: Tactic: -32 time 0.050176 [TensorRT] VERBOSE: Tactic: -64 time 0.046432 [TensorRT] VERBOSE: Tactic: -128 time 0.040384 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.032672 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.02048 [TensorRT] VERBOSE: Tactic: 1 time 0.020128 [TensorRT] VERBOSE: Tactic: 2 time 0.01904 [TensorRT] VERBOSE: Tactic: 3 time 0.021984 [TensorRT] VERBOSE: Tactic: 4 time 0.018432 [TensorRT] VERBOSE: Tactic: 5 time 0.018144 [TensorRT] VERBOSE: Tactic: 6 time 0.021536 [TensorRT] VERBOSE: Tactic: 7 time 0.01952 [TensorRT] VERBOSE: Tactic: 8 time 0.019296 [TensorRT] VERBOSE: Tactic: 9 time 0.018304 [TensorRT] VERBOSE: Tactic: 28 time 0.020672 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.018144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033792 [TensorRT] VERBOSE: Tactic: 256 time 0.033792 [TensorRT] VERBOSE: Tactic: 512 time 0.033952 [TensorRT] VERBOSE: Tactic: -32 time 0.050624 [TensorRT] VERBOSE: Tactic: -64 time 0.047872 [TensorRT] VERBOSE: Tactic: -128 time 0.040544 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.033792 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.027648 [TensorRT] VERBOSE: Tactic: 25 time 0.02672 [TensorRT] VERBOSE: Tactic: 26 time 0.027392 [TensorRT] VERBOSE: Tactic: 27 time 0.02464 [TensorRT] VERBOSE: Tactic: 31 time 0.027424 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.02464 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] WARNING: No implementation of layer LeakyRelu_64 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04288 [TensorRT] VERBOSE: Tactic: 0 time 0.090432 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04288 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.074624 [TensorRT] VERBOSE: Tactic: 0 time 0.043744 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.043744 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.019712 [TensorRT] VERBOSE: Tactic: 0 time 0.011744 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011744 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.023232 [TensorRT] VERBOSE: Tactic: 0 time 0.048832 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023232 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026784 [TensorRT] VERBOSE: Tactic: 0 time 0.015392 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015392 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02496 [TensorRT] VERBOSE: Tactic: 0 time 0.031712 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02496 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040672 [TensorRT] VERBOSE: Tactic: 0 time 0.024832 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024832 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.024512 [TensorRT] VERBOSE: Tactic: 0 time 0.012256 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012256 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028448 [TensorRT] VERBOSE: Tactic: 0 time 0.019712 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019712 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026048 [TensorRT] VERBOSE: Tactic: 0 time 0.038912 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026048 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026624 [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006144 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026272 [TensorRT] VERBOSE: Tactic: 0 time 0.03168 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026272 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039872 [TensorRT] VERBOSE: Tactic: 0 time 0.025152 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.025152 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027776 [TensorRT] VERBOSE: Tactic: 0 time 0.020096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020096 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025728 [TensorRT] VERBOSE: Tactic: 0 time 0.038848 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025728 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0256 [TensorRT] VERBOSE: Tactic: 0 time 0.00928 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00928 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025408 [TensorRT] VERBOSE: Tactic: 0 time 0.007424 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007424 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025824 [TensorRT] VERBOSE: Tactic: 0 time 0.017088 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017088 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02704 [TensorRT] VERBOSE: Tactic: 0 time 0.016992 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016992 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.12288 [TensorRT] VERBOSE: Tactic: 655359 time 0.100352 [TensorRT] VERBOSE: Tactic: 786431 time 0.077792 [TensorRT] VERBOSE: Tactic: 851967 time 0.083488 [TensorRT] VERBOSE: Tactic: 1179647 time 0.077024 [TensorRT] VERBOSE: Tactic: 1310719 time 0.128 [TensorRT] VERBOSE: Tactic: 1376255 time 0.099968 [TensorRT] VERBOSE: Tactic: 1441791 time 0.102784 [TensorRT] VERBOSE: Tactic: 1507327 time 0.092608 [TensorRT] VERBOSE: Tactic: 1638399 time 0.082944 [TensorRT] VERBOSE: Tactic: 1835007 time 0.07632 [TensorRT] VERBOSE: Tactic: 1900543 time 0.103424 [TensorRT] VERBOSE: Tactic: 2097151 time 0.078688 [TensorRT] VERBOSE: Tactic: 2162687 time 0.099168 [TensorRT] VERBOSE: Tactic: 2293759 time 0.101376 [TensorRT] VERBOSE: Tactic: 2359295 time 0.0768 [TensorRT] VERBOSE: Tactic: 2686975 time 0.093984 [TensorRT] VERBOSE: Tactic: 3080191 time 0.091168 [TensorRT] VERBOSE: Tactic: 3342335 time 0.093184 [TensorRT] VERBOSE: Tactic: 3407871 time 0.084 [TensorRT] VERBOSE: Tactic: 3538943 time 0.07456 [TensorRT] VERBOSE: Tactic: 3670015 time 0.142432 [TensorRT] VERBOSE: Tactic: 3932159 time 0.088544 [TensorRT] VERBOSE: Tactic: 3997695 time 0.07712 [TensorRT] VERBOSE: Tactic: 4063231 time 0.083392 [TensorRT] VERBOSE: Tactic: 4194303 time 0.079328 [TensorRT] VERBOSE: Tactic: 4259839 time 0.078592 [TensorRT] VERBOSE: Tactic: 4325375 time 0.078944 [TensorRT] VERBOSE: Tactic: 4521983 time 0.094784 [TensorRT] VERBOSE: Tactic: 4587519 time 0.073856 [TensorRT] VERBOSE: Tactic: 4653055 time 0.07184 [TensorRT] VERBOSE: Tactic: 4915199 time 0.073152 [TensorRT] VERBOSE: Tactic: 4980735 time 0.090432 [TensorRT] VERBOSE: Tactic: 5177343 time 0.080192 [TensorRT] VERBOSE: Tactic: 5242879 time 0.08496 [TensorRT] VERBOSE: Tactic: 5373951 time 0.09408 [TensorRT] VERBOSE: Tactic: 5439487 time 0.094144 [TensorRT] VERBOSE: Tactic: 5570559 time 0.093088 [TensorRT] VERBOSE: Tactic: 5636095 time 0.084448 [TensorRT] VERBOSE: Tactic: 5701631 time 0.095008 [TensorRT] VERBOSE: Tactic: 5767167 time 0.132 [TensorRT] VERBOSE: Tactic: 5832703 time 0.083232 [TensorRT] VERBOSE: Tactic: 5898239 time 0.074784 [TensorRT] VERBOSE: Tactic: 6029311 time 0.090656 [TensorRT] VERBOSE: Tactic: 6225919 time 0.072448 [TensorRT] VERBOSE: Tactic: 6291455 time 0.0768 [TensorRT] VERBOSE: Tactic: 6422527 time 0.08656 [TensorRT] VERBOSE: Tactic: 6750207 time 0.082944 [TensorRT] VERBOSE: Tactic: 6815743 time 0.090688 [TensorRT] VERBOSE: Tactic: 6946815 time 0.089952 [TensorRT] VERBOSE: Tactic: 7012351 time 0.078016 [TensorRT] VERBOSE: Tactic: 7077887 time 0.0736 [TensorRT] VERBOSE: Tactic: 7143423 time 0.105536 [TensorRT] VERBOSE: Tactic: 7208959 time 0.087936 [TensorRT] VERBOSE: Tactic: 7340031 time 0.07616 [TensorRT] VERBOSE: Tactic: 7405567 time 0.07632 [TensorRT] VERBOSE: Tactic: 7536639 time 0.090976 [TensorRT] VERBOSE: Tactic: 7602175 time 0.0768 [TensorRT] VERBOSE: Tactic: 7733247 time 0.073408 [TensorRT] VERBOSE: Tactic: 7798783 time 0.08 [TensorRT] VERBOSE: Tactic: 8191999 time 0.098048 [TensorRT] VERBOSE: Tactic: 8257535 time 0.078176 [TensorRT] VERBOSE: Tactic: 8323071 time 0.0864 [TensorRT] VERBOSE: Tactic: 8650751 time 0.079776 [TensorRT] VERBOSE: Tactic: 8716287 time 0.08416 [TensorRT] VERBOSE: Tactic: 9109503 time 0.081088 [TensorRT] VERBOSE: Tactic: 9568255 time 0.072032 [TensorRT] VERBOSE: Tactic: 9895935 time 0.077152 [TensorRT] VERBOSE: Tactic: 10223615 time 0.09424 [TensorRT] VERBOSE: Tactic: 10354687 time 0.076064 [TensorRT] VERBOSE: Tactic: 10551295 time 0.08192 [TensorRT] VERBOSE: Tactic: 10747903 time 0.07024 [TensorRT] VERBOSE: Tactic: 10944511 time 0.090112 [TensorRT] VERBOSE: Fastest Tactic: 10747903 Time: 0.07024 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.03584 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.038336 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.042144 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.03584 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.04 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.037888 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.03856 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.040064 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.043776 [TensorRT] VERBOSE: Fastest Tactic: 1754569683116234317 Time: 0.03584 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.060256 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 401408, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 3203072, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.059392 [TensorRT] VERBOSE: Fastest Tactic: 57 Time: 0.059392 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.018112 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.01776 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.019456 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.018976 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.018144 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.018848 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.018656 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.017856 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.018048 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.01776 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.020064 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.018336 [TensorRT] VERBOSE: Fastest Tactic: 1204440019753223942 Time: 0.01776 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1204440019753223942 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.025952 [TensorRT] VERBOSE: Tactic: 655359 time 0.023712 [TensorRT] VERBOSE: Tactic: 786431 time 0.024416 [TensorRT] VERBOSE: Tactic: 851967 time 0.02512 [TensorRT] VERBOSE: Tactic: 1179647 time 0.026688 [TensorRT] VERBOSE: Tactic: 1310719 time 0.02608 [TensorRT] VERBOSE: Tactic: 1376255 time 0.029376 [TensorRT] VERBOSE: Tactic: 1441791 time 0.02848 [TensorRT] VERBOSE: Tactic: 1507327 time 0.021888 [TensorRT] VERBOSE: Tactic: 1638399 time 0.024 [TensorRT] VERBOSE: Tactic: 1835007 time 0.023552 [TensorRT] VERBOSE: Tactic: 1900543 time 0.025184 [TensorRT] VERBOSE: Tactic: 2097151 time 0.024128 [TensorRT] VERBOSE: Tactic: 2162687 time 0.035264 [TensorRT] VERBOSE: Tactic: 2293759 time 0.029504 [TensorRT] VERBOSE: Tactic: 2359295 time 0.027808 [TensorRT] VERBOSE: Tactic: 2686975 time 0.028192 [TensorRT] VERBOSE: Tactic: 3080191 time 0.021888 [TensorRT] VERBOSE: Tactic: 3342335 time 0.022528 [TensorRT] VERBOSE: Tactic: 3407871 time 0.027072 [TensorRT] VERBOSE: Tactic: 3538943 time 0.025344 [TensorRT] VERBOSE: Tactic: 3670015 time 0.0312 [TensorRT] VERBOSE: Tactic: 3932159 time 0.02208 [TensorRT] VERBOSE: Tactic: 3997695 time 0.0224 [TensorRT] VERBOSE: Tactic: 4063231 time 0.023552 [TensorRT] VERBOSE: Tactic: 4194303 time 0.023552 [TensorRT] VERBOSE: Tactic: 4259839 time 0.026784 [TensorRT] VERBOSE: Tactic: 4325375 time 0.032448 [TensorRT] VERBOSE: Tactic: 4521983 time 0.033216 [TensorRT] VERBOSE: Tactic: 4587519 time 0.023008 [TensorRT] VERBOSE: Tactic: 4653055 time 0.029696 [TensorRT] VERBOSE: Tactic: 4915199 time 0.021152 [TensorRT] VERBOSE: Tactic: 4980735 time 0.034784 [TensorRT] VERBOSE: Tactic: 5177343 time 0.025024 [TensorRT] VERBOSE: Tactic: 5242879 time 0.023776 [TensorRT] VERBOSE: Tactic: 5373951 time 0.027328 [TensorRT] VERBOSE: Tactic: 5439487 time 0.025152 [TensorRT] VERBOSE: Tactic: 5570559 time 0.023296 [TensorRT] VERBOSE: Tactic: 5636095 time 0.02336 [TensorRT] VERBOSE: Tactic: 5701631 time 0.029696 [TensorRT] VERBOSE: Tactic: 5767167 time 0.029888 [TensorRT] VERBOSE: Tactic: 5832703 time 0.025152 [TensorRT] VERBOSE: Tactic: 5898239 time 0.02368 [TensorRT] VERBOSE: Tactic: 6029311 time 0.026368 [TensorRT] VERBOSE: Tactic: 6225919 time 0.022304 [TensorRT] VERBOSE: Tactic: 6291455 time 0.026592 [TensorRT] VERBOSE: Tactic: 6422527 time 0.020352 [TensorRT] VERBOSE: Tactic: 6750207 time 0.02368 [TensorRT] VERBOSE: Tactic: 6815743 time 0.023712 [TensorRT] VERBOSE: Tactic: 6946815 time 0.02496 [TensorRT] VERBOSE: Tactic: 7012351 time 0.023648 [TensorRT] VERBOSE: Tactic: 7077887 time 0.02336 [TensorRT] VERBOSE: Tactic: 7143423 time 0.026624 [TensorRT] VERBOSE: Tactic: 7208959 time 0.023552 [TensorRT] VERBOSE: Tactic: 7340031 time 0.024576 [TensorRT] VERBOSE: Tactic: 7405567 time 0.022336 [TensorRT] VERBOSE: Tactic: 7536639 time 0.026432 [TensorRT] VERBOSE: Tactic: 7602175 time 0.022144 [TensorRT] VERBOSE: Tactic: 7733247 time 0.022464 [TensorRT] VERBOSE: Tactic: 7798783 time 0.025024 [TensorRT] VERBOSE: Tactic: 8191999 time 0.026912 [TensorRT] VERBOSE: Tactic: 8257535 time 0.021088 [TensorRT] VERBOSE: Tactic: 8323071 time 0.022528 [TensorRT] VERBOSE: Tactic: 8650751 time 0.022592 [TensorRT] VERBOSE: Tactic: 8716287 time 0.023232 [TensorRT] VERBOSE: Tactic: 9109503 time 0.026624 [TensorRT] VERBOSE: Tactic: 9568255 time 0.02208 [TensorRT] VERBOSE: Tactic: 9895935 time 0.02336 [TensorRT] VERBOSE: Tactic: 10223615 time 0.027968 [TensorRT] VERBOSE: Tactic: 10354687 time 0.03584 [TensorRT] VERBOSE: Tactic: 10551295 time 0.023552 [TensorRT] VERBOSE: Tactic: 10747903 time 0.021792 [TensorRT] VERBOSE: Tactic: 10944511 time 0.033664 [TensorRT] VERBOSE: Fastest Tactic: 6422527 Time: 0.020352 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.014432 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.014336 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.015744 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.015744 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.018848 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.015008 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.015616 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.015552 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.014336 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.015488 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.018656 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.015744 [TensorRT] VERBOSE: Fastest Tactic: 4000990898022781625 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4000990898022781625 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.014336 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.015808 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.015776 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.014112 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.01568 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.015552 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.01744 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.01568 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.0152 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.014208 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.01536 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.015712 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.014112 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.020256 [TensorRT] VERBOSE: Tactic: 655359 time 0.017376 [TensorRT] VERBOSE: Tactic: 786431 time 0.021984 [TensorRT] VERBOSE: Tactic: 851967 time 0.022048 [TensorRT] VERBOSE: Tactic: 1179647 time 0.026624 [TensorRT] VERBOSE: Tactic: 1310719 time 0.023232 [TensorRT] VERBOSE: Tactic: 1376255 time 0.025152 [TensorRT] VERBOSE: Tactic: 1441791 time 0.026912 [TensorRT] VERBOSE: Tactic: 1507327 time 0.016704 [TensorRT] VERBOSE: Tactic: 1638399 time 0.02384 [TensorRT] VERBOSE: Tactic: 1835007 time 0.023776 [TensorRT] VERBOSE: Tactic: 1900543 time 0.01728 [TensorRT] VERBOSE: Tactic: 2097151 time 0.026464 [TensorRT] VERBOSE: Tactic: 2162687 time 0.026528 [TensorRT] VERBOSE: Tactic: 2293759 time 0.025024 [TensorRT] VERBOSE: Tactic: 2359295 time 0.021248 [TensorRT] VERBOSE: Tactic: 2686975 time 0.023584 [TensorRT] VERBOSE: Tactic: 3080191 time 0.015488 [TensorRT] VERBOSE: Tactic: 3342335 time 0.017088 [TensorRT] VERBOSE: Tactic: 3407871 time 0.026272 [TensorRT] VERBOSE: Tactic: 3538943 time 0.025184 [TensorRT] VERBOSE: Tactic: 3670015 time 0.021984 [TensorRT] VERBOSE: Tactic: 3932159 time 0.016704 [TensorRT] VERBOSE: Tactic: 3997695 time 0.022112 [TensorRT] VERBOSE: Tactic: 4063231 time 0.019872 [TensorRT] VERBOSE: Tactic: 4194303 time 0.021184 [TensorRT] VERBOSE: Tactic: 4259839 time 0.026752 [TensorRT] VERBOSE: Tactic: 4325375 time 0.0328 [TensorRT] VERBOSE: Tactic: 4521983 time 0.034688 [TensorRT] VERBOSE: Tactic: 4587519 time 0.023872 [TensorRT] VERBOSE: Tactic: 4653055 time 0.029984 [TensorRT] VERBOSE: Tactic: 4915199 time 0.0192 [TensorRT] VERBOSE: Tactic: 4980735 time 0.034784 [TensorRT] VERBOSE: Tactic: 5177343 time 0.025216 [TensorRT] VERBOSE: Tactic: 5242879 time 0.022144 [TensorRT] VERBOSE: Tactic: 5373951 time 0.028224 [TensorRT] VERBOSE: Tactic: 5439487 time 0.025152 [TensorRT] VERBOSE: Tactic: 5570559 time 0.015584 [TensorRT] VERBOSE: Tactic: 5636095 time 0.02048 [TensorRT] VERBOSE: Tactic: 5701631 time 0.023392 [TensorRT] VERBOSE: Tactic: 5767167 time 0.043008 [TensorRT] VERBOSE: Tactic: 5832703 time 0.023616 [TensorRT] VERBOSE: Tactic: 5898239 time 0.023296 [TensorRT] VERBOSE: Tactic: 6029311 time 0.022528 [TensorRT] VERBOSE: Tactic: 6225919 time 0.021856 [TensorRT] VERBOSE: Tactic: 6291455 time 0.02656 [TensorRT] VERBOSE: Tactic: 6422527 time 0.015648 [TensorRT] VERBOSE: Tactic: 6750207 time 0.02496 [TensorRT] VERBOSE: Tactic: 6815743 time 0.023616 [TensorRT] VERBOSE: Tactic: 6946815 time 0.026624 [TensorRT] VERBOSE: Tactic: 7012351 time 0.026592 [TensorRT] VERBOSE: Tactic: 7077887 time 0.022208 [TensorRT] VERBOSE: Tactic: 7143423 time 0.032768 [TensorRT] VERBOSE: Tactic: 7208959 time 0.021824 [TensorRT] VERBOSE: Tactic: 7340031 time 0.022048 [TensorRT] VERBOSE: Tactic: 7405567 time 0.01984 [TensorRT] VERBOSE: Tactic: 7536639 time 0.025056 [TensorRT] VERBOSE: Tactic: 7602175 time 0.022176 [TensorRT] VERBOSE: Tactic: 7733247 time 0.019424 [TensorRT] VERBOSE: Tactic: 7798783 time 0.021728 [TensorRT] VERBOSE: Tactic: 8191999 time 0.031008 [TensorRT] VERBOSE: Tactic: 8257535 time 0.017408 [TensorRT] VERBOSE: Tactic: 8323071 time 0.02224 [TensorRT] VERBOSE: Tactic: 8650751 time 0.022208 [TensorRT] VERBOSE: Tactic: 8716287 time 0.023552 [TensorRT] VERBOSE: Tactic: 9109503 time 0.022112 [TensorRT] VERBOSE: Tactic: 9568255 time 0.018848 [TensorRT] VERBOSE: Tactic: 9895935 time 0.021504 [TensorRT] VERBOSE: Tactic: 10223615 time 0.023456 [TensorRT] VERBOSE: Tactic: 10354687 time 0.034688 [TensorRT] VERBOSE: Tactic: 10551295 time 0.022816 [TensorRT] VERBOSE: Tactic: 10747903 time 0.020544 [TensorRT] VERBOSE: Tactic: 10944511 time 0.034368 [TensorRT] VERBOSE: Fastest Tactic: 3080191 Time: 0.015488 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.010688 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.012288 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.010112 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.01072 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.012576 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.011008 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.011008 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.010688 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.011008 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.01104 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.012704 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.010816 [TensorRT] VERBOSE: Fastest Tactic: 5754467717466343388 Time: 0.010112 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5754467717466343388 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02336 [TensorRT] VERBOSE: Tactic: 0 time 0.048032 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02336 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026432 [TensorRT] VERBOSE: Tactic: 0 time 0.048128 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026432 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026336 [TensorRT] VERBOSE: Tactic: 0 time 0.047872 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026336 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019168 [TensorRT] VERBOSE: Tactic: 256 time 0.019328 [TensorRT] VERBOSE: Tactic: 512 time 0.020672 [TensorRT] VERBOSE: Tactic: -32 time 0.042688 [TensorRT] VERBOSE: Tactic: -64 time 0.027648 [TensorRT] VERBOSE: Tactic: -128 time 0.025696 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019168 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.012576 [TensorRT] VERBOSE: Tactic: 1 time 0.013376 [TensorRT] VERBOSE: Tactic: 2 time 0.011424 [TensorRT] VERBOSE: Tactic: 3 time 0.01248 [TensorRT] VERBOSE: Tactic: 4 time 0.011136 [TensorRT] VERBOSE: Tactic: 5 time 0.011872 [TensorRT] VERBOSE: Tactic: 6 time 0.013824 [TensorRT] VERBOSE: Tactic: 7 time 0.011648 [TensorRT] VERBOSE: Tactic: 8 time 0.011264 [TensorRT] VERBOSE: Tactic: 9 time 0.012576 [TensorRT] VERBOSE: Tactic: 28 time 0.012832 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.011136 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.020352 [TensorRT] VERBOSE: Tactic: 256 time 0.019456 [TensorRT] VERBOSE: Tactic: 512 time 0.019936 [TensorRT] VERBOSE: Tactic: -32 time 0.043552 [TensorRT] VERBOSE: Tactic: -64 time 0.027104 [TensorRT] VERBOSE: Tactic: -128 time 0.025952 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.019456 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.015584 [TensorRT] VERBOSE: Tactic: 25 time 0.016192 [TensorRT] VERBOSE: Tactic: 26 time 0.014048 [TensorRT] VERBOSE: Tactic: 27 time 0.014624 [TensorRT] VERBOSE: Tactic: 31 time 0.014752 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.014048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022752 [TensorRT] VERBOSE: Tactic: 256 time 0.021088 [TensorRT] VERBOSE: Tactic: 512 time 0.022016 [TensorRT] VERBOSE: Tactic: -32 time 0.026528 [TensorRT] VERBOSE: Tactic: -64 time 0.029696 [TensorRT] VERBOSE: Tactic: -128 time 0.031104 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021088 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Tactic: 1 time 0.007712 [TensorRT] VERBOSE: Tactic: 2 time 0.007008 [TensorRT] VERBOSE: Tactic: 3 time 0.007552 [TensorRT] VERBOSE: Tactic: 4 time 0.00752 [TensorRT] VERBOSE: Tactic: 5 time 0.006816 [TensorRT] VERBOSE: Tactic: 6 time 0.00752 [TensorRT] VERBOSE: Tactic: 7 time 0.00768 [TensorRT] VERBOSE: Tactic: 8 time 0.009216 [TensorRT] VERBOSE: Tactic: 9 time 0.008352 [TensorRT] VERBOSE: Tactic: 10 time 0.012384 [TensorRT] VERBOSE: Tactic: 11 time 0.011104 [TensorRT] VERBOSE: Tactic: 12 time 0.009408 [TensorRT] VERBOSE: Tactic: 13 time 0.009824 [TensorRT] VERBOSE: Tactic: 14 time 0.008352 [TensorRT] VERBOSE: Tactic: 15 time 0.008384 [TensorRT] VERBOSE: Tactic: 16 time 0.009184 [TensorRT] VERBOSE: Tactic: 17 time 0.009152 [TensorRT] VERBOSE: Tactic: 18 time 0.008096 [TensorRT] VERBOSE: Tactic: 19 time 0.008448 [TensorRT] VERBOSE: Tactic: 20 time 0.018752 [TensorRT] VERBOSE: Tactic: 21 time 0.014112 [TensorRT] VERBOSE: Tactic: 22 time 0.011072 [TensorRT] VERBOSE: Tactic: 23 time 0.010944 [TensorRT] VERBOSE: Tactic: 28 time 0.010816 [TensorRT] VERBOSE: Tactic: 29 time 0.012704 [TensorRT] VERBOSE: Tactic: 30 time 0.018528 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.006816 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022016 [TensorRT] VERBOSE: Tactic: 256 time 0.021312 [TensorRT] VERBOSE: Tactic: 512 time 0.021984 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021312 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007936 [TensorRT] VERBOSE: Tactic: 11 time 0.007712 [TensorRT] VERBOSE: Tactic: 12 time 0.008064 [TensorRT] VERBOSE: Tactic: 13 time 0.01072 [TensorRT] VERBOSE: Tactic: 14 time 0.009408 [TensorRT] VERBOSE: Tactic: 15 time 0.011328 [TensorRT] VERBOSE: Tactic: 16 time 0.01408 [TensorRT] VERBOSE: Tactic: 17 time 0.014112 [TensorRT] VERBOSE: Tactic: 18 time 0.014592 [TensorRT] VERBOSE: Tactic: 19 time 0.015648 [TensorRT] VERBOSE: Tactic: 20 time 0.008064 [TensorRT] VERBOSE: Tactic: 21 time 0.007744 [TensorRT] VERBOSE: Tactic: 22 time 0.00752 [TensorRT] VERBOSE: Tactic: 23 time 0.009568 [TensorRT] VERBOSE: Tactic: 24 time 0.009408 [TensorRT] VERBOSE: Tactic: 25 time 0.007744 [TensorRT] VERBOSE: Tactic: 26 time 0.007168 [TensorRT] VERBOSE: Tactic: 27 time 0.00816 [TensorRT] VERBOSE: Tactic: 29 time 0.027008 [TensorRT] VERBOSE: Tactic: 30 time 0.015648 [TensorRT] VERBOSE: Tactic: 31 time 0.012576 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.007168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.248832 [TensorRT] VERBOSE: Tactic: 720895 time 0.244384 [TensorRT] VERBOSE: Tactic: 983039 time 0.212896 [TensorRT] VERBOSE: Tactic: 1048575 time 0.263712 [TensorRT] VERBOSE: Tactic: 1703935 time 0.251872 [TensorRT] VERBOSE: Tactic: 1769471 time 0.261152 [TensorRT] VERBOSE: Tactic: 1966079 time 0.296352 [TensorRT] VERBOSE: Tactic: 2031615 time 0.316896 [TensorRT] VERBOSE: Tactic: 2228223 time 0.292864 [TensorRT] VERBOSE: Tactic: 2424831 time 0.253792 [TensorRT] VERBOSE: Tactic: 2621439 time 0.278976 [TensorRT] VERBOSE: Tactic: 2752511 time 0.270336 [TensorRT] VERBOSE: Tactic: 2818047 time 0.268096 [TensorRT] VERBOSE: Tactic: 2883583 time 0.33984 [TensorRT] VERBOSE: Tactic: 3014655 time 0.234368 [TensorRT] VERBOSE: Tactic: 3145727 time 0.210848 [TensorRT] VERBOSE: Tactic: 3473407 time 0.2472 [TensorRT] VERBOSE: Tactic: 3604479 time 0.232096 [TensorRT] VERBOSE: Tactic: 3735551 time 0.287552 [TensorRT] VERBOSE: Tactic: 4390911 time 0.308416 [TensorRT] VERBOSE: Tactic: 5046271 time 0.251904 [TensorRT] VERBOSE: Tactic: 5963775 time 0.276096 [TensorRT] VERBOSE: Tactic: 6160383 time 0.247552 [TensorRT] VERBOSE: Tactic: 6488063 time 0.2136 [TensorRT] VERBOSE: Tactic: 6881279 time 0.274336 [TensorRT] VERBOSE: Tactic: 7274495 time 0.245568 [TensorRT] VERBOSE: Tactic: 7864319 time 0.233056 [TensorRT] VERBOSE: Tactic: 7995391 time 0.250624 [TensorRT] VERBOSE: Tactic: 8585215 time 0.248096 [TensorRT] VERBOSE: Tactic: 8847359 time 0.273664 [TensorRT] VERBOSE: Tactic: 8978431 time 0.281152 [TensorRT] VERBOSE: Tactic: 9043967 time 0.212768 [TensorRT] VERBOSE: Tactic: 9175039 time 0.229248 [TensorRT] VERBOSE: Tactic: 9502719 time 0.309312 [TensorRT] VERBOSE: Tactic: 9830399 time 0.231968 [TensorRT] VERBOSE: Tactic: 9961471 time 0.281056 [TensorRT] VERBOSE: Tactic: 10027007 time 0.22096 [TensorRT] VERBOSE: Tactic: 10092543 time 0.310272 [TensorRT] VERBOSE: Tactic: 10289151 time 0.296576 [TensorRT] VERBOSE: Tactic: 10485759 time 0.220768 [TensorRT] VERBOSE: Tactic: 10682367 time 0.253952 [TensorRT] VERBOSE: Tactic: 10813439 time 0.226016 [TensorRT] VERBOSE: Fastest Tactic: 3145727 Time: 0.210848 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.238912 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.125536 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.238592 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.23552 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.24144 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.238624 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.248416 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.249152 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.28656 [TensorRT] VERBOSE: Fastest Tactic: 2775507031594384867 Time: 0.125536 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.346112 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 3612672, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 72417280, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 1638912, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 1987584, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.346112 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.069152 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.071904 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.080704 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.072608 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.070624 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.083296 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.07168 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.070496 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.069056 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.069312 [TensorRT] VERBOSE: Fastest Tactic: -4973811344878172338 Time: 0.069056 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4973811344878172338 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.06656 [TensorRT] VERBOSE: Tactic: 720895 time 0.075936 [TensorRT] VERBOSE: Tactic: 983039 time 0.057824 [TensorRT] VERBOSE: Tactic: 1048575 time 0.072768 [TensorRT] VERBOSE: Tactic: 1703935 time 0.074496 [TensorRT] VERBOSE: Tactic: 1769471 time 0.073632 [TensorRT] VERBOSE: Tactic: 1966079 time 0.07248 [TensorRT] VERBOSE: Tactic: 2031615 time 0.083712 [TensorRT] VERBOSE: Tactic: 2228223 time 0.11024 [TensorRT] VERBOSE: Tactic: 2424831 time 0.116736 [TensorRT] VERBOSE: Tactic: 2621439 time 0.079872 [TensorRT] VERBOSE: Tactic: 2752511 time 0.079328 [TensorRT] VERBOSE: Tactic: 2818047 time 0.063808 [TensorRT] VERBOSE: Tactic: 2883583 time 0.089152 [TensorRT] VERBOSE: Tactic: 3014655 time 0.072448 [TensorRT] VERBOSE: Tactic: 3145727 time 0.061696 [TensorRT] VERBOSE: Tactic: 3473407 time 0.068192 [TensorRT] VERBOSE: Tactic: 3604479 time 0.061824 [TensorRT] VERBOSE: Tactic: 3735551 time 0.066144 [TensorRT] VERBOSE: Tactic: 4390911 time 0.078944 [TensorRT] VERBOSE: Tactic: 5046271 time 0.069888 [TensorRT] VERBOSE: Tactic: 5963775 time 0.069088 [TensorRT] VERBOSE: Tactic: 6160383 time 0.144384 [TensorRT] VERBOSE: Tactic: 6488063 time 0.074784 [TensorRT] VERBOSE: Tactic: 6881279 time 0.075712 [TensorRT] VERBOSE: Tactic: 7274495 time 0.066144 [TensorRT] VERBOSE: Tactic: 7864319 time 0.071008 [TensorRT] VERBOSE: Tactic: 7995391 time 0.068256 [TensorRT] VERBOSE: Tactic: 8585215 time 0.068864 [TensorRT] VERBOSE: Tactic: 8847359 time 0.066432 [TensorRT] VERBOSE: Tactic: 8978431 time 0.065472 [TensorRT] VERBOSE: Tactic: 9043967 time 0.063008 [TensorRT] VERBOSE: Tactic: 9175039 time 0.061184 [TensorRT] VERBOSE: Tactic: 9502719 time 0.0808 [TensorRT] VERBOSE: Tactic: 9830399 time 0.0648 [TensorRT] VERBOSE: Tactic: 9961471 time 0.102048 [TensorRT] VERBOSE: Tactic: 10027007 time 0.065824 [TensorRT] VERBOSE: Tactic: 10092543 time 0.07824 [TensorRT] VERBOSE: Tactic: 10289151 time 0.07264 [TensorRT] VERBOSE: Tactic: 10485759 time 0.06656 [TensorRT] VERBOSE: Tactic: 10682367 time 0.070144 [TensorRT] VERBOSE: Tactic: 10813439 time 0.060928 [TensorRT] VERBOSE: Fastest Tactic: 983039 Time: 0.057824 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.067904 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.065472 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.069312 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.064448 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.077984 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.062688 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.071296 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.065312 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.067968 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.06656 [TensorRT] VERBOSE: Fastest Tactic: -7210942453088153035 Time: 0.062688 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 983039 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.069344 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.07824 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.065664 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.071488 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.065984 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.067136 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.063072 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.069152 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.064448 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.065568 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.063072 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.065984 [TensorRT] VERBOSE: Tactic: 720895 time 0.066944 [TensorRT] VERBOSE: Tactic: 983039 time 0.054976 [TensorRT] VERBOSE: Tactic: 1048575 time 0.073728 [TensorRT] VERBOSE: Tactic: 1703935 time 0.074752 [TensorRT] VERBOSE: Tactic: 1769471 time 0.071136 [TensorRT] VERBOSE: Tactic: 1966079 time 0.070432 [TensorRT] VERBOSE: Tactic: 2031615 time 0.080576 [TensorRT] VERBOSE: Tactic: 2228223 time 0.112896 [TensorRT] VERBOSE: Tactic: 2424831 time 0.121696 [TensorRT] VERBOSE: Tactic: 2621439 time 0.07616 [TensorRT] VERBOSE: Tactic: 2752511 time 0.076608 [TensorRT] VERBOSE: Tactic: 2818047 time 0.06672 [TensorRT] VERBOSE: Tactic: 2883583 time 0.082208 [TensorRT] VERBOSE: Tactic: 3014655 time 0.074688 [TensorRT] VERBOSE: Tactic: 3145727 time 0.060736 [TensorRT] VERBOSE: Tactic: 3473407 time 0.065088 [TensorRT] VERBOSE: Tactic: 3604479 time 0.061568 [TensorRT] VERBOSE: Tactic: 3735551 time 0.062496 [TensorRT] VERBOSE: Tactic: 4390911 time 0.078176 [TensorRT] VERBOSE: Tactic: 5046271 time 0.07104 [TensorRT] VERBOSE: Tactic: 5963775 time 0.066528 [TensorRT] VERBOSE: Tactic: 6160383 time 0.154976 [TensorRT] VERBOSE: Tactic: 6488063 time 0.074848 [TensorRT] VERBOSE: Tactic: 6881279 time 0.074112 [TensorRT] VERBOSE: Tactic: 7274495 time 0.06416 [TensorRT] VERBOSE: Tactic: 7864319 time 0.071616 [TensorRT] VERBOSE: Tactic: 7995391 time 0.066016 [TensorRT] VERBOSE: Tactic: 8585215 time 0.07216 [TensorRT] VERBOSE: Tactic: 8847359 time 0.064896 [TensorRT] VERBOSE: Tactic: 8978431 time 0.063424 [TensorRT] VERBOSE: Tactic: 9043967 time 0.062432 [TensorRT] VERBOSE: Tactic: 9175039 time 0.063104 [TensorRT] VERBOSE: Tactic: 9502719 time 0.08048 [TensorRT] VERBOSE: Tactic: 9830399 time 0.061632 [TensorRT] VERBOSE: Tactic: 9961471 time 0.112288 [TensorRT] VERBOSE: Tactic: 10027007 time 0.067328 [TensorRT] VERBOSE: Tactic: 10092543 time 0.079872 [TensorRT] VERBOSE: Tactic: 10289151 time 0.073152 [TensorRT] VERBOSE: Tactic: 10485759 time 0.0664 [TensorRT] VERBOSE: Tactic: 10682367 time 0.071744 [TensorRT] VERBOSE: Tactic: 10813439 time 0.059648 [TensorRT] VERBOSE: Fastest Tactic: 983039 Time: 0.054976 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.024608 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.028576 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.037728 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.025376 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.02544 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.02656 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.03808 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.0272 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.027648 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.023552 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.037664 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.023744 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023968 [TensorRT] VERBOSE: Tactic: 256 time 0.02384 [TensorRT] VERBOSE: Tactic: 512 time 0.024864 [TensorRT] VERBOSE: Tactic: -32 time 0.052224 [TensorRT] VERBOSE: Tactic: -64 time 0.033184 [TensorRT] VERBOSE: Tactic: -128 time 0.03184 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.02384 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.015712 [TensorRT] VERBOSE: Tactic: 1 time 0.01472 [TensorRT] VERBOSE: Tactic: 2 time 0.015072 [TensorRT] VERBOSE: Tactic: 3 time 0.01648 [TensorRT] VERBOSE: Tactic: 4 time 0.01472 [TensorRT] VERBOSE: Tactic: 5 time 0.014272 [TensorRT] VERBOSE: Tactic: 6 time 0.015552 [TensorRT] VERBOSE: Tactic: 7 time 0.014688 [TensorRT] VERBOSE: Tactic: 8 time 0.014528 [TensorRT] VERBOSE: Tactic: 9 time 0.01632 [TensorRT] VERBOSE: Tactic: 28 time 0.01568 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.014272 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024192 [TensorRT] VERBOSE: Tactic: 256 time 0.024512 [TensorRT] VERBOSE: Tactic: 512 time 0.02544 [TensorRT] VERBOSE: Tactic: -32 time 0.053568 [TensorRT] VERBOSE: Tactic: -64 time 0.0368 [TensorRT] VERBOSE: Tactic: -128 time 0.031744 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.024192 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.023456 [TensorRT] VERBOSE: Tactic: 25 time 0.024608 [TensorRT] VERBOSE: Tactic: 26 time 0.02288 [TensorRT] VERBOSE: Tactic: 27 time 0.023232 [TensorRT] VERBOSE: Tactic: 31 time 0.0224 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.0224 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02672 [TensorRT] VERBOSE: Tactic: 256 time 0.027648 [TensorRT] VERBOSE: Tactic: 512 time 0.02848 [TensorRT] VERBOSE: Tactic: -32 time 0.036256 [TensorRT] VERBOSE: Tactic: -64 time 0.040224 [TensorRT] VERBOSE: Tactic: -128 time 0.04112 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.02672 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.010592 [TensorRT] VERBOSE: Tactic: 1 time 0.010176 [TensorRT] VERBOSE: Tactic: 2 time 0.010752 [TensorRT] VERBOSE: Tactic: 3 time 0.009216 [TensorRT] VERBOSE: Tactic: 4 time 0.00992 [TensorRT] VERBOSE: Tactic: 5 time 0.012448 [TensorRT] VERBOSE: Tactic: 6 time 0.01104 [TensorRT] VERBOSE: Tactic: 7 time 0.009248 [TensorRT] VERBOSE: Tactic: 8 time 0.009888 [TensorRT] VERBOSE: Tactic: 9 time 0.016896 [TensorRT] VERBOSE: Tactic: 10 time 0.014208 [TensorRT] VERBOSE: Tactic: 11 time 0.012416 [TensorRT] VERBOSE: Tactic: 12 time 0.012032 [TensorRT] VERBOSE: Tactic: 13 time 0.01104 [TensorRT] VERBOSE: Tactic: 14 time 0.011552 [TensorRT] VERBOSE: Tactic: 15 time 0.013184 [TensorRT] VERBOSE: Tactic: 16 time 0.010592 [TensorRT] VERBOSE: Tactic: 17 time 0.011072 [TensorRT] VERBOSE: Tactic: 18 time 0.012768 [TensorRT] VERBOSE: Tactic: 19 time 0.016096 [TensorRT] VERBOSE: Tactic: 20 time 0.02096 [TensorRT] VERBOSE: Tactic: 21 time 0.016384 [TensorRT] VERBOSE: Tactic: 22 time 0.013312 [TensorRT] VERBOSE: Tactic: 23 time 0.012288 [TensorRT] VERBOSE: Tactic: 28 time 0.0152 [TensorRT] VERBOSE: Tactic: 29 time 0.01552 [TensorRT] VERBOSE: Tactic: 30 time 0.02048 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.027776 [TensorRT] VERBOSE: Tactic: 256 time 0.027008 [TensorRT] VERBOSE: Tactic: 512 time 0.028384 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027008 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.010592 [TensorRT] VERBOSE: Tactic: 11 time 0.011136 [TensorRT] VERBOSE: Tactic: 12 time 0.010496 [TensorRT] VERBOSE: Tactic: 13 time 0.014208 [TensorRT] VERBOSE: Tactic: 14 time 0.011488 [TensorRT] VERBOSE: Tactic: 15 time 0.016096 [TensorRT] VERBOSE: Tactic: 16 time 0.02112 [TensorRT] VERBOSE: Tactic: 17 time 0.017312 [TensorRT] VERBOSE: Tactic: 18 time 0.017472 [TensorRT] VERBOSE: Tactic: 19 time 0.023456 [TensorRT] VERBOSE: Tactic: 20 time 0.010976 [TensorRT] VERBOSE: Tactic: 21 time 0.00976 [TensorRT] VERBOSE: Tactic: 22 time 0.010752 [TensorRT] VERBOSE: Tactic: 23 time 0.013984 [TensorRT] VERBOSE: Tactic: 24 time 0.011424 [TensorRT] VERBOSE: Tactic: 25 time 0.010176 [TensorRT] VERBOSE: Tactic: 26 time 0.009216 [TensorRT] VERBOSE: Tactic: 27 time 0.012288 [TensorRT] VERBOSE: Tactic: 29 time 0.040128 [TensorRT] VERBOSE: Tactic: 30 time 0.023552 [TensorRT] VERBOSE: Tactic: 31 time 0.015904 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.024448 [TensorRT] VERBOSE: Tactic: 0 time 0.048224 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02656 [TensorRT] VERBOSE: Tactic: 0 time 0.00752 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00752 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02528 [TensorRT] VERBOSE: Tactic: 0 time 0.031584 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02528 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040704 [TensorRT] VERBOSE: Tactic: 0 time 0.024736 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024736 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028288 [TensorRT] VERBOSE: Tactic: 0 time 0.02048 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02048 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0256 [TensorRT] VERBOSE: Tactic: 0 time 0.039296 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.0256 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026848 [TensorRT] VERBOSE: Tactic: 0 time 0.00944 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00944 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026432 [TensorRT] VERBOSE: Tactic: 0 time 0.048 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026432 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025504 [TensorRT] VERBOSE: Tactic: 0 time 0.007648 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007648 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0256 [TensorRT] VERBOSE: Tactic: 0 time 0.015744 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015744 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0256 [TensorRT] VERBOSE: Tactic: 0 time 0.048128 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.0256 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027232 [TensorRT] VERBOSE: Tactic: 0 time 0.016544 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016544 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019328 [TensorRT] VERBOSE: Tactic: 256 time 0.019456 [TensorRT] VERBOSE: Tactic: 512 time 0.019872 [TensorRT] VERBOSE: Tactic: -32 time 0.041984 [TensorRT] VERBOSE: Tactic: -64 time 0.028672 [TensorRT] VERBOSE: Tactic: -128 time 0.026336 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019328 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013088 [TensorRT] VERBOSE: Tactic: 1 time 0.012128 [TensorRT] VERBOSE: Tactic: 2 time 0.011136 [TensorRT] VERBOSE: Tactic: 3 time 0.012192 [TensorRT] VERBOSE: Tactic: 4 time 0.011264 [TensorRT] VERBOSE: Tactic: 5 time 0.0104 [TensorRT] VERBOSE: Tactic: 6 time 0.012736 [TensorRT] VERBOSE: Tactic: 7 time 0.011744 [TensorRT] VERBOSE: Tactic: 8 time 0.011616 [TensorRT] VERBOSE: Tactic: 9 time 0.012224 [TensorRT] VERBOSE: Tactic: 28 time 0.013152 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.0104 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019424 [TensorRT] VERBOSE: Tactic: 256 time 0.020192 [TensorRT] VERBOSE: Tactic: 512 time 0.019968 [TensorRT] VERBOSE: Tactic: -32 time 0.042592 [TensorRT] VERBOSE: Tactic: -64 time 0.028256 [TensorRT] VERBOSE: Tactic: -128 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019424 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.015136 [TensorRT] VERBOSE: Tactic: 25 time 0.014976 [TensorRT] VERBOSE: Tactic: 26 time 0.014336 [TensorRT] VERBOSE: Tactic: 27 time 0.014496 [TensorRT] VERBOSE: Tactic: 31 time 0.016096 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.014336 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023584 [TensorRT] VERBOSE: Tactic: 256 time 0.02208 [TensorRT] VERBOSE: Tactic: 512 time 0.02192 [TensorRT] VERBOSE: Tactic: -32 time 0.026784 [TensorRT] VERBOSE: Tactic: -64 time 0.030144 [TensorRT] VERBOSE: Tactic: -128 time 0.031744 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.02192 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.0088 [TensorRT] VERBOSE: Tactic: 1 time 0.007744 [TensorRT] VERBOSE: Tactic: 2 time 0.007072 [TensorRT] VERBOSE: Tactic: 3 time 0.00752 [TensorRT] VERBOSE: Tactic: 4 time 0.007712 [TensorRT] VERBOSE: Tactic: 5 time 0.008096 [TensorRT] VERBOSE: Tactic: 6 time 0.007872 [TensorRT] VERBOSE: Tactic: 7 time 0.007712 [TensorRT] VERBOSE: Tactic: 8 time 0.00816 [TensorRT] VERBOSE: Tactic: 9 time 0.009504 [TensorRT] VERBOSE: Tactic: 10 time 0.012608 [TensorRT] VERBOSE: Tactic: 11 time 0.010976 [TensorRT] VERBOSE: Tactic: 12 time 0.009536 [TensorRT] VERBOSE: Tactic: 13 time 0.009408 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.008192 [TensorRT] VERBOSE: Tactic: 16 time 0.00928 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.009216 [TensorRT] VERBOSE: Tactic: 19 time 0.009216 [TensorRT] VERBOSE: Tactic: 20 time 0.018656 [TensorRT] VERBOSE: Tactic: 21 time 0.013952 [TensorRT] VERBOSE: Tactic: 22 time 0.011008 [TensorRT] VERBOSE: Tactic: 23 time 0.01024 [TensorRT] VERBOSE: Tactic: 28 time 0.011264 [TensorRT] VERBOSE: Tactic: 29 time 0.012576 [TensorRT] VERBOSE: Tactic: 30 time 0.018976 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.007072 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022144 [TensorRT] VERBOSE: Tactic: 256 time 0.020928 [TensorRT] VERBOSE: Tactic: 512 time 0.02208 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.020928 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007776 [TensorRT] VERBOSE: Tactic: 11 time 0.00784 [TensorRT] VERBOSE: Tactic: 12 time 0.008192 [TensorRT] VERBOSE: Tactic: 13 time 0.009632 [TensorRT] VERBOSE: Tactic: 14 time 0.009248 [TensorRT] VERBOSE: Tactic: 15 time 0.010976 [TensorRT] VERBOSE: Tactic: 16 time 0.01424 [TensorRT] VERBOSE: Tactic: 17 time 0.01408 [TensorRT] VERBOSE: Tactic: 18 time 0.015008 [TensorRT] VERBOSE: Tactic: 19 time 0.015776 [TensorRT] VERBOSE: Tactic: 20 time 0.008064 [TensorRT] VERBOSE: Tactic: 21 time 0.007584 [TensorRT] VERBOSE: Tactic: 22 time 0.007552 [TensorRT] VERBOSE: Tactic: 23 time 0.010592 [TensorRT] VERBOSE: Tactic: 24 time 0.009184 [TensorRT] VERBOSE: Tactic: 25 time 0.007648 [TensorRT] VERBOSE: Tactic: 26 time 0.00768 [TensorRT] VERBOSE: Tactic: 27 time 0.009472 [TensorRT] VERBOSE: Tactic: 29 time 0.026976 [TensorRT] VERBOSE: Tactic: 30 time 0.01584 [TensorRT] VERBOSE: Tactic: 31 time 0.010976 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.007552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_85 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_85 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_85 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_85 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_85 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024672 [TensorRT] VERBOSE: Tactic: 256 time 0.024288 [TensorRT] VERBOSE: Tactic: 512 time 0.024608 [TensorRT] VERBOSE: Tactic: -32 time 0.053632 [TensorRT] VERBOSE: Tactic: -64 time 0.033952 [TensorRT] VERBOSE: Tactic: -128 time 0.031712 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.024288 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.015456 [TensorRT] VERBOSE: Tactic: 1 time 0.0152 [TensorRT] VERBOSE: Tactic: 2 time 0.014816 [TensorRT] VERBOSE: Tactic: 3 time 0.01632 [TensorRT] VERBOSE: Tactic: 4 time 0.014752 [TensorRT] VERBOSE: Tactic: 5 time 0.014752 [TensorRT] VERBOSE: Tactic: 6 time 0.01664 [TensorRT] VERBOSE: Tactic: 7 time 0.01536 [TensorRT] VERBOSE: Tactic: 8 time 0.01536 [TensorRT] VERBOSE: Tactic: 9 time 0.01536 [TensorRT] VERBOSE: Tactic: 28 time 0.014656 [TensorRT] VERBOSE: Fastest Tactic: 28 Time: 0.014656 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023456 [TensorRT] VERBOSE: Tactic: 256 time 0.024928 [TensorRT] VERBOSE: Tactic: 512 time 0.024704 [TensorRT] VERBOSE: Tactic: -32 time 0.051808 [TensorRT] VERBOSE: Tactic: -64 time 0.035424 [TensorRT] VERBOSE: Tactic: -128 time 0.03152 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023456 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.022592 [TensorRT] VERBOSE: Tactic: 25 time 0.023808 [TensorRT] VERBOSE: Tactic: 26 time 0.023168 [TensorRT] VERBOSE: Tactic: 27 time 0.023616 [TensorRT] VERBOSE: Tactic: 31 time 0.022464 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.022464 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028672 [TensorRT] VERBOSE: Tactic: 256 time 0.027456 [TensorRT] VERBOSE: Tactic: 512 time 0.028256 [TensorRT] VERBOSE: Tactic: -32 time 0.036 [TensorRT] VERBOSE: Tactic: -64 time 0.04 [TensorRT] VERBOSE: Tactic: -128 time 0.041792 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027456 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.011264 [TensorRT] VERBOSE: Tactic: 1 time 0.009728 [TensorRT] VERBOSE: Tactic: 2 time 0.010624 [TensorRT] VERBOSE: Tactic: 3 time 0.009344 [TensorRT] VERBOSE: Tactic: 4 time 0.00992 [TensorRT] VERBOSE: Tactic: 5 time 0.01248 [TensorRT] VERBOSE: Tactic: 6 time 0.011072 [TensorRT] VERBOSE: Tactic: 7 time 0.009312 [TensorRT] VERBOSE: Tactic: 8 time 0.01008 [TensorRT] VERBOSE: Tactic: 9 time 0.015712 [TensorRT] VERBOSE: Tactic: 10 time 0.013824 [TensorRT] VERBOSE: Tactic: 11 time 0.012448 [TensorRT] VERBOSE: Tactic: 12 time 0.01152 [TensorRT] VERBOSE: Tactic: 13 time 0.010912 [TensorRT] VERBOSE: Tactic: 14 time 0.01184 [TensorRT] VERBOSE: Tactic: 15 time 0.013056 [TensorRT] VERBOSE: Tactic: 16 time 0.01056 [TensorRT] VERBOSE: Tactic: 17 time 0.011168 [TensorRT] VERBOSE: Tactic: 18 time 0.012864 [TensorRT] VERBOSE: Tactic: 19 time 0.014432 [TensorRT] VERBOSE: Tactic: 20 time 0.022176 [TensorRT] VERBOSE: Tactic: 21 time 0.016384 [TensorRT] VERBOSE: Tactic: 22 time 0.014112 [TensorRT] VERBOSE: Tactic: 23 time 0.011328 [TensorRT] VERBOSE: Tactic: 28 time 0.014784 [TensorRT] VERBOSE: Tactic: 29 time 0.015744 [TensorRT] VERBOSE: Tactic: 30 time 0.020704 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.009312 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028448 [TensorRT] VERBOSE: Tactic: 256 time 0.026944 [TensorRT] VERBOSE: Tactic: 512 time 0.02848 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.026944 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.01072 [TensorRT] VERBOSE: Tactic: 11 time 0.01104 [TensorRT] VERBOSE: Tactic: 12 time 0.010336 [TensorRT] VERBOSE: Tactic: 13 time 0.013856 [TensorRT] VERBOSE: Tactic: 14 time 0.01136 [TensorRT] VERBOSE: Tactic: 15 time 0.016416 [TensorRT] VERBOSE: Tactic: 16 time 0.021568 [TensorRT] VERBOSE: Tactic: 17 time 0.016384 [TensorRT] VERBOSE: Tactic: 18 time 0.017888 [TensorRT] VERBOSE: Tactic: 19 time 0.022144 [TensorRT] VERBOSE: Tactic: 20 time 0.011104 [TensorRT] VERBOSE: Tactic: 21 time 0.009568 [TensorRT] VERBOSE: Tactic: 22 time 0.01088 [TensorRT] VERBOSE: Tactic: 23 time 0.013984 [TensorRT] VERBOSE: Tactic: 24 time 0.010336 [TensorRT] VERBOSE: Tactic: 25 time 0.01008 [TensorRT] VERBOSE: Tactic: 26 time 0.009504 [TensorRT] VERBOSE: Tactic: 27 time 0.012256 [TensorRT] VERBOSE: Tactic: 29 time 0.039936 [TensorRT] VERBOSE: Tactic: 30 time 0.022528 [TensorRT] VERBOSE: Tactic: 31 time 0.016512 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.009504 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019104 [TensorRT] VERBOSE: Tactic: 256 time 0.019456 [TensorRT] VERBOSE: Tactic: 512 time 0.02032 [TensorRT] VERBOSE: Tactic: -32 time 0.042368 [TensorRT] VERBOSE: Tactic: -64 time 0.027392 [TensorRT] VERBOSE: Tactic: -128 time 0.026176 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019104 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.012896 [TensorRT] VERBOSE: Tactic: 1 time 0.011744 [TensorRT] VERBOSE: Tactic: 2 time 0.010816 [TensorRT] VERBOSE: Tactic: 3 time 0.012448 [TensorRT] VERBOSE: Tactic: 4 time 0.011072 [TensorRT] VERBOSE: Tactic: 5 time 0.011968 [TensorRT] VERBOSE: Tactic: 6 time 0.01232 [TensorRT] VERBOSE: Tactic: 7 time 0.011456 [TensorRT] VERBOSE: Tactic: 8 time 0.011264 [TensorRT] VERBOSE: Tactic: 9 time 0.012192 [TensorRT] VERBOSE: Tactic: 28 time 0.012992 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.010816 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019008 [TensorRT] VERBOSE: Tactic: 256 time 0.019456 [TensorRT] VERBOSE: Tactic: 512 time 0.020352 [TensorRT] VERBOSE: Tactic: -32 time 0.041856 [TensorRT] VERBOSE: Tactic: -64 time 0.029536 [TensorRT] VERBOSE: Tactic: -128 time 0.026016 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019008 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.01504 [TensorRT] VERBOSE: Tactic: 25 time 0.01616 [TensorRT] VERBOSE: Tactic: 26 time 0.0152 [TensorRT] VERBOSE: Tactic: 27 time 0.014944 [TensorRT] VERBOSE: Tactic: 31 time 0.014624 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.014624 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02304 [TensorRT] VERBOSE: Tactic: 256 time 0.021184 [TensorRT] VERBOSE: Tactic: 512 time 0.021888 [TensorRT] VERBOSE: Tactic: -32 time 0.026304 [TensorRT] VERBOSE: Tactic: -64 time 0.029952 [TensorRT] VERBOSE: Tactic: -128 time 0.031744 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021184 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009344 [TensorRT] VERBOSE: Tactic: 1 time 0.007456 [TensorRT] VERBOSE: Tactic: 2 time 0.006848 [TensorRT] VERBOSE: Tactic: 3 time 0.008064 [TensorRT] VERBOSE: Tactic: 4 time 0.007552 [TensorRT] VERBOSE: Tactic: 5 time 0.008448 [TensorRT] VERBOSE: Tactic: 6 time 0.007648 [TensorRT] VERBOSE: Tactic: 7 time 0.007744 [TensorRT] VERBOSE: Tactic: 8 time 0.009216 [TensorRT] VERBOSE: Tactic: 9 time 0.008768 [TensorRT] VERBOSE: Tactic: 10 time 0.01248 [TensorRT] VERBOSE: Tactic: 11 time 0.009856 [TensorRT] VERBOSE: Tactic: 12 time 0.009344 [TensorRT] VERBOSE: Tactic: 13 time 0.009536 [TensorRT] VERBOSE: Tactic: 14 time 0.008704 [TensorRT] VERBOSE: Tactic: 15 time 0.008192 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.00928 [TensorRT] VERBOSE: Tactic: 18 time 0.009248 [TensorRT] VERBOSE: Tactic: 19 time 0.009056 [TensorRT] VERBOSE: Tactic: 20 time 0.018432 [TensorRT] VERBOSE: Tactic: 21 time 0.014112 [TensorRT] VERBOSE: Tactic: 22 time 0.011072 [TensorRT] VERBOSE: Tactic: 23 time 0.010592 [TensorRT] VERBOSE: Tactic: 28 time 0.010816 [TensorRT] VERBOSE: Tactic: 29 time 0.012608 [TensorRT] VERBOSE: Tactic: 30 time 0.01872 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006848 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022432 [TensorRT] VERBOSE: Tactic: 256 time 0.021952 [TensorRT] VERBOSE: Tactic: 512 time 0.02224 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021952 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007936 [TensorRT] VERBOSE: Tactic: 11 time 0.008064 [TensorRT] VERBOSE: Tactic: 12 time 0.008064 [TensorRT] VERBOSE: Tactic: 13 time 0.009344 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.0112 [TensorRT] VERBOSE: Tactic: 16 time 0.014368 [TensorRT] VERBOSE: Tactic: 17 time 0.01392 [TensorRT] VERBOSE: Tactic: 18 time 0.014688 [TensorRT] VERBOSE: Tactic: 19 time 0.015744 [TensorRT] VERBOSE: Tactic: 20 time 0.008064 [TensorRT] VERBOSE: Tactic: 21 time 0.007296 [TensorRT] VERBOSE: Tactic: 22 time 0.00768 [TensorRT] VERBOSE: Tactic: 23 time 0.009888 [TensorRT] VERBOSE: Tactic: 24 time 0.008384 [TensorRT] VERBOSE: Tactic: 25 time 0.007648 [TensorRT] VERBOSE: Tactic: 26 time 0.007776 [TensorRT] VERBOSE: Tactic: 27 time 0.007904 [TensorRT] VERBOSE: Tactic: 29 time 0.027008 [TensorRT] VERBOSE: Tactic: 30 time 0.015648 [TensorRT] VERBOSE: Tactic: 31 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.007296 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_90 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_90 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_90 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_90 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_90 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023872 [TensorRT] VERBOSE: Tactic: 256 time 0.024096 [TensorRT] VERBOSE: Tactic: 512 time 0.024768 [TensorRT] VERBOSE: Tactic: -32 time 0.051104 [TensorRT] VERBOSE: Tactic: -64 time 0.033856 [TensorRT] VERBOSE: Tactic: -128 time 0.03168 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023872 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014464 [TensorRT] VERBOSE: Tactic: 1 time 0.0152 [TensorRT] VERBOSE: Tactic: 2 time 0.014752 [TensorRT] VERBOSE: Tactic: 3 time 0.015776 [TensorRT] VERBOSE: Tactic: 4 time 0.015776 [TensorRT] VERBOSE: Tactic: 5 time 0.014368 [TensorRT] VERBOSE: Tactic: 6 time 0.015904 [TensorRT] VERBOSE: Tactic: 7 time 0.014848 [TensorRT] VERBOSE: Tactic: 8 time 0.014944 [TensorRT] VERBOSE: Tactic: 9 time 0.015776 [TensorRT] VERBOSE: Tactic: 28 time 0.0144 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.014368 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024896 [TensorRT] VERBOSE: Tactic: 256 time 0.024576 [TensorRT] VERBOSE: Tactic: 512 time 0.026016 [TensorRT] VERBOSE: Tactic: -32 time 0.050368 [TensorRT] VERBOSE: Tactic: -64 time 0.03456 [TensorRT] VERBOSE: Tactic: -128 time 0.0312 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.024576 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.023328 [TensorRT] VERBOSE: Tactic: 25 time 0.023552 [TensorRT] VERBOSE: Tactic: 26 time 0.023936 [TensorRT] VERBOSE: Tactic: 27 time 0.024384 [TensorRT] VERBOSE: Tactic: 31 time 0.02256 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.02256 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.027776 [TensorRT] VERBOSE: Tactic: 256 time 0.027264 [TensorRT] VERBOSE: Tactic: 512 time 0.028672 [TensorRT] VERBOSE: Tactic: -32 time 0.03584 [TensorRT] VERBOSE: Tactic: -64 time 0.039232 [TensorRT] VERBOSE: Tactic: -128 time 0.041024 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027264 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01056 [TensorRT] VERBOSE: Tactic: 1 time 0.009664 [TensorRT] VERBOSE: Tactic: 2 time 0.010784 [TensorRT] VERBOSE: Tactic: 3 time 0.009344 [TensorRT] VERBOSE: Tactic: 4 time 0.010272 [TensorRT] VERBOSE: Tactic: 5 time 0.012512 [TensorRT] VERBOSE: Tactic: 6 time 0.010624 [TensorRT] VERBOSE: Tactic: 7 time 0.010784 [TensorRT] VERBOSE: Tactic: 8 time 0.012736 [TensorRT] VERBOSE: Tactic: 9 time 0.01696 [TensorRT] VERBOSE: Tactic: 10 time 0.014336 [TensorRT] VERBOSE: Tactic: 11 time 0.012864 [TensorRT] VERBOSE: Tactic: 12 time 0.011648 [TensorRT] VERBOSE: Tactic: 13 time 0.010848 [TensorRT] VERBOSE: Tactic: 14 time 0.01152 [TensorRT] VERBOSE: Tactic: 15 time 0.013792 [TensorRT] VERBOSE: Tactic: 16 time 0.010912 [TensorRT] VERBOSE: Tactic: 17 time 0.010688 [TensorRT] VERBOSE: Tactic: 18 time 0.012736 [TensorRT] VERBOSE: Tactic: 19 time 0.015424 [TensorRT] VERBOSE: Tactic: 20 time 0.020928 [TensorRT] VERBOSE: Tactic: 21 time 0.01728 [TensorRT] VERBOSE: Tactic: 22 time 0.013472 [TensorRT] VERBOSE: Tactic: 23 time 0.012384 [TensorRT] VERBOSE: Tactic: 28 time 0.014784 [TensorRT] VERBOSE: Tactic: 29 time 0.015296 [TensorRT] VERBOSE: Tactic: 30 time 0.020576 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.009344 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028384 [TensorRT] VERBOSE: Tactic: 256 time 0.027008 [TensorRT] VERBOSE: Tactic: 512 time 0.02832 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027008 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.010752 [TensorRT] VERBOSE: Tactic: 11 time 0.010816 [TensorRT] VERBOSE: Tactic: 12 time 0.010208 [TensorRT] VERBOSE: Tactic: 13 time 0.014144 [TensorRT] VERBOSE: Tactic: 14 time 0.011232 [TensorRT] VERBOSE: Tactic: 15 time 0.01632 [TensorRT] VERBOSE: Tactic: 16 time 0.021312 [TensorRT] VERBOSE: Tactic: 17 time 0.015968 [TensorRT] VERBOSE: Tactic: 18 time 0.018016 [TensorRT] VERBOSE: Tactic: 19 time 0.021984 [TensorRT] VERBOSE: Tactic: 20 time 0.010912 [TensorRT] VERBOSE: Tactic: 21 time 0.010112 [TensorRT] VERBOSE: Tactic: 22 time 0.01072 [TensorRT] VERBOSE: Tactic: 23 time 0.014272 [TensorRT] VERBOSE: Tactic: 24 time 0.011552 [TensorRT] VERBOSE: Tactic: 25 time 0.009536 [TensorRT] VERBOSE: Tactic: 26 time 0.00944 [TensorRT] VERBOSE: Tactic: 27 time 0.012672 [TensorRT] VERBOSE: Tactic: 29 time 0.04096 [TensorRT] VERBOSE: Tactic: 30 time 0.02336 [TensorRT] VERBOSE: Tactic: 31 time 0.015744 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.00944 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019968 [TensorRT] VERBOSE: Tactic: 256 time 0.019424 [TensorRT] VERBOSE: Tactic: 512 time 0.01968 [TensorRT] VERBOSE: Tactic: -32 time 0.042464 [TensorRT] VERBOSE: Tactic: -64 time 0.026528 [TensorRT] VERBOSE: Tactic: -128 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.019424 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.012992 [TensorRT] VERBOSE: Tactic: 1 time 0.01312 [TensorRT] VERBOSE: Tactic: 2 time 0.011232 [TensorRT] VERBOSE: Tactic: 3 time 0.01232 [TensorRT] VERBOSE: Tactic: 4 time 0.01072 [TensorRT] VERBOSE: Tactic: 5 time 0.011552 [TensorRT] VERBOSE: Tactic: 6 time 0.012832 [TensorRT] VERBOSE: Tactic: 7 time 0.011264 [TensorRT] VERBOSE: Tactic: 8 time 0.011264 [TensorRT] VERBOSE: Tactic: 9 time 0.012192 [TensorRT] VERBOSE: Tactic: 28 time 0.012512 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.01072 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01872 [TensorRT] VERBOSE: Tactic: 256 time 0.019392 [TensorRT] VERBOSE: Tactic: 512 time 0.019648 [TensorRT] VERBOSE: Tactic: -32 time 0.042784 [TensorRT] VERBOSE: Tactic: -64 time 0.026848 [TensorRT] VERBOSE: Tactic: -128 time 0.025792 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01872 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014688 [TensorRT] VERBOSE: Tactic: 25 time 0.017088 [TensorRT] VERBOSE: Tactic: 26 time 0.013792 [TensorRT] VERBOSE: Tactic: 27 time 0.013728 [TensorRT] VERBOSE: Tactic: 31 time 0.015456 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.013728 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022528 [TensorRT] VERBOSE: Tactic: 256 time 0.021216 [TensorRT] VERBOSE: Tactic: 512 time 0.022208 [TensorRT] VERBOSE: Tactic: -32 time 0.026624 [TensorRT] VERBOSE: Tactic: -64 time 0.030144 [TensorRT] VERBOSE: Tactic: -128 time 0.030912 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021216 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009184 [TensorRT] VERBOSE: Tactic: 1 time 0.007648 [TensorRT] VERBOSE: Tactic: 2 time 0.006848 [TensorRT] VERBOSE: Tactic: 3 time 0.007968 [TensorRT] VERBOSE: Tactic: 4 time 0.007456 [TensorRT] VERBOSE: Tactic: 5 time 0.00704 [TensorRT] VERBOSE: Tactic: 6 time 0.007392 [TensorRT] VERBOSE: Tactic: 7 time 0.008352 [TensorRT] VERBOSE: Tactic: 8 time 0.009376 [TensorRT] VERBOSE: Tactic: 9 time 0.008256 [TensorRT] VERBOSE: Tactic: 10 time 0.012512 [TensorRT] VERBOSE: Tactic: 11 time 0.011136 [TensorRT] VERBOSE: Tactic: 12 time 0.009312 [TensorRT] VERBOSE: Tactic: 13 time 0.009248 [TensorRT] VERBOSE: Tactic: 14 time 0.009312 [TensorRT] VERBOSE: Tactic: 15 time 0.008128 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009504 [TensorRT] VERBOSE: Tactic: 18 time 0.008608 [TensorRT] VERBOSE: Tactic: 19 time 0.009152 [TensorRT] VERBOSE: Tactic: 20 time 0.019008 [TensorRT] VERBOSE: Tactic: 21 time 0.013856 [TensorRT] VERBOSE: Tactic: 22 time 0.010784 [TensorRT] VERBOSE: Tactic: 23 time 0.010784 [TensorRT] VERBOSE: Tactic: 28 time 0.01072 [TensorRT] VERBOSE: Tactic: 29 time 0.01248 [TensorRT] VERBOSE: Tactic: 30 time 0.018848 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006848 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023456 [TensorRT] VERBOSE: Tactic: 256 time 0.02176 [TensorRT] VERBOSE: Tactic: 512 time 0.021856 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.02176 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007872 [TensorRT] VERBOSE: Tactic: 11 time 0.007488 [TensorRT] VERBOSE: Tactic: 12 time 0.007808 [TensorRT] VERBOSE: Tactic: 13 time 0.009728 [TensorRT] VERBOSE: Tactic: 14 time 0.009248 [TensorRT] VERBOSE: Tactic: 15 time 0.011488 [TensorRT] VERBOSE: Tactic: 16 time 0.01408 [TensorRT] VERBOSE: Tactic: 17 time 0.013888 [TensorRT] VERBOSE: Tactic: 18 time 0.014208 [TensorRT] VERBOSE: Tactic: 19 time 0.015968 [TensorRT] VERBOSE: Tactic: 20 time 0.008192 [TensorRT] VERBOSE: Tactic: 21 time 0.007648 [TensorRT] VERBOSE: Tactic: 22 time 0.007552 [TensorRT] VERBOSE: Tactic: 23 time 0.009472 [TensorRT] VERBOSE: Tactic: 24 time 0.009248 [TensorRT] VERBOSE: Tactic: 25 time 0.007712 [TensorRT] VERBOSE: Tactic: 26 time 0.00752 [TensorRT] VERBOSE: Tactic: 27 time 0.00752 [TensorRT] VERBOSE: Tactic: 29 time 0.026912 [TensorRT] VERBOSE: Tactic: 30 time 0.015488 [TensorRT] VERBOSE: Tactic: 31 time 0.01104 [TensorRT] VERBOSE: Fastest Tactic: 11 Time: 0.007488 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_95 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_95 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_95 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_95 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_95 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023552 [TensorRT] VERBOSE: Tactic: 256 time 0.023488 [TensorRT] VERBOSE: Tactic: 512 time 0.025472 [TensorRT] VERBOSE: Tactic: -32 time 0.052512 [TensorRT] VERBOSE: Tactic: -64 time 0.034944 [TensorRT] VERBOSE: Tactic: -128 time 0.032256 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.023488 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.0144 [TensorRT] VERBOSE: Tactic: 1 time 0.014912 [TensorRT] VERBOSE: Tactic: 2 time 0.014272 [TensorRT] VERBOSE: Tactic: 3 time 0.014976 [TensorRT] VERBOSE: Tactic: 4 time 0.01456 [TensorRT] VERBOSE: Tactic: 5 time 0.014784 [TensorRT] VERBOSE: Tactic: 6 time 0.014816 [TensorRT] VERBOSE: Tactic: 7 time 0.015136 [TensorRT] VERBOSE: Tactic: 8 time 0.014432 [TensorRT] VERBOSE: Tactic: 9 time 0.016128 [TensorRT] VERBOSE: Tactic: 28 time 0.014752 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.014272 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024992 [TensorRT] VERBOSE: Tactic: 256 time 0.023552 [TensorRT] VERBOSE: Tactic: 512 time 0.025536 [TensorRT] VERBOSE: Tactic: -32 time 0.050592 [TensorRT] VERBOSE: Tactic: -64 time 0.034176 [TensorRT] VERBOSE: Tactic: -128 time 0.030944 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.022816 [TensorRT] VERBOSE: Tactic: 25 time 0.024576 [TensorRT] VERBOSE: Tactic: 26 time 0.022464 [TensorRT] VERBOSE: Tactic: 27 time 0.023904 [TensorRT] VERBOSE: Tactic: 31 time 0.02256 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.022464 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.027968 [TensorRT] VERBOSE: Tactic: 256 time 0.026912 [TensorRT] VERBOSE: Tactic: 512 time 0.028544 [TensorRT] VERBOSE: Tactic: -32 time 0.03664 [TensorRT] VERBOSE: Tactic: -64 time 0.040064 [TensorRT] VERBOSE: Tactic: -128 time 0.04128 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.026912 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.011488 [TensorRT] VERBOSE: Tactic: 1 time 0.010112 [TensorRT] VERBOSE: Tactic: 2 time 0.011488 [TensorRT] VERBOSE: Tactic: 3 time 0.009472 [TensorRT] VERBOSE: Tactic: 4 time 0.010016 [TensorRT] VERBOSE: Tactic: 5 time 0.012032 [TensorRT] VERBOSE: Tactic: 6 time 0.010976 [TensorRT] VERBOSE: Tactic: 7 time 0.011136 [TensorRT] VERBOSE: Tactic: 8 time 0.012768 [TensorRT] VERBOSE: Tactic: 9 time 0.01728 [TensorRT] VERBOSE: Tactic: 10 time 0.014304 [TensorRT] VERBOSE: Tactic: 11 time 0.012544 [TensorRT] VERBOSE: Tactic: 12 time 0.012 [TensorRT] VERBOSE: Tactic: 13 time 0.010656 [TensorRT] VERBOSE: Tactic: 14 time 0.011264 [TensorRT] VERBOSE: Tactic: 15 time 0.01424 [TensorRT] VERBOSE: Tactic: 16 time 0.010688 [TensorRT] VERBOSE: Tactic: 17 time 0.010784 [TensorRT] VERBOSE: Tactic: 18 time 0.011168 [TensorRT] VERBOSE: Tactic: 19 time 0.015168 [TensorRT] VERBOSE: Tactic: 20 time 0.020832 [TensorRT] VERBOSE: Tactic: 21 time 0.017408 [TensorRT] VERBOSE: Tactic: 22 time 0.013152 [TensorRT] VERBOSE: Tactic: 23 time 0.012416 [TensorRT] VERBOSE: Tactic: 28 time 0.015104 [TensorRT] VERBOSE: Tactic: 29 time 0.014848 [TensorRT] VERBOSE: Tactic: 30 time 0.02064 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.009472 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.027488 [TensorRT] VERBOSE: Tactic: 256 time 0.02752 [TensorRT] VERBOSE: Tactic: 512 time 0.028128 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.027488 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011136 [TensorRT] VERBOSE: Tactic: 11 time 0.011072 [TensorRT] VERBOSE: Tactic: 12 time 0.010848 [TensorRT] VERBOSE: Tactic: 13 time 0.014208 [TensorRT] VERBOSE: Tactic: 14 time 0.011744 [TensorRT] VERBOSE: Tactic: 15 time 0.015744 [TensorRT] VERBOSE: Tactic: 16 time 0.021824 [TensorRT] VERBOSE: Tactic: 17 time 0.016512 [TensorRT] VERBOSE: Tactic: 18 time 0.017632 [TensorRT] VERBOSE: Tactic: 19 time 0.022624 [TensorRT] VERBOSE: Tactic: 20 time 0.010624 [TensorRT] VERBOSE: Tactic: 21 time 0.009312 [TensorRT] VERBOSE: Tactic: 22 time 0.010752 [TensorRT] VERBOSE: Tactic: 23 time 0.014336 [TensorRT] VERBOSE: Tactic: 24 time 0.010592 [TensorRT] VERBOSE: Tactic: 25 time 0.009728 [TensorRT] VERBOSE: Tactic: 26 time 0.009216 [TensorRT] VERBOSE: Tactic: 27 time 0.01216 [TensorRT] VERBOSE: Tactic: 29 time 0.039936 [TensorRT] VERBOSE: Tactic: 30 time 0.02288 [TensorRT] VERBOSE: Tactic: 31 time 0.015584 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 256 time 0.019808 [TensorRT] VERBOSE: Tactic: 512 time 0.019744 [TensorRT] VERBOSE: Tactic: -32 time 0.04304 [TensorRT] VERBOSE: Tactic: -64 time 0.027392 [TensorRT] VERBOSE: Tactic: -128 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019456 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013376 [TensorRT] VERBOSE: Tactic: 1 time 0.01216 [TensorRT] VERBOSE: Tactic: 2 time 0.01264 [TensorRT] VERBOSE: Tactic: 3 time 0.013632 [TensorRT] VERBOSE: Tactic: 4 time 0.011104 [TensorRT] VERBOSE: Tactic: 5 time 0.011264 [TensorRT] VERBOSE: Tactic: 6 time 0.01312 [TensorRT] VERBOSE: Tactic: 7 time 0.011296 [TensorRT] VERBOSE: Tactic: 8 time 0.011264 [TensorRT] VERBOSE: Tactic: 9 time 0.012736 [TensorRT] VERBOSE: Tactic: 28 time 0.012672 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.011104 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01984 [TensorRT] VERBOSE: Tactic: 256 time 0.019616 [TensorRT] VERBOSE: Tactic: 512 time 0.019936 [TensorRT] VERBOSE: Tactic: -32 time 0.042688 [TensorRT] VERBOSE: Tactic: -64 time 0.027424 [TensorRT] VERBOSE: Tactic: -128 time 0.025536 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.019616 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014816 [TensorRT] VERBOSE: Tactic: 25 time 0.015808 [TensorRT] VERBOSE: Tactic: 26 time 0.01424 [TensorRT] VERBOSE: Tactic: 27 time 0.013632 [TensorRT] VERBOSE: Tactic: 31 time 0.014656 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.013632 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022464 [TensorRT] VERBOSE: Tactic: 256 time 0.021376 [TensorRT] VERBOSE: Tactic: 512 time 0.022304 [TensorRT] VERBOSE: Tactic: -32 time 0.02672 [TensorRT] VERBOSE: Tactic: -64 time 0.028896 [TensorRT] VERBOSE: Tactic: -128 time 0.030848 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021376 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009248 [TensorRT] VERBOSE: Tactic: 1 time 0.007552 [TensorRT] VERBOSE: Tactic: 2 time 0.007712 [TensorRT] VERBOSE: Tactic: 3 time 0.007584 [TensorRT] VERBOSE: Tactic: 4 time 0.007712 [TensorRT] VERBOSE: Tactic: 5 time 0.007168 [TensorRT] VERBOSE: Tactic: 6 time 0.007616 [TensorRT] VERBOSE: Tactic: 7 time 0.007584 [TensorRT] VERBOSE: Tactic: 8 time 0.008192 [TensorRT] VERBOSE: Tactic: 9 time 0.008736 [TensorRT] VERBOSE: Tactic: 10 time 0.012416 [TensorRT] VERBOSE: Tactic: 11 time 0.010912 [TensorRT] VERBOSE: Tactic: 12 time 0.009312 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009376 [TensorRT] VERBOSE: Tactic: 15 time 0.008512 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009248 [TensorRT] VERBOSE: Tactic: 18 time 0.009184 [TensorRT] VERBOSE: Tactic: 19 time 0.008512 [TensorRT] VERBOSE: Tactic: 20 time 0.019264 [TensorRT] VERBOSE: Tactic: 21 time 0.014144 [TensorRT] VERBOSE: Tactic: 22 time 0.010784 [TensorRT] VERBOSE: Tactic: 23 time 0.010592 [TensorRT] VERBOSE: Tactic: 28 time 0.011264 [TensorRT] VERBOSE: Tactic: 29 time 0.012576 [TensorRT] VERBOSE: Tactic: 30 time 0.018624 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.007168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.021952 [TensorRT] VERBOSE: Tactic: 256 time 0.021472 [TensorRT] VERBOSE: Tactic: 512 time 0.022304 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021472 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007936 [TensorRT] VERBOSE: Tactic: 11 time 0.007456 [TensorRT] VERBOSE: Tactic: 12 time 0.008064 [TensorRT] VERBOSE: Tactic: 13 time 0.010976 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.011264 [TensorRT] VERBOSE: Tactic: 16 time 0.014048 [TensorRT] VERBOSE: Tactic: 17 time 0.013856 [TensorRT] VERBOSE: Tactic: 18 time 0.014336 [TensorRT] VERBOSE: Tactic: 19 time 0.016064 [TensorRT] VERBOSE: Tactic: 20 time 0.008192 [TensorRT] VERBOSE: Tactic: 21 time 0.007392 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.01072 [TensorRT] VERBOSE: Tactic: 24 time 0.009056 [TensorRT] VERBOSE: Tactic: 25 time 0.007744 [TensorRT] VERBOSE: Tactic: 26 time 0.00752 [TensorRT] VERBOSE: Tactic: 27 time 0.007392 [TensorRT] VERBOSE: Tactic: 29 time 0.027008 [TensorRT] VERBOSE: Tactic: 30 time 0.015808 [TensorRT] VERBOSE: Tactic: 31 time 0.011328 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.007392 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_100 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_100 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_100 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_100 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_100 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024448 [TensorRT] VERBOSE: Tactic: 256 time 0.023744 [TensorRT] VERBOSE: Tactic: 512 time 0.025056 [TensorRT] VERBOSE: Tactic: -32 time 0.052224 [TensorRT] VERBOSE: Tactic: -64 time 0.033984 [TensorRT] VERBOSE: Tactic: -128 time 0.031232 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.023744 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.015104 [TensorRT] VERBOSE: Tactic: 1 time 0.015296 [TensorRT] VERBOSE: Tactic: 2 time 0.014976 [TensorRT] VERBOSE: Tactic: 3 time 0.01536 [TensorRT] VERBOSE: Tactic: 4 time 0.015744 [TensorRT] VERBOSE: Tactic: 5 time 0.014432 [TensorRT] VERBOSE: Tactic: 6 time 0.01536 [TensorRT] VERBOSE: Tactic: 7 time 0.015232 [TensorRT] VERBOSE: Tactic: 8 time 0.014464 [TensorRT] VERBOSE: Tactic: 9 time 0.014848 [TensorRT] VERBOSE: Tactic: 28 time 0.014432 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.014432 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024064 [TensorRT] VERBOSE: Tactic: 256 time 0.023776 [TensorRT] VERBOSE: Tactic: 512 time 0.024544 [TensorRT] VERBOSE: Tactic: -32 time 0.052288 [TensorRT] VERBOSE: Tactic: -64 time 0.033696 [TensorRT] VERBOSE: Tactic: -128 time 0.03168 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.023776 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.023904 [TensorRT] VERBOSE: Tactic: 25 time 0.024256 [TensorRT] VERBOSE: Tactic: 26 time 0.023552 [TensorRT] VERBOSE: Tactic: 27 time 0.022912 [TensorRT] VERBOSE: Tactic: 31 time 0.022048 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.022048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02848 [TensorRT] VERBOSE: Tactic: 256 time 0.026816 [TensorRT] VERBOSE: Tactic: 512 time 0.02832 [TensorRT] VERBOSE: Tactic: -32 time 0.036096 [TensorRT] VERBOSE: Tactic: -64 time 0.03968 [TensorRT] VERBOSE: Tactic: -128 time 0.041888 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.026816 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.010944 [TensorRT] VERBOSE: Tactic: 1 time 0.009792 [TensorRT] VERBOSE: Tactic: 2 time 0.011136 [TensorRT] VERBOSE: Tactic: 3 time 0.00864 [TensorRT] VERBOSE: Tactic: 4 time 0.009696 [TensorRT] VERBOSE: Tactic: 5 time 0.01152 [TensorRT] VERBOSE: Tactic: 6 time 0.00944 [TensorRT] VERBOSE: Tactic: 7 time 0.009216 [TensorRT] VERBOSE: Tactic: 8 time 0.01024 [TensorRT] VERBOSE: Tactic: 9 time 0.0176 [TensorRT] VERBOSE: Tactic: 10 time 0.01472 [TensorRT] VERBOSE: Tactic: 11 time 0.0128 [TensorRT] VERBOSE: Tactic: 12 time 0.011712 [TensorRT] VERBOSE: Tactic: 13 time 0.01104 [TensorRT] VERBOSE: Tactic: 14 time 0.011712 [TensorRT] VERBOSE: Tactic: 15 time 0.013312 [TensorRT] VERBOSE: Tactic: 16 time 0.011072 [TensorRT] VERBOSE: Tactic: 17 time 0.010752 [TensorRT] VERBOSE: Tactic: 18 time 0.011584 [TensorRT] VERBOSE: Tactic: 19 time 0.015488 [TensorRT] VERBOSE: Tactic: 20 time 0.021952 [TensorRT] VERBOSE: Tactic: 21 time 0.01696 [TensorRT] VERBOSE: Tactic: 22 time 0.012576 [TensorRT] VERBOSE: Tactic: 23 time 0.012288 [TensorRT] VERBOSE: Tactic: 28 time 0.016224 [TensorRT] VERBOSE: Tactic: 29 time 0.014912 [TensorRT] VERBOSE: Tactic: 30 time 0.02048 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.00864 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028288 [TensorRT] VERBOSE: Tactic: 256 time 0.027328 [TensorRT] VERBOSE: Tactic: 512 time 0.028672 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027328 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011552 [TensorRT] VERBOSE: Tactic: 11 time 0.011264 [TensorRT] VERBOSE: Tactic: 12 time 0.010688 [TensorRT] VERBOSE: Tactic: 13 time 0.01424 [TensorRT] VERBOSE: Tactic: 14 time 0.011616 [TensorRT] VERBOSE: Tactic: 15 time 0.015872 [TensorRT] VERBOSE: Tactic: 16 time 0.02112 [TensorRT] VERBOSE: Tactic: 17 time 0.016384 [TensorRT] VERBOSE: Tactic: 18 time 0.017696 [TensorRT] VERBOSE: Tactic: 19 time 0.022144 [TensorRT] VERBOSE: Tactic: 20 time 0.010592 [TensorRT] VERBOSE: Tactic: 21 time 0.009568 [TensorRT] VERBOSE: Tactic: 22 time 0.010976 [TensorRT] VERBOSE: Tactic: 23 time 0.014048 [TensorRT] VERBOSE: Tactic: 24 time 0.010272 [TensorRT] VERBOSE: Tactic: 25 time 0.009952 [TensorRT] VERBOSE: Tactic: 26 time 0.009408 [TensorRT] VERBOSE: Tactic: 27 time 0.012288 [TensorRT] VERBOSE: Tactic: 29 time 0.04 [TensorRT] VERBOSE: Tactic: 30 time 0.023712 [TensorRT] VERBOSE: Tactic: 31 time 0.016352 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.009408 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019328 [TensorRT] VERBOSE: Tactic: 256 time 0.019296 [TensorRT] VERBOSE: Tactic: 512 time 0.019488 [TensorRT] VERBOSE: Tactic: -32 time 0.041952 [TensorRT] VERBOSE: Tactic: -64 time 0.027584 [TensorRT] VERBOSE: Tactic: -128 time 0.026016 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.019296 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013728 [TensorRT] VERBOSE: Tactic: 1 time 0.012096 [TensorRT] VERBOSE: Tactic: 2 time 0.011104 [TensorRT] VERBOSE: Tactic: 3 time 0.01216 [TensorRT] VERBOSE: Tactic: 4 time 0.012096 [TensorRT] VERBOSE: Tactic: 5 time 0.011424 [TensorRT] VERBOSE: Tactic: 6 time 0.012256 [TensorRT] VERBOSE: Tactic: 7 time 0.01136 [TensorRT] VERBOSE: Tactic: 8 time 0.011392 [TensorRT] VERBOSE: Tactic: 9 time 0.011904 [TensorRT] VERBOSE: Tactic: 28 time 0.012864 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.011104 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019552 [TensorRT] VERBOSE: Tactic: 256 time 0.020064 [TensorRT] VERBOSE: Tactic: 512 time 0.019744 [TensorRT] VERBOSE: Tactic: -32 time 0.044 [TensorRT] VERBOSE: Tactic: -64 time 0.02704 [TensorRT] VERBOSE: Tactic: -128 time 0.025632 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019552 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.01472 [TensorRT] VERBOSE: Tactic: 25 time 0.015808 [TensorRT] VERBOSE: Tactic: 26 time 0.0136 [TensorRT] VERBOSE: Tactic: 27 time 0.014336 [TensorRT] VERBOSE: Tactic: 31 time 0.014944 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.0136 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02224 [TensorRT] VERBOSE: Tactic: 256 time 0.021824 [TensorRT] VERBOSE: Tactic: 512 time 0.021856 [TensorRT] VERBOSE: Tactic: -32 time 0.026752 [TensorRT] VERBOSE: Tactic: -64 time 0.029984 [TensorRT] VERBOSE: Tactic: -128 time 0.031136 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008864 [TensorRT] VERBOSE: Tactic: 1 time 0.00784 [TensorRT] VERBOSE: Tactic: 2 time 0.006752 [TensorRT] VERBOSE: Tactic: 3 time 0.007648 [TensorRT] VERBOSE: Tactic: 4 time 0.00688 [TensorRT] VERBOSE: Tactic: 5 time 0.006784 [TensorRT] VERBOSE: Tactic: 6 time 0.007616 [TensorRT] VERBOSE: Tactic: 7 time 0.007584 [TensorRT] VERBOSE: Tactic: 8 time 0.007872 [TensorRT] VERBOSE: Tactic: 9 time 0.008128 [TensorRT] VERBOSE: Tactic: 10 time 0.012416 [TensorRT] VERBOSE: Tactic: 11 time 0.01104 [TensorRT] VERBOSE: Tactic: 12 time 0.00944 [TensorRT] VERBOSE: Tactic: 13 time 0.009376 [TensorRT] VERBOSE: Tactic: 14 time 0.009344 [TensorRT] VERBOSE: Tactic: 15 time 0.008192 [TensorRT] VERBOSE: Tactic: 16 time 0.00912 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.009248 [TensorRT] VERBOSE: Tactic: 19 time 0.00896 [TensorRT] VERBOSE: Tactic: 20 time 0.018688 [TensorRT] VERBOSE: Tactic: 21 time 0.014016 [TensorRT] VERBOSE: Tactic: 22 time 0.011456 [TensorRT] VERBOSE: Tactic: 23 time 0.010592 [TensorRT] VERBOSE: Tactic: 28 time 0.010592 [TensorRT] VERBOSE: Tactic: 29 time 0.01392 [TensorRT] VERBOSE: Tactic: 30 time 0.018816 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006752 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022656 [TensorRT] VERBOSE: Tactic: 256 time 0.022272 [TensorRT] VERBOSE: Tactic: 512 time 0.021856 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.021856 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00784 [TensorRT] VERBOSE: Tactic: 11 time 0.00752 [TensorRT] VERBOSE: Tactic: 12 time 0.008192 [TensorRT] VERBOSE: Tactic: 13 time 0.010528 [TensorRT] VERBOSE: Tactic: 14 time 0.009152 [TensorRT] VERBOSE: Tactic: 15 time 0.011136 [TensorRT] VERBOSE: Tactic: 16 time 0.014144 [TensorRT] VERBOSE: Tactic: 17 time 0.013632 [TensorRT] VERBOSE: Tactic: 18 time 0.014208 [TensorRT] VERBOSE: Tactic: 19 time 0.015904 [TensorRT] VERBOSE: Tactic: 20 time 0.007904 [TensorRT] VERBOSE: Tactic: 21 time 0.007776 [TensorRT] VERBOSE: Tactic: 22 time 0.00752 [TensorRT] VERBOSE: Tactic: 23 time 0.01056 [TensorRT] VERBOSE: Tactic: 24 time 0.009216 [TensorRT] VERBOSE: Tactic: 25 time 0.007808 [TensorRT] VERBOSE: Tactic: 26 time 0.00768 [TensorRT] VERBOSE: Tactic: 27 time 0.007808 [TensorRT] VERBOSE: Tactic: 29 time 0.0272 [TensorRT] VERBOSE: Tactic: 30 time 0.016064 [TensorRT] VERBOSE: Tactic: 31 time 0.010816 [TensorRT] VERBOSE: Fastest Tactic: 11 Time: 0.00752 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_105 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_105 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_105 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_105 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_105 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023936 [TensorRT] VERBOSE: Tactic: 256 time 0.02496 [TensorRT] VERBOSE: Tactic: 512 time 0.02432 [TensorRT] VERBOSE: Tactic: -32 time 0.051488 [TensorRT] VERBOSE: Tactic: -64 time 0.035904 [TensorRT] VERBOSE: Tactic: -128 time 0.032416 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023936 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.015872 [TensorRT] VERBOSE: Tactic: 1 time 0.014912 [TensorRT] VERBOSE: Tactic: 2 time 0.0152 [TensorRT] VERBOSE: Tactic: 3 time 0.016224 [TensorRT] VERBOSE: Tactic: 4 time 0.017792 [TensorRT] VERBOSE: Tactic: 5 time 0.014912 [TensorRT] VERBOSE: Tactic: 6 time 0.016096 [TensorRT] VERBOSE: Tactic: 7 time 0.014784 [TensorRT] VERBOSE: Tactic: 8 time 0.01456 [TensorRT] VERBOSE: Tactic: 9 time 0.016 [TensorRT] VERBOSE: Tactic: 28 time 0.015904 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.01456 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024288 [TensorRT] VERBOSE: Tactic: 256 time 0.024864 [TensorRT] VERBOSE: Tactic: 512 time 0.025536 [TensorRT] VERBOSE: Tactic: -32 time 0.05184 [TensorRT] VERBOSE: Tactic: -64 time 0.035104 [TensorRT] VERBOSE: Tactic: -128 time 0.03168 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.024288 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.021504 [TensorRT] VERBOSE: Tactic: 25 time 0.022944 [TensorRT] VERBOSE: Tactic: 26 time 0.024416 [TensorRT] VERBOSE: Tactic: 27 time 0.024256 [TensorRT] VERBOSE: Tactic: 31 time 0.02224 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.021504 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.027872 [TensorRT] VERBOSE: Tactic: 256 time 0.027104 [TensorRT] VERBOSE: Tactic: 512 time 0.028672 [TensorRT] VERBOSE: Tactic: -32 time 0.036576 [TensorRT] VERBOSE: Tactic: -64 time 0.03904 [TensorRT] VERBOSE: Tactic: -128 time 0.041472 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027104 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.010368 [TensorRT] VERBOSE: Tactic: 1 time 0.009664 [TensorRT] VERBOSE: Tactic: 2 time 0.010944 [TensorRT] VERBOSE: Tactic: 3 time 0.009248 [TensorRT] VERBOSE: Tactic: 4 time 0.010112 [TensorRT] VERBOSE: Tactic: 5 time 0.012416 [TensorRT] VERBOSE: Tactic: 6 time 0.00976 [TensorRT] VERBOSE: Tactic: 7 time 0.009344 [TensorRT] VERBOSE: Tactic: 8 time 0.009952 [TensorRT] VERBOSE: Tactic: 9 time 0.016896 [TensorRT] VERBOSE: Tactic: 10 time 0.014336 [TensorRT] VERBOSE: Tactic: 11 time 0.012672 [TensorRT] VERBOSE: Tactic: 12 time 0.011584 [TensorRT] VERBOSE: Tactic: 13 time 0.010944 [TensorRT] VERBOSE: Tactic: 14 time 0.011488 [TensorRT] VERBOSE: Tactic: 15 time 0.013984 [TensorRT] VERBOSE: Tactic: 16 time 0.010976 [TensorRT] VERBOSE: Tactic: 17 time 0.009664 [TensorRT] VERBOSE: Tactic: 18 time 0.011616 [TensorRT] VERBOSE: Tactic: 19 time 0.01568 [TensorRT] VERBOSE: Tactic: 20 time 0.020896 [TensorRT] VERBOSE: Tactic: 21 time 0.017184 [TensorRT] VERBOSE: Tactic: 22 time 0.013312 [TensorRT] VERBOSE: Tactic: 23 time 0.012736 [TensorRT] VERBOSE: Tactic: 28 time 0.015328 [TensorRT] VERBOSE: Tactic: 29 time 0.01536 [TensorRT] VERBOSE: Tactic: 30 time 0.02048 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.009248 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028 [TensorRT] VERBOSE: Tactic: 256 time 0.026944 [TensorRT] VERBOSE: Tactic: 512 time 0.02816 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.026944 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011712 [TensorRT] VERBOSE: Tactic: 11 time 0.011168 [TensorRT] VERBOSE: Tactic: 12 time 0.01072 [TensorRT] VERBOSE: Tactic: 13 time 0.014016 [TensorRT] VERBOSE: Tactic: 14 time 0.011616 [TensorRT] VERBOSE: Tactic: 15 time 0.01584 [TensorRT] VERBOSE: Tactic: 16 time 0.020704 [TensorRT] VERBOSE: Tactic: 17 time 0.01648 [TensorRT] VERBOSE: Tactic: 18 time 0.017408 [TensorRT] VERBOSE: Tactic: 19 time 0.022464 [TensorRT] VERBOSE: Tactic: 20 time 0.011072 [TensorRT] VERBOSE: Tactic: 21 time 0.009568 [TensorRT] VERBOSE: Tactic: 22 time 0.01072 [TensorRT] VERBOSE: Tactic: 23 time 0.014112 [TensorRT] VERBOSE: Tactic: 24 time 0.010368 [TensorRT] VERBOSE: Tactic: 25 time 0.009824 [TensorRT] VERBOSE: Tactic: 26 time 0.009216 [TensorRT] VERBOSE: Tactic: 27 time 0.012512 [TensorRT] VERBOSE: Tactic: 29 time 0.03984 [TensorRT] VERBOSE: Tactic: 30 time 0.0224 [TensorRT] VERBOSE: Tactic: 31 time 0.015328 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019296 [TensorRT] VERBOSE: Tactic: 256 time 0.019488 [TensorRT] VERBOSE: Tactic: 512 time 0.02 [TensorRT] VERBOSE: Tactic: -32 time 0.042912 [TensorRT] VERBOSE: Tactic: -64 time 0.027136 [TensorRT] VERBOSE: Tactic: -128 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019296 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013056 [TensorRT] VERBOSE: Tactic: 1 time 0.012 [TensorRT] VERBOSE: Tactic: 2 time 0.011264 [TensorRT] VERBOSE: Tactic: 3 time 0.013408 [TensorRT] VERBOSE: Tactic: 4 time 0.011264 [TensorRT] VERBOSE: Tactic: 5 time 0.011264 [TensorRT] VERBOSE: Tactic: 6 time 0.01248 [TensorRT] VERBOSE: Tactic: 7 time 0.011296 [TensorRT] VERBOSE: Tactic: 8 time 0.01152 [TensorRT] VERBOSE: Tactic: 9 time 0.012704 [TensorRT] VERBOSE: Tactic: 28 time 0.013344 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.011264 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019328 [TensorRT] VERBOSE: Tactic: 256 time 0.019328 [TensorRT] VERBOSE: Tactic: 512 time 0.019456 [TensorRT] VERBOSE: Tactic: -32 time 0.042048 [TensorRT] VERBOSE: Tactic: -64 time 0.02816 [TensorRT] VERBOSE: Tactic: -128 time 0.026592 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019328 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.01568 [TensorRT] VERBOSE: Tactic: 25 time 0.015904 [TensorRT] VERBOSE: Tactic: 26 time 0.014624 [TensorRT] VERBOSE: Tactic: 27 time 0.013408 [TensorRT] VERBOSE: Tactic: 31 time 0.015008 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.013408 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02256 [TensorRT] VERBOSE: Tactic: 256 time 0.021408 [TensorRT] VERBOSE: Tactic: 512 time 0.022496 [TensorRT] VERBOSE: Tactic: -32 time 0.02672 [TensorRT] VERBOSE: Tactic: -64 time 0.03024 [TensorRT] VERBOSE: Tactic: -128 time 0.031648 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021408 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009408 [TensorRT] VERBOSE: Tactic: 1 time 0.007232 [TensorRT] VERBOSE: Tactic: 2 time 0.006976 [TensorRT] VERBOSE: Tactic: 3 time 0.007488 [TensorRT] VERBOSE: Tactic: 4 time 0.007936 [TensorRT] VERBOSE: Tactic: 5 time 0.00688 [TensorRT] VERBOSE: Tactic: 6 time 0.007712 [TensorRT] VERBOSE: Tactic: 7 time 0.00768 [TensorRT] VERBOSE: Tactic: 8 time 0.008608 [TensorRT] VERBOSE: Tactic: 9 time 0.008384 [TensorRT] VERBOSE: Tactic: 10 time 0.012384 [TensorRT] VERBOSE: Tactic: 11 time 0.010976 [TensorRT] VERBOSE: Tactic: 12 time 0.009312 [TensorRT] VERBOSE: Tactic: 13 time 0.009312 [TensorRT] VERBOSE: Tactic: 14 time 0.009312 [TensorRT] VERBOSE: Tactic: 15 time 0.008288 [TensorRT] VERBOSE: Tactic: 16 time 0.009248 [TensorRT] VERBOSE: Tactic: 17 time 0.009184 [TensorRT] VERBOSE: Tactic: 18 time 0.009344 [TensorRT] VERBOSE: Tactic: 19 time 0.008896 [TensorRT] VERBOSE: Tactic: 20 time 0.018656 [TensorRT] VERBOSE: Tactic: 21 time 0.014144 [TensorRT] VERBOSE: Tactic: 22 time 0.010688 [TensorRT] VERBOSE: Tactic: 23 time 0.011008 [TensorRT] VERBOSE: Tactic: 28 time 0.010976 [TensorRT] VERBOSE: Tactic: 29 time 0.013184 [TensorRT] VERBOSE: Tactic: 30 time 0.018816 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.00688 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023456 [TensorRT] VERBOSE: Tactic: 256 time 0.022112 [TensorRT] VERBOSE: Tactic: 512 time 0.021952 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.021952 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007936 [TensorRT] VERBOSE: Tactic: 11 time 0.007584 [TensorRT] VERBOSE: Tactic: 12 time 0.008192 [TensorRT] VERBOSE: Tactic: 13 time 0.010752 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.011072 [TensorRT] VERBOSE: Tactic: 16 time 0.013856 [TensorRT] VERBOSE: Tactic: 17 time 0.013792 [TensorRT] VERBOSE: Tactic: 18 time 0.01408 [TensorRT] VERBOSE: Tactic: 19 time 0.015712 [TensorRT] VERBOSE: Tactic: 20 time 0.008192 [TensorRT] VERBOSE: Tactic: 21 time 0.007712 [TensorRT] VERBOSE: Tactic: 22 time 0.007648 [TensorRT] VERBOSE: Tactic: 23 time 0.010048 [TensorRT] VERBOSE: Tactic: 24 time 0.009216 [TensorRT] VERBOSE: Tactic: 25 time 0.007776 [TensorRT] VERBOSE: Tactic: 26 time 0.007584 [TensorRT] VERBOSE: Tactic: 27 time 0.007904 [TensorRT] VERBOSE: Tactic: 29 time 0.027104 [TensorRT] VERBOSE: Tactic: 30 time 0.015456 [TensorRT] VERBOSE: Tactic: 31 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 11 Time: 0.007584 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_110 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_110 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_110 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_110 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_110 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02384 [TensorRT] VERBOSE: Tactic: 256 time 0.023872 [TensorRT] VERBOSE: Tactic: 512 time 0.024576 [TensorRT] VERBOSE: Tactic: -32 time 0.052896 [TensorRT] VERBOSE: Tactic: -64 time 0.03616 [TensorRT] VERBOSE: Tactic: -128 time 0.032768 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.02384 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014336 [TensorRT] VERBOSE: Tactic: 1 time 0.014656 [TensorRT] VERBOSE: Tactic: 2 time 0.013952 [TensorRT] VERBOSE: Tactic: 3 time 0.015712 [TensorRT] VERBOSE: Tactic: 4 time 0.014784 [TensorRT] VERBOSE: Tactic: 5 time 0.015712 [TensorRT] VERBOSE: Tactic: 6 time 0.015296 [TensorRT] VERBOSE: Tactic: 7 time 0.015104 [TensorRT] VERBOSE: Tactic: 8 time 0.014688 [TensorRT] VERBOSE: Tactic: 9 time 0.014752 [TensorRT] VERBOSE: Tactic: 28 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.013952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023904 [TensorRT] VERBOSE: Tactic: 256 time 0.024768 [TensorRT] VERBOSE: Tactic: 512 time 0.024864 [TensorRT] VERBOSE: Tactic: -32 time 0.053088 [TensorRT] VERBOSE: Tactic: -64 time 0.034592 [TensorRT] VERBOSE: Tactic: -128 time 0.034272 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023904 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.022304 [TensorRT] VERBOSE: Tactic: 25 time 0.024672 [TensorRT] VERBOSE: Tactic: 26 time 0.025088 [TensorRT] VERBOSE: Tactic: 27 time 0.023552 [TensorRT] VERBOSE: Tactic: 31 time 0.02336 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.022304 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028384 [TensorRT] VERBOSE: Tactic: 256 time 0.027168 [TensorRT] VERBOSE: Tactic: 512 time 0.028608 [TensorRT] VERBOSE: Tactic: -32 time 0.036704 [TensorRT] VERBOSE: Tactic: -64 time 0.03984 [TensorRT] VERBOSE: Tactic: -128 time 0.041568 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027168 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.010976 [TensorRT] VERBOSE: Tactic: 1 time 0.009632 [TensorRT] VERBOSE: Tactic: 2 time 0.011072 [TensorRT] VERBOSE: Tactic: 3 time 0.00944 [TensorRT] VERBOSE: Tactic: 4 time 0.010208 [TensorRT] VERBOSE: Tactic: 5 time 0.011904 [TensorRT] VERBOSE: Tactic: 6 time 0.00992 [TensorRT] VERBOSE: Tactic: 7 time 0.009696 [TensorRT] VERBOSE: Tactic: 8 time 0.009984 [TensorRT] VERBOSE: Tactic: 9 time 0.01536 [TensorRT] VERBOSE: Tactic: 10 time 0.014272 [TensorRT] VERBOSE: Tactic: 11 time 0.01248 [TensorRT] VERBOSE: Tactic: 12 time 0.01216 [TensorRT] VERBOSE: Tactic: 13 time 0.011264 [TensorRT] VERBOSE: Tactic: 14 time 0.011488 [TensorRT] VERBOSE: Tactic: 15 time 0.013408 [TensorRT] VERBOSE: Tactic: 16 time 0.011072 [TensorRT] VERBOSE: Tactic: 17 time 0.010912 [TensorRT] VERBOSE: Tactic: 18 time 0.011424 [TensorRT] VERBOSE: Tactic: 19 time 0.015264 [TensorRT] VERBOSE: Tactic: 20 time 0.021376 [TensorRT] VERBOSE: Tactic: 21 time 0.017024 [TensorRT] VERBOSE: Tactic: 22 time 0.013888 [TensorRT] VERBOSE: Tactic: 23 time 0.012544 [TensorRT] VERBOSE: Tactic: 28 time 0.015072 [TensorRT] VERBOSE: Tactic: 29 time 0.015744 [TensorRT] VERBOSE: Tactic: 30 time 0.020512 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.00944 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02832 [TensorRT] VERBOSE: Tactic: 256 time 0.026688 [TensorRT] VERBOSE: Tactic: 512 time 0.028608 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.026688 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011424 [TensorRT] VERBOSE: Tactic: 11 time 0.011296 [TensorRT] VERBOSE: Tactic: 12 time 0.010496 [TensorRT] VERBOSE: Tactic: 13 time 0.014144 [TensorRT] VERBOSE: Tactic: 14 time 0.011616 [TensorRT] VERBOSE: Tactic: 15 time 0.015392 [TensorRT] VERBOSE: Tactic: 16 time 0.02208 [TensorRT] VERBOSE: Tactic: 17 time 0.016672 [TensorRT] VERBOSE: Tactic: 18 time 0.01744 [TensorRT] VERBOSE: Tactic: 19 time 0.021472 [TensorRT] VERBOSE: Tactic: 20 time 0.01024 [TensorRT] VERBOSE: Tactic: 21 time 0.009728 [TensorRT] VERBOSE: Tactic: 22 time 0.01072 [TensorRT] VERBOSE: Tactic: 23 time 0.014336 [TensorRT] VERBOSE: Tactic: 24 time 0.01152 [TensorRT] VERBOSE: Tactic: 25 time 0.009792 [TensorRT] VERBOSE: Tactic: 26 time 0.009216 [TensorRT] VERBOSE: Tactic: 27 time 0.01296 [TensorRT] VERBOSE: Tactic: 29 time 0.040192 [TensorRT] VERBOSE: Tactic: 30 time 0.022816 [TensorRT] VERBOSE: Tactic: 31 time 0.015136 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019168 [TensorRT] VERBOSE: Tactic: 256 time 0.018976 [TensorRT] VERBOSE: Tactic: 512 time 0.020864 [TensorRT] VERBOSE: Tactic: -32 time 0.042752 [TensorRT] VERBOSE: Tactic: -64 time 0.027648 [TensorRT] VERBOSE: Tactic: -128 time 0.026624 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.018976 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013088 [TensorRT] VERBOSE: Tactic: 1 time 0.014368 [TensorRT] VERBOSE: Tactic: 2 time 0.011328 [TensorRT] VERBOSE: Tactic: 3 time 0.013312 [TensorRT] VERBOSE: Tactic: 4 time 0.011712 [TensorRT] VERBOSE: Tactic: 5 time 0.011712 [TensorRT] VERBOSE: Tactic: 6 time 0.012512 [TensorRT] VERBOSE: Tactic: 7 time 0.011264 [TensorRT] VERBOSE: Tactic: 8 time 0.011264 [TensorRT] VERBOSE: Tactic: 9 time 0.012288 [TensorRT] VERBOSE: Tactic: 28 time 0.013312 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.011264 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019392 [TensorRT] VERBOSE: Tactic: 256 time 0.019712 [TensorRT] VERBOSE: Tactic: 512 time 0.019584 [TensorRT] VERBOSE: Tactic: -32 time 0.041696 [TensorRT] VERBOSE: Tactic: -64 time 0.0272 [TensorRT] VERBOSE: Tactic: -128 time 0.026176 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019392 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014688 [TensorRT] VERBOSE: Tactic: 25 time 0.016768 [TensorRT] VERBOSE: Tactic: 26 time 0.014336 [TensorRT] VERBOSE: Tactic: 27 time 0.014592 [TensorRT] VERBOSE: Tactic: 31 time 0.015936 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.014336 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023488 [TensorRT] VERBOSE: Tactic: 256 time 0.020864 [TensorRT] VERBOSE: Tactic: 512 time 0.022112 [TensorRT] VERBOSE: Tactic: -32 time 0.026656 [TensorRT] VERBOSE: Tactic: -64 time 0.028768 [TensorRT] VERBOSE: Tactic: -128 time 0.031232 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.020864 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009376 [TensorRT] VERBOSE: Tactic: 1 time 0.007744 [TensorRT] VERBOSE: Tactic: 2 time 0.006752 [TensorRT] VERBOSE: Tactic: 3 time 0.007296 [TensorRT] VERBOSE: Tactic: 4 time 0.007616 [TensorRT] VERBOSE: Tactic: 5 time 0.006656 [TensorRT] VERBOSE: Tactic: 6 time 0.007648 [TensorRT] VERBOSE: Tactic: 7 time 0.007616 [TensorRT] VERBOSE: Tactic: 8 time 0.00768 [TensorRT] VERBOSE: Tactic: 9 time 0.008448 [TensorRT] VERBOSE: Tactic: 10 time 0.012736 [TensorRT] VERBOSE: Tactic: 11 time 0.00992 [TensorRT] VERBOSE: Tactic: 12 time 0.009216 [TensorRT] VERBOSE: Tactic: 13 time 0.009472 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.008544 [TensorRT] VERBOSE: Tactic: 16 time 0.008512 [TensorRT] VERBOSE: Tactic: 17 time 0.009312 [TensorRT] VERBOSE: Tactic: 18 time 0.00912 [TensorRT] VERBOSE: Tactic: 19 time 0.008352 [TensorRT] VERBOSE: Tactic: 20 time 0.018432 [TensorRT] VERBOSE: Tactic: 21 time 0.014208 [TensorRT] VERBOSE: Tactic: 22 time 0.012288 [TensorRT] VERBOSE: Tactic: 23 time 0.010592 [TensorRT] VERBOSE: Tactic: 28 time 0.010656 [TensorRT] VERBOSE: Tactic: 29 time 0.012672 [TensorRT] VERBOSE: Tactic: 30 time 0.018656 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.006656 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023296 [TensorRT] VERBOSE: Tactic: 256 time 0.02192 [TensorRT] VERBOSE: Tactic: 512 time 0.023424 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.02192 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007744 [TensorRT] VERBOSE: Tactic: 11 time 0.007712 [TensorRT] VERBOSE: Tactic: 12 time 0.007808 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009312 [TensorRT] VERBOSE: Tactic: 15 time 0.011232 [TensorRT] VERBOSE: Tactic: 16 time 0.014048 [TensorRT] VERBOSE: Tactic: 17 time 0.013792 [TensorRT] VERBOSE: Tactic: 18 time 0.014304 [TensorRT] VERBOSE: Tactic: 19 time 0.016224 [TensorRT] VERBOSE: Tactic: 20 time 0.008192 [TensorRT] VERBOSE: Tactic: 21 time 0.007616 [TensorRT] VERBOSE: Tactic: 22 time 0.007552 [TensorRT] VERBOSE: Tactic: 23 time 0.00944 [TensorRT] VERBOSE: Tactic: 24 time 0.00928 [TensorRT] VERBOSE: Tactic: 25 time 0.007744 [TensorRT] VERBOSE: Tactic: 26 time 0.007936 [TensorRT] VERBOSE: Tactic: 27 time 0.009184 [TensorRT] VERBOSE: Tactic: 29 time 0.027296 [TensorRT] VERBOSE: Tactic: 30 time 0.015744 [TensorRT] VERBOSE: Tactic: 31 time 0.011296 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.007552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_115 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_115 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_115 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_115 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_115 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02416 [TensorRT] VERBOSE: Tactic: 256 time 0.024448 [TensorRT] VERBOSE: Tactic: 512 time 0.025312 [TensorRT] VERBOSE: Tactic: -32 time 0.054944 [TensorRT] VERBOSE: Tactic: -64 time 0.034176 [TensorRT] VERBOSE: Tactic: -128 time 0.031808 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.02416 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.015936 [TensorRT] VERBOSE: Tactic: 1 time 0.014368 [TensorRT] VERBOSE: Tactic: 2 time 0.014144 [TensorRT] VERBOSE: Tactic: 3 time 0.015552 [TensorRT] VERBOSE: Tactic: 4 time 0.016416 [TensorRT] VERBOSE: Tactic: 5 time 0.015104 [TensorRT] VERBOSE: Tactic: 6 time 0.01536 [TensorRT] VERBOSE: Tactic: 7 time 0.014912 [TensorRT] VERBOSE: Tactic: 8 time 0.015456 [TensorRT] VERBOSE: Tactic: 9 time 0.015776 [TensorRT] VERBOSE: Tactic: 28 time 0.015456 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.014144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02384 [TensorRT] VERBOSE: Tactic: 256 time 0.024128 [TensorRT] VERBOSE: Tactic: 512 time 0.02496 [TensorRT] VERBOSE: Tactic: -32 time 0.051008 [TensorRT] VERBOSE: Tactic: -64 time 0.035264 [TensorRT] VERBOSE: Tactic: -128 time 0.03088 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.02384 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.02224 [TensorRT] VERBOSE: Tactic: 25 time 0.025184 [TensorRT] VERBOSE: Tactic: 26 time 0.024576 [TensorRT] VERBOSE: Tactic: 27 time 0.024288 [TensorRT] VERBOSE: Tactic: 31 time 0.023008 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.02224 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028096 [TensorRT] VERBOSE: Tactic: 256 time 0.026848 [TensorRT] VERBOSE: Tactic: 512 time 0.029376 [TensorRT] VERBOSE: Tactic: -32 time 0.036096 [TensorRT] VERBOSE: Tactic: -64 time 0.039392 [TensorRT] VERBOSE: Tactic: -128 time 0.04144 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.026848 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.011328 [TensorRT] VERBOSE: Tactic: 1 time 0.009632 [TensorRT] VERBOSE: Tactic: 2 time 0.010752 [TensorRT] VERBOSE: Tactic: 3 time 0.009088 [TensorRT] VERBOSE: Tactic: 4 time 0.009824 [TensorRT] VERBOSE: Tactic: 5 time 0.012352 [TensorRT] VERBOSE: Tactic: 6 time 0.01088 [TensorRT] VERBOSE: Tactic: 7 time 0.009504 [TensorRT] VERBOSE: Tactic: 8 time 0.009344 [TensorRT] VERBOSE: Tactic: 9 time 0.01536 [TensorRT] VERBOSE: Tactic: 10 time 0.014592 [TensorRT] VERBOSE: Tactic: 11 time 0.012288 [TensorRT] VERBOSE: Tactic: 12 time 0.011616 [TensorRT] VERBOSE: Tactic: 13 time 0.011136 [TensorRT] VERBOSE: Tactic: 14 time 0.01184 [TensorRT] VERBOSE: Tactic: 15 time 0.013312 [TensorRT] VERBOSE: Tactic: 16 time 0.010784 [TensorRT] VERBOSE: Tactic: 17 time 0.010944 [TensorRT] VERBOSE: Tactic: 18 time 0.012768 [TensorRT] VERBOSE: Tactic: 19 time 0.015712 [TensorRT] VERBOSE: Tactic: 20 time 0.020864 [TensorRT] VERBOSE: Tactic: 21 time 0.017184 [TensorRT] VERBOSE: Tactic: 22 time 0.013024 [TensorRT] VERBOSE: Tactic: 23 time 0.012288 [TensorRT] VERBOSE: Tactic: 28 time 0.015904 [TensorRT] VERBOSE: Tactic: 29 time 0.015776 [TensorRT] VERBOSE: Tactic: 30 time 0.02048 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.009088 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028512 [TensorRT] VERBOSE: Tactic: 256 time 0.028256 [TensorRT] VERBOSE: Tactic: 512 time 0.028544 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.028256 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011264 [TensorRT] VERBOSE: Tactic: 11 time 0.011488 [TensorRT] VERBOSE: Tactic: 12 time 0.010496 [TensorRT] VERBOSE: Tactic: 13 time 0.014336 [TensorRT] VERBOSE: Tactic: 14 time 0.012544 [TensorRT] VERBOSE: Tactic: 15 time 0.016384 [TensorRT] VERBOSE: Tactic: 16 time 0.020704 [TensorRT] VERBOSE: Tactic: 17 time 0.01616 [TensorRT] VERBOSE: Tactic: 18 time 0.01776 [TensorRT] VERBOSE: Tactic: 19 time 0.0224 [TensorRT] VERBOSE: Tactic: 20 time 0.010624 [TensorRT] VERBOSE: Tactic: 21 time 0.0096 [TensorRT] VERBOSE: Tactic: 22 time 0.010784 [TensorRT] VERBOSE: Tactic: 23 time 0.014336 [TensorRT] VERBOSE: Tactic: 24 time 0.011648 [TensorRT] VERBOSE: Tactic: 25 time 0.011136 [TensorRT] VERBOSE: Tactic: 26 time 0.009856 [TensorRT] VERBOSE: Tactic: 27 time 0.01264 [TensorRT] VERBOSE: Tactic: 29 time 0.04 [TensorRT] VERBOSE: Tactic: 30 time 0.023552 [TensorRT] VERBOSE: Tactic: 31 time 0.01536 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.0096 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02048 [TensorRT] VERBOSE: Tactic: 0 time 0.01168 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01168 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.023232 [TensorRT] VERBOSE: Tactic: 0 time 0.048896 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023232 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027104 [TensorRT] VERBOSE: Tactic: 0 time 0.016384 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016384 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0256 [TensorRT] VERBOSE: Tactic: 0 time 0.031744 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.0256 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039392 [TensorRT] VERBOSE: Tactic: 0 time 0.02528 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02528 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0256 [TensorRT] VERBOSE: Tactic: 0 time 0.012096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012096 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027936 [TensorRT] VERBOSE: Tactic: 0 time 0.02048 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02048 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026848 [TensorRT] VERBOSE: Tactic: 0 time 0.038912 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026848 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022304 [TensorRT] VERBOSE: Tactic: 256 time 0.022528 [TensorRT] VERBOSE: Tactic: 512 time 0.021888 [TensorRT] VERBOSE: Tactic: -32 time 0.042688 [TensorRT] VERBOSE: Tactic: -64 time 0.027232 [TensorRT] VERBOSE: Tactic: -128 time 0.026688 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.021888 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014016 [TensorRT] VERBOSE: Tactic: 1 time 0.013312 [TensorRT] VERBOSE: Tactic: 2 time 0.011264 [TensorRT] VERBOSE: Tactic: 3 time 0.013664 [TensorRT] VERBOSE: Tactic: 4 time 0.011552 [TensorRT] VERBOSE: Tactic: 5 time 0.011872 [TensorRT] VERBOSE: Tactic: 6 time 0.0128 [TensorRT] VERBOSE: Tactic: 7 time 0.012448 [TensorRT] VERBOSE: Tactic: 8 time 0.0112 [TensorRT] VERBOSE: Tactic: 9 time 0.012672 [TensorRT] VERBOSE: Tactic: 28 time 0.01456 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.0112 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02208 [TensorRT] VERBOSE: Tactic: 256 time 0.022688 [TensorRT] VERBOSE: Tactic: 512 time 0.021984 [TensorRT] VERBOSE: Tactic: -32 time 0.044 [TensorRT] VERBOSE: Tactic: -64 time 0.028064 [TensorRT] VERBOSE: Tactic: -128 time 0.027136 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.021984 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.01632 [TensorRT] VERBOSE: Tactic: 25 time 0.016384 [TensorRT] VERBOSE: Tactic: 26 time 0.014016 [TensorRT] VERBOSE: Tactic: 27 time 0.013888 [TensorRT] VERBOSE: Tactic: 31 time 0.0152 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.013888 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023552 [TensorRT] VERBOSE: Tactic: 256 time 0.02112 [TensorRT] VERBOSE: Tactic: 512 time 0.022048 [TensorRT] VERBOSE: Tactic: -32 time 0.026624 [TensorRT] VERBOSE: Tactic: -64 time 0.029632 [TensorRT] VERBOSE: Tactic: -128 time 0.032128 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.02112 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009376 [TensorRT] VERBOSE: Tactic: 1 time 0.007872 [TensorRT] VERBOSE: Tactic: 2 time 0.007168 [TensorRT] VERBOSE: Tactic: 3 time 0.007584 [TensorRT] VERBOSE: Tactic: 4 time 0.00784 [TensorRT] VERBOSE: Tactic: 5 time 0.00656 [TensorRT] VERBOSE: Tactic: 6 time 0.007584 [TensorRT] VERBOSE: Tactic: 7 time 0.00784 [TensorRT] VERBOSE: Tactic: 8 time 0.007936 [TensorRT] VERBOSE: Tactic: 9 time 0.008704 [TensorRT] VERBOSE: Tactic: 10 time 0.012928 [TensorRT] VERBOSE: Tactic: 11 time 0.010528 [TensorRT] VERBOSE: Tactic: 12 time 0.009888 [TensorRT] VERBOSE: Tactic: 13 time 0.009568 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.008512 [TensorRT] VERBOSE: Tactic: 16 time 0.00912 [TensorRT] VERBOSE: Tactic: 17 time 0.00896 [TensorRT] VERBOSE: Tactic: 18 time 0.009376 [TensorRT] VERBOSE: Tactic: 19 time 0.008544 [TensorRT] VERBOSE: Tactic: 20 time 0.018944 [TensorRT] VERBOSE: Tactic: 21 time 0.013888 [TensorRT] VERBOSE: Tactic: 22 time 0.011008 [TensorRT] VERBOSE: Tactic: 23 time 0.010656 [TensorRT] VERBOSE: Tactic: 28 time 0.010752 [TensorRT] VERBOSE: Tactic: 29 time 0.012704 [TensorRT] VERBOSE: Tactic: 30 time 0.017856 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.00656 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022528 [TensorRT] VERBOSE: Tactic: 256 time 0.021536 [TensorRT] VERBOSE: Tactic: 512 time 0.022272 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021536 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006592 [TensorRT] VERBOSE: Tactic: 11 time 0.007904 [TensorRT] VERBOSE: Tactic: 12 time 0.00784 [TensorRT] VERBOSE: Tactic: 13 time 0.009344 [TensorRT] VERBOSE: Tactic: 14 time 0.00944 [TensorRT] VERBOSE: Tactic: 15 time 0.011264 [TensorRT] VERBOSE: Tactic: 16 time 0.014144 [TensorRT] VERBOSE: Tactic: 17 time 0.013824 [TensorRT] VERBOSE: Tactic: 18 time 0.014304 [TensorRT] VERBOSE: Tactic: 19 time 0.01536 [TensorRT] VERBOSE: Tactic: 20 time 0.008192 [TensorRT] VERBOSE: Tactic: 21 time 0.007648 [TensorRT] VERBOSE: Tactic: 22 time 0.007776 [TensorRT] VERBOSE: Tactic: 23 time 0.010016 [TensorRT] VERBOSE: Tactic: 24 time 0.00944 [TensorRT] VERBOSE: Tactic: 25 time 0.00752 [TensorRT] VERBOSE: Tactic: 26 time 0.007776 [TensorRT] VERBOSE: Tactic: 27 time 0.008576 [TensorRT] VERBOSE: Tactic: 29 time 0.026912 [TensorRT] VERBOSE: Tactic: 30 time 0.016448 [TensorRT] VERBOSE: Tactic: 31 time 0.011136 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.006592 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.024352 [TensorRT] VERBOSE: Tactic: 0 time 0.04832 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024352 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026624 [TensorRT] VERBOSE: Tactic: 0 time 0.0064 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0064 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025504 [TensorRT] VERBOSE: Tactic: 0 time 0.0312 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025504 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.03872 [TensorRT] VERBOSE: Tactic: 0 time 0.025216 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.025216 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02752 [TensorRT] VERBOSE: Tactic: 0 time 0.020448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026624 [TensorRT] VERBOSE: Tactic: 0 time 0.039648 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026624 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026176 [TensorRT] VERBOSE: Tactic: 0 time 0.016384 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016384 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025408 [TensorRT] VERBOSE: Tactic: 0 time 0.047744 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025408 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026624 [TensorRT] VERBOSE: Tactic: 0 time 0.007968 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007968 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026272 [TensorRT] VERBOSE: Tactic: 0 time 0.015456 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015456 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025696 [TensorRT] VERBOSE: Tactic: 0 time 0.047584 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025696 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026976 [TensorRT] VERBOSE: Tactic: 0 time 0.016224 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016224 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032608 [TensorRT] VERBOSE: Tactic: 256 time 0.032992 [TensorRT] VERBOSE: Tactic: 512 time 0.034048 [TensorRT] VERBOSE: Tactic: -32 time 0.050048 [TensorRT] VERBOSE: Tactic: -64 time 0.046784 [TensorRT] VERBOSE: Tactic: -128 time 0.04064 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.032608 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.02032 [TensorRT] VERBOSE: Tactic: 1 time 0.021248 [TensorRT] VERBOSE: Tactic: 2 time 0.018336 [TensorRT] VERBOSE: Tactic: 3 time 0.020512 [TensorRT] VERBOSE: Tactic: 4 time 0.018432 [TensorRT] VERBOSE: Tactic: 5 time 0.017952 [TensorRT] VERBOSE: Tactic: 6 time 0.021312 [TensorRT] VERBOSE: Tactic: 7 time 0.018176 [TensorRT] VERBOSE: Tactic: 8 time 0.017664 [TensorRT] VERBOSE: Tactic: 9 time 0.018432 [TensorRT] VERBOSE: Tactic: 28 time 0.021248 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.017664 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033184 [TensorRT] VERBOSE: Tactic: 256 time 0.03296 [TensorRT] VERBOSE: Tactic: 512 time 0.034464 [TensorRT] VERBOSE: Tactic: -32 time 0.051072 [TensorRT] VERBOSE: Tactic: -64 time 0.04592 [TensorRT] VERBOSE: Tactic: -128 time 0.039936 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.03296 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.02848 [TensorRT] VERBOSE: Tactic: 25 time 0.025856 [TensorRT] VERBOSE: Tactic: 26 time 0.02656 [TensorRT] VERBOSE: Tactic: 27 time 0.024576 [TensorRT] VERBOSE: Tactic: 31 time 0.026624 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.024576 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.043008 [TensorRT] VERBOSE: Tactic: 256 time 0.036192 [TensorRT] VERBOSE: Tactic: 512 time 0.037088 [TensorRT] VERBOSE: Tactic: -32 time 0.052288 [TensorRT] VERBOSE: Tactic: -64 time 0.055296 [TensorRT] VERBOSE: Tactic: -128 time 0.054016 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036192 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014336 [TensorRT] VERBOSE: Tactic: 1 time 0.012576 [TensorRT] VERBOSE: Tactic: 2 time 0.012448 [TensorRT] VERBOSE: Tactic: 3 time 0.011488 [TensorRT] VERBOSE: Tactic: 4 time 0.012768 [TensorRT] VERBOSE: Tactic: 5 time 0.012512 [TensorRT] VERBOSE: Tactic: 6 time 0.011392 [TensorRT] VERBOSE: Tactic: 7 time 0.011776 [TensorRT] VERBOSE: Tactic: 8 time 0.014656 [TensorRT] VERBOSE: Tactic: 9 time 0.01536 [TensorRT] VERBOSE: Tactic: 10 time 0.021984 [TensorRT] VERBOSE: Tactic: 11 time 0.01824 [TensorRT] VERBOSE: Tactic: 12 time 0.016384 [TensorRT] VERBOSE: Tactic: 13 time 0.015136 [TensorRT] VERBOSE: Tactic: 14 time 0.015264 [TensorRT] VERBOSE: Tactic: 15 time 0.015232 [TensorRT] VERBOSE: Tactic: 16 time 0.013824 [TensorRT] VERBOSE: Tactic: 17 time 0.014208 [TensorRT] VERBOSE: Tactic: 18 time 0.014336 [TensorRT] VERBOSE: Tactic: 19 time 0.016928 [TensorRT] VERBOSE: Tactic: 20 time 0.033568 [TensorRT] VERBOSE: Tactic: 21 time 0.024448 [TensorRT] VERBOSE: Tactic: 22 time 0.018144 [TensorRT] VERBOSE: Tactic: 23 time 0.015808 [TensorRT] VERBOSE: Tactic: 28 time 0.018176 [TensorRT] VERBOSE: Tactic: 29 time 0.023104 [TensorRT] VERBOSE: Tactic: 30 time 0.032384 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.011392 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.04256 [TensorRT] VERBOSE: Tactic: 256 time 0.036544 [TensorRT] VERBOSE: Tactic: 512 time 0.038144 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036544 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011072 [TensorRT] VERBOSE: Tactic: 11 time 0.012192 [TensorRT] VERBOSE: Tactic: 12 time 0.01216 [TensorRT] VERBOSE: Tactic: 13 time 0.012032 [TensorRT] VERBOSE: Tactic: 14 time 0.013376 [TensorRT] VERBOSE: Tactic: 15 time 0.015776 [TensorRT] VERBOSE: Tactic: 16 time 0.015904 [TensorRT] VERBOSE: Tactic: 17 time 0.016288 [TensorRT] VERBOSE: Tactic: 18 time 0.019328 [TensorRT] VERBOSE: Tactic: 19 time 0.022528 [TensorRT] VERBOSE: Tactic: 20 time 0.011744 [TensorRT] VERBOSE: Tactic: 21 time 0.012288 [TensorRT] VERBOSE: Tactic: 22 time 0.011872 [TensorRT] VERBOSE: Tactic: 23 time 0.01216 [TensorRT] VERBOSE: Tactic: 24 time 0.01488 [TensorRT] VERBOSE: Tactic: 25 time 0.012256 [TensorRT] VERBOSE: Tactic: 26 time 0.011648 [TensorRT] VERBOSE: Tactic: 27 time 0.01072 [TensorRT] VERBOSE: Tactic: 29 time 0.046656 [TensorRT] VERBOSE: Tactic: 30 time 0.027712 [TensorRT] VERBOSE: Tactic: 31 time 0.019488 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.01072 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.522208 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.522208 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.47088 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.48624 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.469248 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.47168 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.488448 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.499712 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.541632 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.61392 [TensorRT] VERBOSE: Fastest Tactic: 3915320020053085238 Time: 0.469248 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.756736 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 1806336, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 573767680, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 10642944, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.756736 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.12608 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.185056 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.1584 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.13616 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.184096 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.164544 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.129024 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.131072 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.1216 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.126656 [TensorRT] VERBOSE: Fastest Tactic: -4973811344878172338 Time: 0.1216 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4973811344878172338 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.156448 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.156448 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.12992 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.125632 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.182816 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.124288 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.162272 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.122816 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.151872 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.125664 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.183296 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.12976 [TensorRT] VERBOSE: Fastest Tactic: -7210942453088153035 Time: 0.122816 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7210942453088153035 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.182016 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.162944 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.128096 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.15536 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.127264 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.182624 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.12416 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.134624 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.124416 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.124992 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.12416 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.14496 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.14496 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.056192 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.061728 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.071968 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.056064 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.057248 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.060896 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.079488 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.0592 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.060672 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.052544 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.068256 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.049888 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.049888 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025184 [TensorRT] VERBOSE: Tactic: 0 time 0.04784 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025184 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027584 [TensorRT] VERBOSE: Tactic: 0 time 0.007584 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007584 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026976 [TensorRT] VERBOSE: Tactic: 0 time 0.03312 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026976 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.043168 [TensorRT] VERBOSE: Tactic: 0 time 0.022624 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.022624 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028672 [TensorRT] VERBOSE: Tactic: 0 time 0.020672 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020672 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028256 [TensorRT] VERBOSE: Tactic: 0 time 0.040576 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.028256 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027584 [TensorRT] VERBOSE: Tactic: 0 time 0.009952 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009952 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028 [TensorRT] VERBOSE: Tactic: 0 time 0.04752 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.028 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027488 [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009216 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027968 [TensorRT] VERBOSE: Tactic: 0 time 0.016 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027648 [TensorRT] VERBOSE: Tactic: 0 time 0.047744 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.027648 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028672 [TensorRT] VERBOSE: Tactic: 0 time 0.014752 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014752 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019264 [TensorRT] VERBOSE: Tactic: 256 time 0.01904 [TensorRT] VERBOSE: Tactic: 512 time 0.019392 [TensorRT] VERBOSE: Tactic: -32 time 0.043648 [TensorRT] VERBOSE: Tactic: -64 time 0.026816 [TensorRT] VERBOSE: Tactic: -128 time 0.026464 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.01904 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013312 [TensorRT] VERBOSE: Tactic: 1 time 0.012288 [TensorRT] VERBOSE: Tactic: 2 time 0.011648 [TensorRT] VERBOSE: Tactic: 3 time 0.013312 [TensorRT] VERBOSE: Tactic: 4 time 0.011456 [TensorRT] VERBOSE: Tactic: 5 time 0.011904 [TensorRT] VERBOSE: Tactic: 6 time 0.012672 [TensorRT] VERBOSE: Tactic: 7 time 0.01168 [TensorRT] VERBOSE: Tactic: 8 time 0.010528 [TensorRT] VERBOSE: Tactic: 9 time 0.011168 [TensorRT] VERBOSE: Tactic: 28 time 0.01328 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.010528 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 256 time 0.02112 [TensorRT] VERBOSE: Tactic: 512 time 0.020416 [TensorRT] VERBOSE: Tactic: -32 time 0.043264 [TensorRT] VERBOSE: Tactic: -64 time 0.02768 [TensorRT] VERBOSE: Tactic: -128 time 0.025952 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019456 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.016192 [TensorRT] VERBOSE: Tactic: 25 time 0.016384 [TensorRT] VERBOSE: Tactic: 26 time 0.014304 [TensorRT] VERBOSE: Tactic: 27 time 0.013312 [TensorRT] VERBOSE: Tactic: 31 time 0.015584 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.013312 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023616 [TensorRT] VERBOSE: Tactic: 256 time 0.021568 [TensorRT] VERBOSE: Tactic: 512 time 0.022112 [TensorRT] VERBOSE: Tactic: -32 time 0.026144 [TensorRT] VERBOSE: Tactic: -64 time 0.02992 [TensorRT] VERBOSE: Tactic: -128 time 0.03168 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021568 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009344 [TensorRT] VERBOSE: Tactic: 1 time 0.007968 [TensorRT] VERBOSE: Tactic: 2 time 0.008608 [TensorRT] VERBOSE: Tactic: 3 time 0.007552 [TensorRT] VERBOSE: Tactic: 4 time 0.007872 [TensorRT] VERBOSE: Tactic: 5 time 0.00752 [TensorRT] VERBOSE: Tactic: 6 time 0.007072 [TensorRT] VERBOSE: Tactic: 7 time 0.00784 [TensorRT] VERBOSE: Tactic: 8 time 0.008352 [TensorRT] VERBOSE: Tactic: 9 time 0.01024 [TensorRT] VERBOSE: Tactic: 10 time 0.012544 [TensorRT] VERBOSE: Tactic: 11 time 0.0112 [TensorRT] VERBOSE: Tactic: 12 time 0.00944 [TensorRT] VERBOSE: Tactic: 13 time 0.010144 [TensorRT] VERBOSE: Tactic: 14 time 0.009472 [TensorRT] VERBOSE: Tactic: 15 time 0.008864 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.009472 [TensorRT] VERBOSE: Tactic: 19 time 0.008736 [TensorRT] VERBOSE: Tactic: 20 time 0.019168 [TensorRT] VERBOSE: Tactic: 21 time 0.014624 [TensorRT] VERBOSE: Tactic: 22 time 0.012192 [TensorRT] VERBOSE: Tactic: 23 time 0.0112 [TensorRT] VERBOSE: Tactic: 28 time 0.011136 [TensorRT] VERBOSE: Tactic: 29 time 0.012768 [TensorRT] VERBOSE: Tactic: 30 time 0.018272 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.007072 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022368 [TensorRT] VERBOSE: Tactic: 256 time 0.022272 [TensorRT] VERBOSE: Tactic: 512 time 0.0224 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.022272 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007616 [TensorRT] VERBOSE: Tactic: 11 time 0.007712 [TensorRT] VERBOSE: Tactic: 12 time 0.008064 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.00944 [TensorRT] VERBOSE: Tactic: 15 time 0.0112 [TensorRT] VERBOSE: Tactic: 16 time 0.014016 [TensorRT] VERBOSE: Tactic: 17 time 0.01376 [TensorRT] VERBOSE: Tactic: 18 time 0.014592 [TensorRT] VERBOSE: Tactic: 19 time 0.015904 [TensorRT] VERBOSE: Tactic: 20 time 0.008224 [TensorRT] VERBOSE: Tactic: 21 time 0.007744 [TensorRT] VERBOSE: Tactic: 22 time 0.007744 [TensorRT] VERBOSE: Tactic: 23 time 0.010848 [TensorRT] VERBOSE: Tactic: 24 time 0.009248 [TensorRT] VERBOSE: Tactic: 25 time 0.007744 [TensorRT] VERBOSE: Tactic: 26 time 0.007584 [TensorRT] VERBOSE: Tactic: 27 time 0.009216 [TensorRT] VERBOSE: Tactic: 29 time 0.02704 [TensorRT] VERBOSE: Tactic: 30 time 0.015776 [TensorRT] VERBOSE: Tactic: 31 time 0.011584 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.007584 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.341536 [TensorRT] VERBOSE: Tactic: 655359 time 0.235392 [TensorRT] VERBOSE: Tactic: 786431 time 0.182592 [TensorRT] VERBOSE: Tactic: 851967 time 0.19744 [TensorRT] VERBOSE: Tactic: 1179647 time 0.200288 [TensorRT] VERBOSE: Tactic: 1310719 time 0.384 [TensorRT] VERBOSE: Tactic: 1376255 time 0.243296 [TensorRT] VERBOSE: Tactic: 1441791 time 0.358144 [TensorRT] VERBOSE: Tactic: 1507327 time 0.236384 [TensorRT] VERBOSE: Tactic: 1638399 time 0.2496 [TensorRT] VERBOSE: Tactic: 1835007 time 0.193024 [TensorRT] VERBOSE: Tactic: 1900543 time 0.245056 [TensorRT] VERBOSE: Tactic: 2097151 time 0.219744 [TensorRT] VERBOSE: Tactic: 2162687 time 0.244352 [TensorRT] VERBOSE: Tactic: 2293759 time 0.23008 [TensorRT] VERBOSE: Tactic: 2359295 time 0.250752 [TensorRT] VERBOSE: Tactic: 2686975 time 0.230336 [TensorRT] VERBOSE: Tactic: 3080191 time 0.228992 [TensorRT] VERBOSE: Tactic: 3342335 time 0.245696 [TensorRT] VERBOSE: Tactic: 3407871 time 0.229664 [TensorRT] VERBOSE: Tactic: 3538943 time 0.192 [TensorRT] VERBOSE: Tactic: 3670015 time 0.413632 [TensorRT] VERBOSE: Tactic: 3932159 time 0.21168 [TensorRT] VERBOSE: Tactic: 3997695 time 0.194624 [TensorRT] VERBOSE: Tactic: 4063231 time 0.191776 [TensorRT] VERBOSE: Tactic: 4194303 time 0.171872 [TensorRT] VERBOSE: Tactic: 4259839 time 0.22016 [TensorRT] VERBOSE: Tactic: 4325375 time 0.236576 [TensorRT] VERBOSE: Tactic: 4521983 time 0.228224 [TensorRT] VERBOSE: Tactic: 4587519 time 0.207584 [TensorRT] VERBOSE: Tactic: 4653055 time 0.191488 [TensorRT] VERBOSE: Tactic: 4915199 time 0.174624 [TensorRT] VERBOSE: Tactic: 4980735 time 0.230208 [TensorRT] VERBOSE: Tactic: 5177343 time 0.240768 [TensorRT] VERBOSE: Tactic: 5242879 time 0.211744 [TensorRT] VERBOSE: Tactic: 5373951 time 0.222624 [TensorRT] VERBOSE: Tactic: 5439487 time 0.226048 [TensorRT] VERBOSE: Tactic: 5570559 time 0.237664 [TensorRT] VERBOSE: Tactic: 5636095 time 0.193856 [TensorRT] VERBOSE: Tactic: 5701631 time 0.227392 [TensorRT] VERBOSE: Tactic: 5767167 time 0.377536 [TensorRT] VERBOSE: Tactic: 5832703 time 0.228256 [TensorRT] VERBOSE: Tactic: 5898239 time 0.177312 [TensorRT] VERBOSE: Tactic: 6029311 time 0.219584 [TensorRT] VERBOSE: Tactic: 6225919 time 0.166176 [TensorRT] VERBOSE: Tactic: 6291455 time 0.200224 [TensorRT] VERBOSE: Tactic: 6422527 time 0.21312 [TensorRT] VERBOSE: Tactic: 6750207 time 0.197888 [TensorRT] VERBOSE: Tactic: 6815743 time 0.220128 [TensorRT] VERBOSE: Tactic: 6946815 time 0.208448 [TensorRT] VERBOSE: Tactic: 7012351 time 0.216672 [TensorRT] VERBOSE: Tactic: 7077887 time 0.193632 [TensorRT] VERBOSE: Tactic: 7143423 time 0.281088 [TensorRT] VERBOSE: Tactic: 7208959 time 0.228192 [TensorRT] VERBOSE: Tactic: 7340031 time 0.182048 [TensorRT] VERBOSE: Tactic: 7405567 time 0.180096 [TensorRT] VERBOSE: Tactic: 7536639 time 0.210912 [TensorRT] VERBOSE: Tactic: 7602175 time 0.182112 [TensorRT] VERBOSE: Tactic: 7733247 time 0.166464 [TensorRT] VERBOSE: Tactic: 7798783 time 0.18368 [TensorRT] VERBOSE: Tactic: 8191999 time 0.399424 [TensorRT] VERBOSE: Tactic: 8257535 time 0.186336 [TensorRT] VERBOSE: Tactic: 8323071 time 0.216064 [TensorRT] VERBOSE: Tactic: 8650751 time 0.216 [TensorRT] VERBOSE: Tactic: 8716287 time 0.171616 [TensorRT] VERBOSE: Tactic: 9109503 time 0.235584 [TensorRT] VERBOSE: Tactic: 9568255 time 0.1792 [TensorRT] VERBOSE: Tactic: 9895935 time 0.169184 [TensorRT] VERBOSE: Tactic: 10223615 time 0.22832 [TensorRT] VERBOSE: Tactic: 10354687 time 0.218464 [TensorRT] VERBOSE: Tactic: 10551295 time 0.171424 [TensorRT] VERBOSE: Tactic: 10747903 time 0.163456 [TensorRT] VERBOSE: Tactic: 10944511 time 0.227808 [TensorRT] VERBOSE: Fastest Tactic: 10747903 Time: 0.163456 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.114688 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.114048 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.138304 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.112032 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.116128 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.113056 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.119264 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.131072 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.145344 [TensorRT] VERBOSE: Fastest Tactic: 3915320020053085238 Time: 0.112032 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.17904 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 401408, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 37601280, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 1852928, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.17904 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.03744 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.050752 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.045472 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.041632 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.053504 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.045184 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.039968 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.037216 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.050816 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.037568 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.044608 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.038816 [TensorRT] VERBOSE: Fastest Tactic: -7924103240988931433 Time: 0.037216 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7924103240988931433 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.056256 [TensorRT] VERBOSE: Tactic: 655359 time 0.0512 [TensorRT] VERBOSE: Tactic: 786431 time 0.05008 [TensorRT] VERBOSE: Tactic: 851967 time 0.049056 [TensorRT] VERBOSE: Tactic: 1179647 time 0.060928 [TensorRT] VERBOSE: Tactic: 1310719 time 0.0512 [TensorRT] VERBOSE: Tactic: 1376255 time 0.069888 [TensorRT] VERBOSE: Tactic: 1441791 time 0.07952 [TensorRT] VERBOSE: Tactic: 1507327 time 0.048768 [TensorRT] VERBOSE: Tactic: 1638399 time 0.06544 [TensorRT] VERBOSE: Tactic: 1835007 time 0.050368 [TensorRT] VERBOSE: Tactic: 1900543 time 0.056448 [TensorRT] VERBOSE: Tactic: 2097151 time 0.049024 [TensorRT] VERBOSE: Tactic: 2162687 time 0.082848 [TensorRT] VERBOSE: Tactic: 2293759 time 0.069632 [TensorRT] VERBOSE: Tactic: 2359295 time 0.07872 [TensorRT] VERBOSE: Tactic: 2686975 time 0.078528 [TensorRT] VERBOSE: Tactic: 3080191 time 0.039808 [TensorRT] VERBOSE: Tactic: 3342335 time 0.050464 [TensorRT] VERBOSE: Tactic: 3407871 time 0.06656 [TensorRT] VERBOSE: Tactic: 3538943 time 0.06144 [TensorRT] VERBOSE: Tactic: 3670015 time 0.063104 [TensorRT] VERBOSE: Tactic: 3932159 time 0.056192 [TensorRT] VERBOSE: Tactic: 3997695 time 0.044352 [TensorRT] VERBOSE: Tactic: 4063231 time 0.043456 [TensorRT] VERBOSE: Tactic: 4194303 time 0.043424 [TensorRT] VERBOSE: Tactic: 4259839 time 0.058752 [TensorRT] VERBOSE: Tactic: 4325375 time 0.1192 [TensorRT] VERBOSE: Tactic: 4521983 time 0.120832 [TensorRT] VERBOSE: Tactic: 4587519 time 0.050656 [TensorRT] VERBOSE: Tactic: 4653055 time 0.06768 [TensorRT] VERBOSE: Tactic: 4915199 time 0.042912 [TensorRT] VERBOSE: Tactic: 4980735 time 0.121728 [TensorRT] VERBOSE: Tactic: 5177343 time 0.069504 [TensorRT] VERBOSE: Tactic: 5242879 time 0.055488 [TensorRT] VERBOSE: Tactic: 5373951 time 0.063424 [TensorRT] VERBOSE: Tactic: 5439487 time 0.05024 [TensorRT] VERBOSE: Tactic: 5570559 time 0.041472 [TensorRT] VERBOSE: Tactic: 5636095 time 0.043712 [TensorRT] VERBOSE: Tactic: 5701631 time 0.067584 [TensorRT] VERBOSE: Tactic: 5767167 time 0.07024 [TensorRT] VERBOSE: Tactic: 5832703 time 0.06112 [TensorRT] VERBOSE: Tactic: 5898239 time 0.056384 [TensorRT] VERBOSE: Tactic: 6029311 time 0.061792 [TensorRT] VERBOSE: Tactic: 6225919 time 0.050752 [TensorRT] VERBOSE: Tactic: 6291455 time 0.060896 [TensorRT] VERBOSE: Tactic: 6422527 time 0.039488 [TensorRT] VERBOSE: Tactic: 6750207 time 0.050144 [TensorRT] VERBOSE: Tactic: 6815743 time 0.0584 [TensorRT] VERBOSE: Tactic: 6946815 time 0.052224 [TensorRT] VERBOSE: Tactic: 7012351 time 0.049504 [TensorRT] VERBOSE: Tactic: 7077887 time 0.056384 [TensorRT] VERBOSE: Tactic: 7143423 time 0.073984 [TensorRT] VERBOSE: Tactic: 7208959 time 0.062144 [TensorRT] VERBOSE: Tactic: 7340031 time 0.057376 [TensorRT] VERBOSE: Tactic: 7405567 time 0.043616 [TensorRT] VERBOSE: Tactic: 7536639 time 0.070144 [TensorRT] VERBOSE: Tactic: 7602175 time 0.051456 [TensorRT] VERBOSE: Tactic: 7733247 time 0.054528 [TensorRT] VERBOSE: Tactic: 7798783 time 0.048768 [TensorRT] VERBOSE: Tactic: 8191999 time 0.080576 [TensorRT] VERBOSE: Tactic: 8257535 time 0.044224 [TensorRT] VERBOSE: Tactic: 8323071 time 0.049344 [TensorRT] VERBOSE: Tactic: 8650751 time 0.056896 [TensorRT] VERBOSE: Tactic: 8716287 time 0.05376 [TensorRT] VERBOSE: Tactic: 9109503 time 0.055104 [TensorRT] VERBOSE: Tactic: 9568255 time 0.042848 [TensorRT] VERBOSE: Tactic: 9895935 time 0.0432 [TensorRT] VERBOSE: Tactic: 10223615 time 0.077024 [TensorRT] VERBOSE: Tactic: 10354687 time 0.108288 [TensorRT] VERBOSE: Tactic: 10551295 time 0.049248 [TensorRT] VERBOSE: Tactic: 10747903 time 0.053856 [TensorRT] VERBOSE: Tactic: 10944511 time 0.121696 [TensorRT] VERBOSE: Fastest Tactic: 6422527 Time: 0.039488 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.034112 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.03264 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.035456 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.033792 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.048064 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.033056 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.038048 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.03424 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.033152 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.036928 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.048576 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.047552 [TensorRT] VERBOSE: Fastest Tactic: 4000990898022781625 Time: 0.03264 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4000990898022781625 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.03328 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.047488 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.038112 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.033536 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.037376 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.034528 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.047264 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.047456 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.033056 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.033792 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.036192 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.033216 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.033056 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.050592 [TensorRT] VERBOSE: Tactic: 655359 time 0.048192 [TensorRT] VERBOSE: Tactic: 786431 time 0.057344 [TensorRT] VERBOSE: Tactic: 851967 time 0.045696 [TensorRT] VERBOSE: Tactic: 1179647 time 0.066528 [TensorRT] VERBOSE: Tactic: 1310719 time 0.052768 [TensorRT] VERBOSE: Tactic: 1376255 time 0.072992 [TensorRT] VERBOSE: Tactic: 1441791 time 0.078848 [TensorRT] VERBOSE: Tactic: 1507327 time 0.046848 [TensorRT] VERBOSE: Tactic: 1638399 time 0.067424 [TensorRT] VERBOSE: Tactic: 1835007 time 0.062336 [TensorRT] VERBOSE: Tactic: 1900543 time 0.051072 [TensorRT] VERBOSE: Tactic: 2097151 time 0.060416 [TensorRT] VERBOSE: Tactic: 2162687 time 0.079488 [TensorRT] VERBOSE: Tactic: 2293759 time 0.07296 [TensorRT] VERBOSE: Tactic: 2359295 time 0.080192 [TensorRT] VERBOSE: Tactic: 2686975 time 0.07792 [TensorRT] VERBOSE: Tactic: 3080191 time 0.035904 [TensorRT] VERBOSE: Tactic: 3342335 time 0.046496 [TensorRT] VERBOSE: Tactic: 3407871 time 0.072416 [TensorRT] VERBOSE: Tactic: 3538943 time 0.068288 [TensorRT] VERBOSE: Tactic: 3670015 time 0.06352 [TensorRT] VERBOSE: Tactic: 3932159 time 0.054432 [TensorRT] VERBOSE: Tactic: 3997695 time 0.053152 [TensorRT] VERBOSE: Tactic: 4063231 time 0.04096 [TensorRT] VERBOSE: Tactic: 4194303 time 0.055008 [TensorRT] VERBOSE: Tactic: 4259839 time 0.062496 [TensorRT] VERBOSE: Tactic: 4325375 time 0.129024 [TensorRT] VERBOSE: Tactic: 4521983 time 0.127456 [TensorRT] VERBOSE: Tactic: 4587519 time 0.058656 [TensorRT] VERBOSE: Tactic: 4653055 time 0.07216 [TensorRT] VERBOSE: Tactic: 4915199 time 0.050272 [TensorRT] VERBOSE: Tactic: 4980735 time 0.132352 [TensorRT] VERBOSE: Tactic: 5177343 time 0.073504 [TensorRT] VERBOSE: Tactic: 5242879 time 0.065248 [TensorRT] VERBOSE: Tactic: 5373951 time 0.065952 [TensorRT] VERBOSE: Tactic: 5439487 time 0.061504 [TensorRT] VERBOSE: Tactic: 5570559 time 0.03792 [TensorRT] VERBOSE: Tactic: 5636095 time 0.04016 [TensorRT] VERBOSE: Tactic: 5701631 time 0.07136 [TensorRT] VERBOSE: Tactic: 5767167 time 0.094592 [TensorRT] VERBOSE: Tactic: 5832703 time 0.069088 [TensorRT] VERBOSE: Tactic: 5898239 time 0.060448 [TensorRT] VERBOSE: Tactic: 6029311 time 0.062976 [TensorRT] VERBOSE: Tactic: 6225919 time 0.060352 [TensorRT] VERBOSE: Tactic: 6291455 time 0.0664 [TensorRT] VERBOSE: Tactic: 6422527 time 0.0368 [TensorRT] VERBOSE: Tactic: 6750207 time 0.064544 [TensorRT] VERBOSE: Tactic: 6815743 time 0.063456 [TensorRT] VERBOSE: Tactic: 6946815 time 0.065056 [TensorRT] VERBOSE: Tactic: 7012351 time 0.060832 [TensorRT] VERBOSE: Tactic: 7077887 time 0.06288 [TensorRT] VERBOSE: Tactic: 7143423 time 0.105856 [TensorRT] VERBOSE: Tactic: 7208959 time 0.075584 [TensorRT] VERBOSE: Tactic: 7340031 time 0.061344 [TensorRT] VERBOSE: Tactic: 7405567 time 0.042624 [TensorRT] VERBOSE: Tactic: 7536639 time 0.07728 [TensorRT] VERBOSE: Tactic: 7602175 time 0.063616 [TensorRT] VERBOSE: Tactic: 7733247 time 0.058784 [TensorRT] VERBOSE: Tactic: 7798783 time 0.057856 [TensorRT] VERBOSE: Tactic: 8191999 time 0.098912 [TensorRT] VERBOSE: Tactic: 8257535 time 0.049664 [TensorRT] VERBOSE: Tactic: 8323071 time 0.063968 [TensorRT] VERBOSE: Tactic: 8650751 time 0.07248 [TensorRT] VERBOSE: Tactic: 8716287 time 0.0584 [TensorRT] VERBOSE: Tactic: 9109503 time 0.0552 [TensorRT] VERBOSE: Tactic: 9568255 time 0.050592 [TensorRT] VERBOSE: Tactic: 9895935 time 0.055296 [TensorRT] VERBOSE: Tactic: 10223615 time 0.080736 [TensorRT] VERBOSE: Tactic: 10354687 time 0.113344 [TensorRT] VERBOSE: Tactic: 10551295 time 0.064416 [TensorRT] VERBOSE: Tactic: 10747903 time 0.05904 [TensorRT] VERBOSE: Tactic: 10944511 time 0.130752 [TensorRT] VERBOSE: Fastest Tactic: 3080191 Time: 0.035904 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.016384 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.022176 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.017376 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.017312 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.022336 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.0168 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.017408 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.01712 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.017408 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.017408 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.022048 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.015648 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.015648 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019552 [TensorRT] VERBOSE: Tactic: 256 time 0.018752 [TensorRT] VERBOSE: Tactic: 512 time 0.019456 [TensorRT] VERBOSE: Tactic: -32 time 0.045888 [TensorRT] VERBOSE: Tactic: -64 time 0.026688 [TensorRT] VERBOSE: Tactic: -128 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.018752 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.012896 [TensorRT] VERBOSE: Tactic: 1 time 0.012064 [TensorRT] VERBOSE: Tactic: 2 time 0.011328 [TensorRT] VERBOSE: Tactic: 3 time 0.012512 [TensorRT] VERBOSE: Tactic: 4 time 0.011232 [TensorRT] VERBOSE: Tactic: 5 time 0.010784 [TensorRT] VERBOSE: Tactic: 6 time 0.013472 [TensorRT] VERBOSE: Tactic: 7 time 0.012864 [TensorRT] VERBOSE: Tactic: 8 time 0.011584 [TensorRT] VERBOSE: Tactic: 9 time 0.012288 [TensorRT] VERBOSE: Tactic: 28 time 0.013536 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.010784 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01952 [TensorRT] VERBOSE: Tactic: 256 time 0.019712 [TensorRT] VERBOSE: Tactic: 512 time 0.019648 [TensorRT] VERBOSE: Tactic: -32 time 0.043264 [TensorRT] VERBOSE: Tactic: -64 time 0.028672 [TensorRT] VERBOSE: Tactic: -128 time 0.025696 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01952 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.015648 [TensorRT] VERBOSE: Tactic: 25 time 0.016192 [TensorRT] VERBOSE: Tactic: 26 time 0.015232 [TensorRT] VERBOSE: Tactic: 27 time 0.013696 [TensorRT] VERBOSE: Tactic: 31 time 0.014816 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.013696 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] WARNING: No implementation of layer LeakyRelu_126 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02544 [TensorRT] VERBOSE: Tactic: 0 time 0.048416 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02544 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04368 [TensorRT] VERBOSE: Tactic: 0 time 0.023008 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023008 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.008384 [TensorRT] VERBOSE: Tactic: 0 time 0.006656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006656 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.013152 [TensorRT] VERBOSE: Tactic: 0 time 0.025152 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.013152 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017344 [TensorRT] VERBOSE: Tactic: 0 time 0.01088 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01088 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015456 [TensorRT] VERBOSE: Tactic: 0 time 0.018496 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015456 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0224 [TensorRT] VERBOSE: Tactic: 0 time 0.012544 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012544 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014144 [TensorRT] VERBOSE: Tactic: 0 time 0.006208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006208 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016928 [TensorRT] VERBOSE: Tactic: 0 time 0.012096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012096 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015616 [TensorRT] VERBOSE: Tactic: 0 time 0.021888 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015616 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016064 [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01552 [TensorRT] VERBOSE: Tactic: 0 time 0.018432 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01552 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022112 [TensorRT] VERBOSE: Tactic: 0 time 0.012864 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012864 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017344 [TensorRT] VERBOSE: Tactic: 0 time 0.012416 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012416 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016384 [TensorRT] VERBOSE: Tactic: 0 time 0.021888 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016384 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01744 [TensorRT] VERBOSE: Tactic: 0 time 0.006304 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006304 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016896 [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006144 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016384 [TensorRT] VERBOSE: Tactic: 0 time 0.009344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009344 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017184 [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009216 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.172768 [TensorRT] VERBOSE: Tactic: 655359 time 0.120256 [TensorRT] VERBOSE: Tactic: 786431 time 0.05872 [TensorRT] VERBOSE: Tactic: 851967 time 0.07312 [TensorRT] VERBOSE: Tactic: 1179647 time 0.060352 [TensorRT] VERBOSE: Tactic: 1310719 time 0.128224 [TensorRT] VERBOSE: Tactic: 1376255 time 0.123264 [TensorRT] VERBOSE: Tactic: 1441791 time 0.096608 [TensorRT] VERBOSE: Tactic: 1507327 time 0.082528 [TensorRT] VERBOSE: Tactic: 1638399 time 0.080416 [TensorRT] VERBOSE: Tactic: 1835007 time 0.060448 [TensorRT] VERBOSE: Tactic: 1900543 time 0.120352 [TensorRT] VERBOSE: Tactic: 2097151 time 0.060224 [TensorRT] VERBOSE: Tactic: 2162687 time 0.123264 [TensorRT] VERBOSE: Tactic: 2293759 time 0.112896 [TensorRT] VERBOSE: Tactic: 2359295 time 0.078336 [TensorRT] VERBOSE: Tactic: 2686975 time 0.116992 [TensorRT] VERBOSE: Tactic: 3080191 time 0.073568 [TensorRT] VERBOSE: Tactic: 3342335 time 0.074272 [TensorRT] VERBOSE: Tactic: 3407871 time 0.07472 [TensorRT] VERBOSE: Tactic: 3538943 time 0.06912 [TensorRT] VERBOSE: Tactic: 3670015 time 0.208032 [TensorRT] VERBOSE: Tactic: 3932159 time 0.109152 [TensorRT] VERBOSE: Tactic: 3997695 time 0.0568 [TensorRT] VERBOSE: Tactic: 4063231 time 0.070816 [TensorRT] VERBOSE: Tactic: 4194303 time 0.058144 [TensorRT] VERBOSE: Tactic: 4259839 time 0.06224 [TensorRT] VERBOSE: Tactic: 4325375 time 0.070304 [TensorRT] VERBOSE: Tactic: 4521983 time 0.108416 [TensorRT] VERBOSE: Tactic: 4587519 time 0.058176 [TensorRT] VERBOSE: Tactic: 4653055 time 0.054624 [TensorRT] VERBOSE: Tactic: 4915199 time 0.054688 [TensorRT] VERBOSE: Tactic: 4980735 time 0.07168 [TensorRT] VERBOSE: Tactic: 5177343 time 0.06736 [TensorRT] VERBOSE: Tactic: 5242879 time 0.070944 [TensorRT] VERBOSE: Tactic: 5373951 time 0.0696 [TensorRT] VERBOSE: Tactic: 5439487 time 0.078656 [TensorRT] VERBOSE: Tactic: 5570559 time 0.074464 [TensorRT] VERBOSE: Tactic: 5636095 time 0.074592 [TensorRT] VERBOSE: Tactic: 5701631 time 0.115424 [TensorRT] VERBOSE: Tactic: 5767167 time 0.086368 [TensorRT] VERBOSE: Tactic: 5832703 time 0.07168 [TensorRT] VERBOSE: Tactic: 5898239 time 0.056 [TensorRT] VERBOSE: Tactic: 6029311 time 0.11264 [TensorRT] VERBOSE: Tactic: 6225919 time 0.052224 [TensorRT] VERBOSE: Tactic: 6291455 time 0.059584 [TensorRT] VERBOSE: Tactic: 6422527 time 0.068704 [TensorRT] VERBOSE: Tactic: 6750207 time 0.06112 [TensorRT] VERBOSE: Tactic: 6815743 time 0.071968 [TensorRT] VERBOSE: Tactic: 6946815 time 0.059712 [TensorRT] VERBOSE: Tactic: 7012351 time 0.061152 [TensorRT] VERBOSE: Tactic: 7077887 time 0.068096 [TensorRT] VERBOSE: Tactic: 7143423 time 0.08192 [TensorRT] VERBOSE: Tactic: 7208959 time 0.074208 [TensorRT] VERBOSE: Tactic: 7340031 time 0.056832 [TensorRT] VERBOSE: Tactic: 7405567 time 0.063296 [TensorRT] VERBOSE: Tactic: 7536639 time 0.104448 [TensorRT] VERBOSE: Tactic: 7602175 time 0.05968 [TensorRT] VERBOSE: Tactic: 7733247 time 0.055392 [TensorRT] VERBOSE: Tactic: 7798783 time 0.058784 [TensorRT] VERBOSE: Tactic: 8191999 time 0.080256 [TensorRT] VERBOSE: Tactic: 8257535 time 0.05776 [TensorRT] VERBOSE: Tactic: 8323071 time 0.074528 [TensorRT] VERBOSE: Tactic: 8650751 time 0.061216 [TensorRT] VERBOSE: Tactic: 8716287 time 0.05488 [TensorRT] VERBOSE: Tactic: 9109503 time 0.062944 [TensorRT] VERBOSE: Tactic: 9568255 time 0.054688 [TensorRT] VERBOSE: Tactic: 9895935 time 0.058336 [TensorRT] VERBOSE: Tactic: 10223615 time 0.115712 [TensorRT] VERBOSE: Tactic: 10354687 time 0.062496 [TensorRT] VERBOSE: Tactic: 10551295 time 0.075136 [TensorRT] VERBOSE: Tactic: 10747903 time 0.054944 [TensorRT] VERBOSE: Tactic: 10944511 time 0.072256 [TensorRT] VERBOSE: Fastest Tactic: 6225919 Time: 0.052224 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.060672 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.061376 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.06944 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.06176 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.046656 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.0456 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.0496 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.062016 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.07312 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.0456 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.05968 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 200704, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 9887744, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.05952 [TensorRT] VERBOSE: Fastest Tactic: 57 Time: 0.05952 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.02288 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.024384 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.023552 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.01744 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.023776 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.024224 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.0176 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.016736 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.023808 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.02272 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.022528 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.022592 [TensorRT] VERBOSE: Fastest Tactic: -7924103240988931433 Time: 0.016736 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7924103240988931433 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.02624 [TensorRT] VERBOSE: Tactic: 655359 time 0.024064 [TensorRT] VERBOSE: Tactic: 786431 time 0.01888 [TensorRT] VERBOSE: Tactic: 851967 time 0.018752 [TensorRT] VERBOSE: Tactic: 1179647 time 0.021984 [TensorRT] VERBOSE: Tactic: 1310719 time 0.021888 [TensorRT] VERBOSE: Tactic: 1376255 time 0.03152 [TensorRT] VERBOSE: Tactic: 1441791 time 0.026432 [TensorRT] VERBOSE: Tactic: 1507327 time 0.02048 [TensorRT] VERBOSE: Tactic: 1638399 time 0.022816 [TensorRT] VERBOSE: Tactic: 1835007 time 0.020256 [TensorRT] VERBOSE: Tactic: 1900543 time 0.024672 [TensorRT] VERBOSE: Tactic: 2097151 time 0.018944 [TensorRT] VERBOSE: Tactic: 2162687 time 0.040128 [TensorRT] VERBOSE: Tactic: 2293759 time 0.028192 [TensorRT] VERBOSE: Tactic: 2359295 time 0.032992 [TensorRT] VERBOSE: Tactic: 2686975 time 0.031616 [TensorRT] VERBOSE: Tactic: 3080191 time 0.018624 [TensorRT] VERBOSE: Tactic: 3342335 time 0.020704 [TensorRT] VERBOSE: Tactic: 3407871 time 0.022144 [TensorRT] VERBOSE: Tactic: 3538943 time 0.02176 [TensorRT] VERBOSE: Tactic: 3670015 time 0.032768 [TensorRT] VERBOSE: Tactic: 3932159 time 0.023648 [TensorRT] VERBOSE: Tactic: 3997695 time 0.017728 [TensorRT] VERBOSE: Tactic: 4063231 time 0.019424 [TensorRT] VERBOSE: Tactic: 4194303 time 0.018112 [TensorRT] VERBOSE: Tactic: 4259839 time 0.022112 [TensorRT] VERBOSE: Tactic: 4325375 time 0.036416 [TensorRT] VERBOSE: Tactic: 4521983 time 0.04 [TensorRT] VERBOSE: Tactic: 4587519 time 0.019008 [TensorRT] VERBOSE: Tactic: 4653055 time 0.02352 [TensorRT] VERBOSE: Tactic: 4915199 time 0.017408 [TensorRT] VERBOSE: Tactic: 4980735 time 0.041184 [TensorRT] VERBOSE: Tactic: 5177343 time 0.023776 [TensorRT] VERBOSE: Tactic: 5242879 time 0.02048 [TensorRT] VERBOSE: Tactic: 5373951 time 0.021792 [TensorRT] VERBOSE: Tactic: 5439487 time 0.019072 [TensorRT] VERBOSE: Tactic: 5570559 time 0.017408 [TensorRT] VERBOSE: Tactic: 5636095 time 0.01888 [TensorRT] VERBOSE: Tactic: 5701631 time 0.027648 [TensorRT] VERBOSE: Tactic: 5767167 time 0.023872 [TensorRT] VERBOSE: Tactic: 5832703 time 0.022016 [TensorRT] VERBOSE: Tactic: 5898239 time 0.021056 [TensorRT] VERBOSE: Tactic: 6029311 time 0.024384 [TensorRT] VERBOSE: Tactic: 6225919 time 0.018752 [TensorRT] VERBOSE: Tactic: 6291455 time 0.02224 [TensorRT] VERBOSE: Tactic: 6422527 time 0.017408 [TensorRT] VERBOSE: Tactic: 6750207 time 0.018176 [TensorRT] VERBOSE: Tactic: 6815743 time 0.021536 [TensorRT] VERBOSE: Tactic: 6946815 time 0.02032 [TensorRT] VERBOSE: Tactic: 7012351 time 0.01904 [TensorRT] VERBOSE: Tactic: 7077887 time 0.019264 [TensorRT] VERBOSE: Tactic: 7143423 time 0.024064 [TensorRT] VERBOSE: Tactic: 7208959 time 0.02192 [TensorRT] VERBOSE: Tactic: 7340031 time 0.021984 [TensorRT] VERBOSE: Tactic: 7405567 time 0.017312 [TensorRT] VERBOSE: Tactic: 7536639 time 0.027136 [TensorRT] VERBOSE: Tactic: 7602175 time 0.0192 [TensorRT] VERBOSE: Tactic: 7733247 time 0.020512 [TensorRT] VERBOSE: Tactic: 7798783 time 0.019168 [TensorRT] VERBOSE: Tactic: 8191999 time 0.025504 [TensorRT] VERBOSE: Tactic: 8257535 time 0.017344 [TensorRT] VERBOSE: Tactic: 8323071 time 0.018944 [TensorRT] VERBOSE: Tactic: 8650751 time 0.02064 [TensorRT] VERBOSE: Tactic: 8716287 time 0.018816 [TensorRT] VERBOSE: Tactic: 9109503 time 0.02096 [TensorRT] VERBOSE: Tactic: 9568255 time 0.016384 [TensorRT] VERBOSE: Tactic: 9895935 time 0.018432 [TensorRT] VERBOSE: Tactic: 10223615 time 0.031104 [TensorRT] VERBOSE: Tactic: 10354687 time 0.034272 [TensorRT] VERBOSE: Tactic: 10551295 time 0.020704 [TensorRT] VERBOSE: Tactic: 10747903 time 0.019744 [TensorRT] VERBOSE: Tactic: 10944511 time 0.041088 [TensorRT] VERBOSE: Fastest Tactic: 9568255 Time: 0.016384 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.01584 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.020352 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.01552 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.014528 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.020896 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.02048 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.022272 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.020512 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.02048 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.021536 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.020512 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.020512 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.014528 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4581732244273465060 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.020288 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.020736 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.022112 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.014336 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.021504 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.014912 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.02048 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.021152 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.020736 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.020384 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.015616 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.020416 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.023008 [TensorRT] VERBOSE: Tactic: 655359 time 0.021856 [TensorRT] VERBOSE: Tactic: 786431 time 0.02048 [TensorRT] VERBOSE: Tactic: 851967 time 0.017344 [TensorRT] VERBOSE: Tactic: 1179647 time 0.023456 [TensorRT] VERBOSE: Tactic: 1310719 time 0.02224 [TensorRT] VERBOSE: Tactic: 1376255 time 0.032512 [TensorRT] VERBOSE: Tactic: 1441791 time 0.026304 [TensorRT] VERBOSE: Tactic: 1507327 time 0.018976 [TensorRT] VERBOSE: Tactic: 1638399 time 0.023488 [TensorRT] VERBOSE: Tactic: 1835007 time 0.019712 [TensorRT] VERBOSE: Tactic: 1900543 time 0.023904 [TensorRT] VERBOSE: Tactic: 2097151 time 0.022048 [TensorRT] VERBOSE: Tactic: 2162687 time 0.037888 [TensorRT] VERBOSE: Tactic: 2293759 time 0.026624 [TensorRT] VERBOSE: Tactic: 2359295 time 0.028448 [TensorRT] VERBOSE: Tactic: 2686975 time 0.030176 [TensorRT] VERBOSE: Tactic: 3080191 time 0.015712 [TensorRT] VERBOSE: Tactic: 3342335 time 0.018688 [TensorRT] VERBOSE: Tactic: 3407871 time 0.023904 [TensorRT] VERBOSE: Tactic: 3538943 time 0.023328 [TensorRT] VERBOSE: Tactic: 3670015 time 0.029984 [TensorRT] VERBOSE: Tactic: 3932159 time 0.019456 [TensorRT] VERBOSE: Tactic: 3997695 time 0.018752 [TensorRT] VERBOSE: Tactic: 4063231 time 0.017824 [TensorRT] VERBOSE: Tactic: 4194303 time 0.020384 [TensorRT] VERBOSE: Tactic: 4259839 time 0.023264 [TensorRT] VERBOSE: Tactic: 4325375 time 0.038048 [TensorRT] VERBOSE: Tactic: 4521983 time 0.04272 [TensorRT] VERBOSE: Tactic: 4587519 time 0.020064 [TensorRT] VERBOSE: Tactic: 4653055 time 0.02384 [TensorRT] VERBOSE: Tactic: 4915199 time 0.018912 [TensorRT] VERBOSE: Tactic: 4980735 time 0.04352 [TensorRT] VERBOSE: Tactic: 5177343 time 0.025376 [TensorRT] VERBOSE: Tactic: 5242879 time 0.021856 [TensorRT] VERBOSE: Tactic: 5373951 time 0.023552 [TensorRT] VERBOSE: Tactic: 5439487 time 0.020352 [TensorRT] VERBOSE: Tactic: 5570559 time 0.015328 [TensorRT] VERBOSE: Tactic: 5636095 time 0.01728 [TensorRT] VERBOSE: Tactic: 5701631 time 0.025888 [TensorRT] VERBOSE: Tactic: 5767167 time 0.028352 [TensorRT] VERBOSE: Tactic: 5832703 time 0.02336 [TensorRT] VERBOSE: Tactic: 5898239 time 0.021056 [TensorRT] VERBOSE: Tactic: 6029311 time 0.023488 [TensorRT] VERBOSE: Tactic: 6225919 time 0.020512 [TensorRT] VERBOSE: Tactic: 6291455 time 0.022048 [TensorRT] VERBOSE: Tactic: 6422527 time 0.015488 [TensorRT] VERBOSE: Tactic: 6750207 time 0.021216 [TensorRT] VERBOSE: Tactic: 6815743 time 0.021792 [TensorRT] VERBOSE: Tactic: 6946815 time 0.021056 [TensorRT] VERBOSE: Tactic: 7012351 time 0.02192 [TensorRT] VERBOSE: Tactic: 7077887 time 0.020928 [TensorRT] VERBOSE: Tactic: 7143423 time 0.031584 [TensorRT] VERBOSE: Tactic: 7208959 time 0.026304 [TensorRT] VERBOSE: Tactic: 7340031 time 0.020832 [TensorRT] VERBOSE: Tactic: 7405567 time 0.017248 [TensorRT] VERBOSE: Tactic: 7536639 time 0.027136 [TensorRT] VERBOSE: Tactic: 7602175 time 0.022016 [TensorRT] VERBOSE: Tactic: 7733247 time 0.02048 [TensorRT] VERBOSE: Tactic: 7798783 time 0.019456 [TensorRT] VERBOSE: Tactic: 8191999 time 0.03056 [TensorRT] VERBOSE: Tactic: 8257535 time 0.018656 [TensorRT] VERBOSE: Tactic: 8323071 time 0.022336 [TensorRT] VERBOSE: Tactic: 8650751 time 0.023552 [TensorRT] VERBOSE: Tactic: 8716287 time 0.019456 [TensorRT] VERBOSE: Tactic: 9109503 time 0.020576 [TensorRT] VERBOSE: Tactic: 9568255 time 0.018656 [TensorRT] VERBOSE: Tactic: 9895935 time 0.020416 [TensorRT] VERBOSE: Tactic: 10223615 time 0.029376 [TensorRT] VERBOSE: Tactic: 10354687 time 0.034752 [TensorRT] VERBOSE: Tactic: 10551295 time 0.022048 [TensorRT] VERBOSE: Tactic: 10747903 time 0.01936 [TensorRT] VERBOSE: Tactic: 10944511 time 0.042752 [TensorRT] VERBOSE: Fastest Tactic: 5570559 Time: 0.015328 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.012576 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.015744 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.012416 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.012288 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.015744 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.012288 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.012576 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.012288 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.012288 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.012352 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.01536 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.01232 [TensorRT] VERBOSE: Fastest Tactic: 7039764449991095921 Time: 0.012288 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7039764449991095921 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014656 [TensorRT] VERBOSE: Tactic: 0 time 0.02544 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.014656 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015904 [TensorRT] VERBOSE: Tactic: 0 time 0.026336 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015904 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01664 [TensorRT] VERBOSE: Tactic: 0 time 0.026112 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01664 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011296 [TensorRT] VERBOSE: Tactic: 256 time 0.011392 [TensorRT] VERBOSE: Tactic: 512 time 0.01152 [TensorRT] VERBOSE: Tactic: -32 time 0.027552 [TensorRT] VERBOSE: Tactic: -64 time 0.01744 [TensorRT] VERBOSE: Tactic: -128 time 0.014656 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011296 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007168 [TensorRT] VERBOSE: Tactic: 1 time 0.006496 [TensorRT] VERBOSE: Tactic: 2 time 0.006336 [TensorRT] VERBOSE: Tactic: 3 time 0.00656 [TensorRT] VERBOSE: Tactic: 4 time 0.006496 [TensorRT] VERBOSE: Tactic: 5 time 0.006304 [TensorRT] VERBOSE: Tactic: 6 time 0.006336 [TensorRT] VERBOSE: Tactic: 7 time 0.006816 [TensorRT] VERBOSE: Tactic: 8 time 0.006272 [TensorRT] VERBOSE: Tactic: 9 time 0.006592 [TensorRT] VERBOSE: Tactic: 28 time 0.006432 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.006272 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01152 [TensorRT] VERBOSE: Tactic: 256 time 0.011264 [TensorRT] VERBOSE: Tactic: 512 time 0.011328 [TensorRT] VERBOSE: Tactic: -32 time 0.027424 [TensorRT] VERBOSE: Tactic: -64 time 0.018368 [TensorRT] VERBOSE: Tactic: -128 time 0.014272 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009504 [TensorRT] VERBOSE: Tactic: 25 time 0.00912 [TensorRT] VERBOSE: Tactic: 26 time 0.008192 [TensorRT] VERBOSE: Tactic: 27 time 0.008256 [TensorRT] VERBOSE: Tactic: 31 time 0.009088 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.008192 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014336 [TensorRT] VERBOSE: Tactic: 256 time 0.01424 [TensorRT] VERBOSE: Tactic: 512 time 0.013824 [TensorRT] VERBOSE: Tactic: -32 time 0.024736 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.017312 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.013824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005984 [TensorRT] VERBOSE: Tactic: 1 time 0.006016 [TensorRT] VERBOSE: Tactic: 2 time 0.00624 [TensorRT] VERBOSE: Tactic: 3 time 0.005984 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.00608 [TensorRT] VERBOSE: Tactic: 6 time 0.006752 [TensorRT] VERBOSE: Tactic: 7 time 0.007616 [TensorRT] VERBOSE: Tactic: 8 time 0.007616 [TensorRT] VERBOSE: Tactic: 9 time 0.007584 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.007968 [TensorRT] VERBOSE: Tactic: 12 time 0.007552 [TensorRT] VERBOSE: Tactic: 13 time 0.007616 [TensorRT] VERBOSE: Tactic: 14 time 0.00752 [TensorRT] VERBOSE: Tactic: 15 time 0.007808 [TensorRT] VERBOSE: Tactic: 16 time 0.007584 [TensorRT] VERBOSE: Tactic: 17 time 0.007552 [TensorRT] VERBOSE: Tactic: 18 time 0.00784 [TensorRT] VERBOSE: Tactic: 19 time 0.007808 [TensorRT] VERBOSE: Tactic: 20 time 0.012544 [TensorRT] VERBOSE: Tactic: 21 time 0.009216 [TensorRT] VERBOSE: Tactic: 22 time 0.007616 [TensorRT] VERBOSE: Tactic: 23 time 0.007488 [TensorRT] VERBOSE: Tactic: 28 time 0.00736 [TensorRT] VERBOSE: Tactic: 29 time 0.00912 [TensorRT] VERBOSE: Tactic: 30 time 0.010848 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014112 [TensorRT] VERBOSE: Tactic: 256 time 0.014048 [TensorRT] VERBOSE: Tactic: 512 time 0.014112 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014048 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006304 [TensorRT] VERBOSE: Tactic: 11 time 0.00752 [TensorRT] VERBOSE: Tactic: 12 time 0.007072 [TensorRT] VERBOSE: Tactic: 13 time 0.009088 [TensorRT] VERBOSE: Tactic: 14 time 0.009248 [TensorRT] VERBOSE: Tactic: 15 time 0.010656 [TensorRT] VERBOSE: Tactic: 16 time 0.013376 [TensorRT] VERBOSE: Tactic: 17 time 0.013984 [TensorRT] VERBOSE: Tactic: 18 time 0.013632 [TensorRT] VERBOSE: Tactic: 19 time 0.01552 [TensorRT] VERBOSE: Tactic: 20 time 0.006048 [TensorRT] VERBOSE: Tactic: 21 time 0.006048 [TensorRT] VERBOSE: Tactic: 22 time 0.007616 [TensorRT] VERBOSE: Tactic: 23 time 0.009152 [TensorRT] VERBOSE: Tactic: 24 time 0.00608 [TensorRT] VERBOSE: Tactic: 25 time 0.006016 [TensorRT] VERBOSE: Tactic: 26 time 0.006016 [TensorRT] VERBOSE: Tactic: 27 time 0.007616 [TensorRT] VERBOSE: Tactic: 29 time 0.01552 [TensorRT] VERBOSE: Tactic: 30 time 0.011072 [TensorRT] VERBOSE: Tactic: 31 time 0.007808 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.283136 [TensorRT] VERBOSE: Tactic: 720895 time 0.343552 [TensorRT] VERBOSE: Tactic: 983039 time 0.225152 [TensorRT] VERBOSE: Tactic: 1048575 time 0.317472 [TensorRT] VERBOSE: Tactic: 1703935 time 0.265312 [TensorRT] VERBOSE: Tactic: 1769471 time 0.240896 [TensorRT] VERBOSE: Tactic: 1966079 time 0.399264 [TensorRT] VERBOSE: Tactic: 2031615 time 0.444288 [TensorRT] VERBOSE: Tactic: 2228223 time 0.361568 [TensorRT] VERBOSE: Tactic: 2424831 time 0.293088 [TensorRT] VERBOSE: Tactic: 2621439 time 0.263392 [TensorRT] VERBOSE: Tactic: 2752511 time 0.292864 [TensorRT] VERBOSE: Tactic: 2818047 time 0.2768 [TensorRT] VERBOSE: Tactic: 2883583 time 0.47936 [TensorRT] VERBOSE: Tactic: 3014655 time 0.227584 [TensorRT] VERBOSE: Tactic: 3145727 time 0.213568 [TensorRT] VERBOSE: Tactic: 3473407 time 0.32464 [TensorRT] VERBOSE: Tactic: 3604479 time 0.224896 [TensorRT] VERBOSE: Tactic: 3735551 time 0.266976 [TensorRT] VERBOSE: Tactic: 4390911 time 0.425056 [TensorRT] VERBOSE: Tactic: 5046271 time 0.2816 [TensorRT] VERBOSE: Tactic: 5963775 time 0.376352 [TensorRT] VERBOSE: Tactic: 6160383 time 0.2688 [TensorRT] VERBOSE: Tactic: 6488063 time 0.237504 [TensorRT] VERBOSE: Tactic: 6881279 time 0.369408 [TensorRT] VERBOSE: Tactic: 7274495 time 0.247168 [TensorRT] VERBOSE: Tactic: 7864319 time 0.265056 [TensorRT] VERBOSE: Tactic: 7995391 time 0.275872 [TensorRT] VERBOSE: Tactic: 8585215 time 0.304064 [TensorRT] VERBOSE: Tactic: 8847359 time 0.25312 [TensorRT] VERBOSE: Tactic: 8978431 time 0.37776 [TensorRT] VERBOSE: Tactic: 9043967 time 0.207136 [TensorRT] VERBOSE: Tactic: 9175039 time 0.224672 [TensorRT] VERBOSE: Tactic: 9502719 time 0.421888 [TensorRT] VERBOSE: Tactic: 9830399 time 0.255904 [TensorRT] VERBOSE: Tactic: 9961471 time 0.265184 [TensorRT] VERBOSE: Tactic: 10027007 time 0.275424 [TensorRT] VERBOSE: Tactic: 10092543 time 0.425472 [TensorRT] VERBOSE: Tactic: 10289151 time 0.398336 [TensorRT] VERBOSE: Tactic: 10485759 time 0.218944 [TensorRT] VERBOSE: Tactic: 10682367 time 0.253504 [TensorRT] VERBOSE: Tactic: 10813439 time 0.246784 [TensorRT] VERBOSE: Fastest Tactic: 9043967 Time: 0.207136 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.471776 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.123424 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.374656 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.463968 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.477472 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.332864 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.377152 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.454688 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.545792 [TensorRT] VERBOSE: Fastest Tactic: 2775507031594384867 Time: 0.123424 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.384448 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 1806336, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 287440896, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 6554624, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 5121536, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.384448 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.127328 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.139584 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.134144 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.104896 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.130816 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.15872 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.10288 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.0896 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.126464 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.12848 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.0896 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.0768 [TensorRT] VERBOSE: Tactic: 720895 time 0.100736 [TensorRT] VERBOSE: Tactic: 983039 time 0.064576 [TensorRT] VERBOSE: Tactic: 1048575 time 0.09216 [TensorRT] VERBOSE: Tactic: 1703935 time 0.07952 [TensorRT] VERBOSE: Tactic: 1769471 time 0.075456 [TensorRT] VERBOSE: Tactic: 1966079 time 0.107776 [TensorRT] VERBOSE: Tactic: 2031615 time 0.119104 [TensorRT] VERBOSE: Tactic: 2228223 time 0.1704 [TensorRT] VERBOSE: Tactic: 2424831 time 0.13456 [TensorRT] VERBOSE: Tactic: 2621439 time 0.081728 [TensorRT] VERBOSE: Tactic: 2752511 time 0.085568 [TensorRT] VERBOSE: Tactic: 2818047 time 0.077856 [TensorRT] VERBOSE: Tactic: 2883583 time 0.134688 [TensorRT] VERBOSE: Tactic: 3014655 time 0.086016 [TensorRT] VERBOSE: Tactic: 3145727 time 0.063488 [TensorRT] VERBOSE: Tactic: 3473407 time 0.088736 [TensorRT] VERBOSE: Tactic: 3604479 time 0.065792 [TensorRT] VERBOSE: Tactic: 3735551 time 0.083552 [TensorRT] VERBOSE: Tactic: 4390911 time 0.12576 [TensorRT] VERBOSE: Tactic: 5046271 time 0.085952 [TensorRT] VERBOSE: Tactic: 5963775 time 0.106176 [TensorRT] VERBOSE: Tactic: 6160383 time 0.138112 [TensorRT] VERBOSE: Tactic: 6488063 time 0.089792 [TensorRT] VERBOSE: Tactic: 6881279 time 0.10752 [TensorRT] VERBOSE: Tactic: 7274495 time 0.06672 [TensorRT] VERBOSE: Tactic: 7864319 time 0.079648 [TensorRT] VERBOSE: Tactic: 7995391 time 0.097696 [TensorRT] VERBOSE: Tactic: 8585215 time 0.104448 [TensorRT] VERBOSE: Tactic: 8847359 time 0.065536 [TensorRT] VERBOSE: Tactic: 8978431 time 0.099712 [TensorRT] VERBOSE: Tactic: 9043967 time 0.065792 [TensorRT] VERBOSE: Tactic: 9175039 time 0.062112 [TensorRT] VERBOSE: Tactic: 9502719 time 0.135072 [TensorRT] VERBOSE: Tactic: 9830399 time 0.071904 [TensorRT] VERBOSE: Tactic: 9961471 time 0.098048 [TensorRT] VERBOSE: Tactic: 10027007 time 0.085248 [TensorRT] VERBOSE: Tactic: 10092543 time 0.127936 [TensorRT] VERBOSE: Tactic: 10289151 time 0.11088 [TensorRT] VERBOSE: Tactic: 10485759 time 0.068864 [TensorRT] VERBOSE: Tactic: 10682367 time 0.074688 [TensorRT] VERBOSE: Tactic: 10813439 time 0.071392 [TensorRT] VERBOSE: Fastest Tactic: 9175039 Time: 0.062112 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.095712 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.087456 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.137504 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.122272 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.144256 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.121184 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.130336 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.12624 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.127808 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.096128 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.087456 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9175039 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.136736 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.144384 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.0976 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.143456 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.086912 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.126976 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.120832 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.098688 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.124992 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.12448 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.086912 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.077504 [TensorRT] VERBOSE: Tactic: 720895 time 0.098464 [TensorRT] VERBOSE: Tactic: 983039 time 0.064224 [TensorRT] VERBOSE: Tactic: 1048575 time 0.092704 [TensorRT] VERBOSE: Tactic: 1703935 time 0.078976 [TensorRT] VERBOSE: Tactic: 1769471 time 0.071872 [TensorRT] VERBOSE: Tactic: 1966079 time 0.104352 [TensorRT] VERBOSE: Tactic: 2031615 time 0.117632 [TensorRT] VERBOSE: Tactic: 2228223 time 0.173184 [TensorRT] VERBOSE: Tactic: 2424831 time 0.145376 [TensorRT] VERBOSE: Tactic: 2621439 time 0.07568 [TensorRT] VERBOSE: Tactic: 2752511 time 0.084096 [TensorRT] VERBOSE: Tactic: 2818047 time 0.08032 [TensorRT] VERBOSE: Tactic: 2883583 time 0.13424 [TensorRT] VERBOSE: Tactic: 3014655 time 0.083104 [TensorRT] VERBOSE: Tactic: 3145727 time 0.06256 [TensorRT] VERBOSE: Tactic: 3473407 time 0.089696 [TensorRT] VERBOSE: Tactic: 3604479 time 0.06528 [TensorRT] VERBOSE: Tactic: 3735551 time 0.08192 [TensorRT] VERBOSE: Tactic: 4390911 time 0.123584 [TensorRT] VERBOSE: Tactic: 5046271 time 0.085312 [TensorRT] VERBOSE: Tactic: 5963775 time 0.099488 [TensorRT] VERBOSE: Tactic: 6160383 time 0.143264 [TensorRT] VERBOSE: Tactic: 6488063 time 0.087552 [TensorRT] VERBOSE: Tactic: 6881279 time 0.105664 [TensorRT] VERBOSE: Tactic: 7274495 time 0.064544 [TensorRT] VERBOSE: Tactic: 7864319 time 0.082016 [TensorRT] VERBOSE: Tactic: 7995391 time 0.074752 [TensorRT] VERBOSE: Tactic: 8585215 time 0.099104 [TensorRT] VERBOSE: Tactic: 8847359 time 0.06272 [TensorRT] VERBOSE: Tactic: 8978431 time 0.098944 [TensorRT] VERBOSE: Tactic: 9043967 time 0.062336 [TensorRT] VERBOSE: Tactic: 9175039 time 0.064096 [TensorRT] VERBOSE: Tactic: 9502719 time 0.140416 [TensorRT] VERBOSE: Tactic: 9830399 time 0.070688 [TensorRT] VERBOSE: Tactic: 9961471 time 0.118784 [TensorRT] VERBOSE: Tactic: 10027007 time 0.082944 [TensorRT] VERBOSE: Tactic: 10092543 time 0.124224 [TensorRT] VERBOSE: Tactic: 10289151 time 0.103424 [TensorRT] VERBOSE: Tactic: 10485759 time 0.06704 [TensorRT] VERBOSE: Tactic: 10682367 time 0.072288 [TensorRT] VERBOSE: Tactic: 10813439 time 0.06752 [TensorRT] VERBOSE: Fastest Tactic: 9043967 Time: 0.062336 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.051712 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.058368 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.07008 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.053728 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.052512 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.058464 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.074624 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.054144 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.058208 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.04704 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.067296 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.0472 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.04704 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014336 [TensorRT] VERBOSE: Tactic: 256 time 0.014624 [TensorRT] VERBOSE: Tactic: 512 time 0.015776 [TensorRT] VERBOSE: Tactic: -32 time 0.04992 [TensorRT] VERBOSE: Tactic: -64 time 0.028896 [TensorRT] VERBOSE: Tactic: -128 time 0.019968 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00976 [TensorRT] VERBOSE: Tactic: 1 time 0.009664 [TensorRT] VERBOSE: Tactic: 2 time 0.010464 [TensorRT] VERBOSE: Tactic: 3 time 0.009344 [TensorRT] VERBOSE: Tactic: 4 time 0.009984 [TensorRT] VERBOSE: Tactic: 5 time 0.010272 [TensorRT] VERBOSE: Tactic: 6 time 0.011264 [TensorRT] VERBOSE: Tactic: 7 time 0.010304 [TensorRT] VERBOSE: Tactic: 8 time 0.009984 [TensorRT] VERBOSE: Tactic: 9 time 0.009376 [TensorRT] VERBOSE: Tactic: 28 time 0.010048 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.009344 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014624 [TensorRT] VERBOSE: Tactic: 256 time 0.015328 [TensorRT] VERBOSE: Tactic: 512 time 0.014656 [TensorRT] VERBOSE: Tactic: -32 time 0.048416 [TensorRT] VERBOSE: Tactic: -64 time 0.02864 [TensorRT] VERBOSE: Tactic: -128 time 0.018976 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014624 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013888 [TensorRT] VERBOSE: Tactic: 25 time 0.015072 [TensorRT] VERBOSE: Tactic: 26 time 0.014208 [TensorRT] VERBOSE: Tactic: 27 time 0.016416 [TensorRT] VERBOSE: Tactic: 31 time 0.013152 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.013152 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017248 [TensorRT] VERBOSE: Tactic: 256 time 0.01728 [TensorRT] VERBOSE: Tactic: 512 time 0.01712 [TensorRT] VERBOSE: Tactic: -32 time 0.032992 [TensorRT] VERBOSE: Tactic: -64 time 0.022976 [TensorRT] VERBOSE: Tactic: -128 time 0.02384 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.01712 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007808 [TensorRT] VERBOSE: Tactic: 1 time 0.007712 [TensorRT] VERBOSE: Tactic: 2 time 0.006304 [TensorRT] VERBOSE: Tactic: 3 time 0.007552 [TensorRT] VERBOSE: Tactic: 4 time 0.007648 [TensorRT] VERBOSE: Tactic: 5 time 0.008192 [TensorRT] VERBOSE: Tactic: 6 time 0.00928 [TensorRT] VERBOSE: Tactic: 7 time 0.007936 [TensorRT] VERBOSE: Tactic: 8 time 0.009408 [TensorRT] VERBOSE: Tactic: 9 time 0.009632 [TensorRT] VERBOSE: Tactic: 10 time 0.009376 [TensorRT] VERBOSE: Tactic: 11 time 0.008384 [TensorRT] VERBOSE: Tactic: 12 time 0.008128 [TensorRT] VERBOSE: Tactic: 13 time 0.008192 [TensorRT] VERBOSE: Tactic: 14 time 0.007712 [TensorRT] VERBOSE: Tactic: 15 time 0.008192 [TensorRT] VERBOSE: Tactic: 16 time 0.009408 [TensorRT] VERBOSE: Tactic: 17 time 0.008384 [TensorRT] VERBOSE: Tactic: 18 time 0.008096 [TensorRT] VERBOSE: Tactic: 19 time 0.00976 [TensorRT] VERBOSE: Tactic: 20 time 0.012672 [TensorRT] VERBOSE: Tactic: 21 time 0.010592 [TensorRT] VERBOSE: Tactic: 22 time 0.008736 [TensorRT] VERBOSE: Tactic: 23 time 0.009248 [TensorRT] VERBOSE: Tactic: 28 time 0.009472 [TensorRT] VERBOSE: Tactic: 29 time 0.009472 [TensorRT] VERBOSE: Tactic: 30 time 0.012384 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006304 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01616 [TensorRT] VERBOSE: Tactic: 256 time 0.016864 [TensorRT] VERBOSE: Tactic: 512 time 0.016864 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01616 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00768 [TensorRT] VERBOSE: Tactic: 11 time 0.009152 [TensorRT] VERBOSE: Tactic: 12 time 0.007744 [TensorRT] VERBOSE: Tactic: 13 time 0.01232 [TensorRT] VERBOSE: Tactic: 14 time 0.010464 [TensorRT] VERBOSE: Tactic: 15 time 0.01072 [TensorRT] VERBOSE: Tactic: 16 time 0.020064 [TensorRT] VERBOSE: Tactic: 17 time 0.01552 [TensorRT] VERBOSE: Tactic: 18 time 0.016992 [TensorRT] VERBOSE: Tactic: 19 time 0.017792 [TensorRT] VERBOSE: Tactic: 20 time 0.007776 [TensorRT] VERBOSE: Tactic: 21 time 0.00768 [TensorRT] VERBOSE: Tactic: 22 time 0.009312 [TensorRT] VERBOSE: Tactic: 23 time 0.013888 [TensorRT] VERBOSE: Tactic: 24 time 0.007776 [TensorRT] VERBOSE: Tactic: 25 time 0.0072 [TensorRT] VERBOSE: Tactic: 26 time 0.00912 [TensorRT] VERBOSE: Tactic: 27 time 0.011264 [TensorRT] VERBOSE: Tactic: 29 time 0.025184 [TensorRT] VERBOSE: Tactic: 30 time 0.0144 [TensorRT] VERBOSE: Tactic: 31 time 0.00992 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.0072 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.013088 [TensorRT] VERBOSE: Tactic: 0 time 0.025376 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.013088 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016128 [TensorRT] VERBOSE: Tactic: 0 time 0.005984 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005984 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01568 [TensorRT] VERBOSE: Tactic: 0 time 0.018048 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01568 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022016 [TensorRT] VERBOSE: Tactic: 0 time 0.012896 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012896 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017344 [TensorRT] VERBOSE: Tactic: 0 time 0.012384 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012384 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016032 [TensorRT] VERBOSE: Tactic: 0 time 0.02192 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016032 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017184 [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01616 [TensorRT] VERBOSE: Tactic: 0 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01616 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016736 [TensorRT] VERBOSE: Tactic: 0 time 0.005984 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005984 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015936 [TensorRT] VERBOSE: Tactic: 0 time 0.009536 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009536 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015936 [TensorRT] VERBOSE: Tactic: 0 time 0.025856 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015936 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01712 [TensorRT] VERBOSE: Tactic: 0 time 0.009152 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009152 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011424 [TensorRT] VERBOSE: Tactic: 256 time 0.01072 [TensorRT] VERBOSE: Tactic: 512 time 0.011744 [TensorRT] VERBOSE: Tactic: -32 time 0.028192 [TensorRT] VERBOSE: Tactic: -64 time 0.017632 [TensorRT] VERBOSE: Tactic: -128 time 0.014496 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.01072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006496 [TensorRT] VERBOSE: Tactic: 1 time 0.00624 [TensorRT] VERBOSE: Tactic: 2 time 0.006848 [TensorRT] VERBOSE: Tactic: 3 time 0.006368 [TensorRT] VERBOSE: Tactic: 4 time 0.006464 [TensorRT] VERBOSE: Tactic: 5 time 0.00624 [TensorRT] VERBOSE: Tactic: 6 time 0.0064 [TensorRT] VERBOSE: Tactic: 7 time 0.006432 [TensorRT] VERBOSE: Tactic: 8 time 0.006336 [TensorRT] VERBOSE: Tactic: 9 time 0.007648 [TensorRT] VERBOSE: Tactic: 28 time 0.006528 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.00624 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011616 [TensorRT] VERBOSE: Tactic: 256 time 0.010848 [TensorRT] VERBOSE: Tactic: 512 time 0.01184 [TensorRT] VERBOSE: Tactic: -32 time 0.028512 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.014304 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.010848 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009504 [TensorRT] VERBOSE: Tactic: 25 time 0.009152 [TensorRT] VERBOSE: Tactic: 26 time 0.008352 [TensorRT] VERBOSE: Tactic: 27 time 0.008608 [TensorRT] VERBOSE: Tactic: 31 time 0.00912 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.008352 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014048 [TensorRT] VERBOSE: Tactic: 256 time 0.013824 [TensorRT] VERBOSE: Tactic: 512 time 0.01408 [TensorRT] VERBOSE: Tactic: -32 time 0.024992 [TensorRT] VERBOSE: Tactic: -64 time 0.017376 [TensorRT] VERBOSE: Tactic: -128 time 0.017408 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006336 [TensorRT] VERBOSE: Tactic: 1 time 0.006208 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.006432 [TensorRT] VERBOSE: Tactic: 5 time 0.006208 [TensorRT] VERBOSE: Tactic: 6 time 0.006272 [TensorRT] VERBOSE: Tactic: 7 time 0.007488 [TensorRT] VERBOSE: Tactic: 8 time 0.00768 [TensorRT] VERBOSE: Tactic: 9 time 0.007744 [TensorRT] VERBOSE: Tactic: 10 time 0.008256 [TensorRT] VERBOSE: Tactic: 11 time 0.007168 [TensorRT] VERBOSE: Tactic: 12 time 0.007552 [TensorRT] VERBOSE: Tactic: 13 time 0.007808 [TensorRT] VERBOSE: Tactic: 14 time 0.007392 [TensorRT] VERBOSE: Tactic: 15 time 0.00656 [TensorRT] VERBOSE: Tactic: 16 time 0.007584 [TensorRT] VERBOSE: Tactic: 17 time 0.007744 [TensorRT] VERBOSE: Tactic: 18 time 0.007968 [TensorRT] VERBOSE: Tactic: 19 time 0.007584 [TensorRT] VERBOSE: Tactic: 20 time 0.012384 [TensorRT] VERBOSE: Tactic: 21 time 0.009248 [TensorRT] VERBOSE: Tactic: 22 time 0.00752 [TensorRT] VERBOSE: Tactic: 23 time 0.007584 [TensorRT] VERBOSE: Tactic: 28 time 0.007744 [TensorRT] VERBOSE: Tactic: 29 time 0.009472 [TensorRT] VERBOSE: Tactic: 30 time 0.010784 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.006048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01408 [TensorRT] VERBOSE: Tactic: 256 time 0.014208 [TensorRT] VERBOSE: Tactic: 512 time 0.013536 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.013536 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006368 [TensorRT] VERBOSE: Tactic: 11 time 0.007712 [TensorRT] VERBOSE: Tactic: 12 time 0.007648 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.010368 [TensorRT] VERBOSE: Tactic: 16 time 0.014336 [TensorRT] VERBOSE: Tactic: 17 time 0.013888 [TensorRT] VERBOSE: Tactic: 18 time 0.013856 [TensorRT] VERBOSE: Tactic: 19 time 0.015488 [TensorRT] VERBOSE: Tactic: 20 time 0.006144 [TensorRT] VERBOSE: Tactic: 21 time 0.00608 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.009184 [TensorRT] VERBOSE: Tactic: 24 time 0.006016 [TensorRT] VERBOSE: Tactic: 25 time 0.006048 [TensorRT] VERBOSE: Tactic: 26 time 0.00608 [TensorRT] VERBOSE: Tactic: 27 time 0.007616 [TensorRT] VERBOSE: Tactic: 29 time 0.015392 [TensorRT] VERBOSE: Tactic: 30 time 0.01056 [TensorRT] VERBOSE: Tactic: 31 time 0.00752 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_147 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_147 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_147 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_147 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_147 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014944 [TensorRT] VERBOSE: Tactic: 256 time 0.014688 [TensorRT] VERBOSE: Tactic: 512 time 0.01536 [TensorRT] VERBOSE: Tactic: -32 time 0.047744 [TensorRT] VERBOSE: Tactic: -64 time 0.032736 [TensorRT] VERBOSE: Tactic: -128 time 0.02016 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014688 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009632 [TensorRT] VERBOSE: Tactic: 1 time 0.009888 [TensorRT] VERBOSE: Tactic: 2 time 0.009088 [TensorRT] VERBOSE: Tactic: 3 time 0.009216 [TensorRT] VERBOSE: Tactic: 4 time 0.009952 [TensorRT] VERBOSE: Tactic: 5 time 0.009664 [TensorRT] VERBOSE: Tactic: 6 time 0.011296 [TensorRT] VERBOSE: Tactic: 7 time 0.009664 [TensorRT] VERBOSE: Tactic: 8 time 0.009632 [TensorRT] VERBOSE: Tactic: 9 time 0.009632 [TensorRT] VERBOSE: Tactic: 28 time 0.009536 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.009088 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01504 [TensorRT] VERBOSE: Tactic: 256 time 0.015392 [TensorRT] VERBOSE: Tactic: 512 time 0.015488 [TensorRT] VERBOSE: Tactic: -32 time 0.047616 [TensorRT] VERBOSE: Tactic: -64 time 0.027936 [TensorRT] VERBOSE: Tactic: -128 time 0.01952 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01504 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013312 [TensorRT] VERBOSE: Tactic: 25 time 0.013984 [TensorRT] VERBOSE: Tactic: 26 time 0.014112 [TensorRT] VERBOSE: Tactic: 27 time 0.016064 [TensorRT] VERBOSE: Tactic: 31 time 0.012832 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.012832 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017056 [TensorRT] VERBOSE: Tactic: 256 time 0.016864 [TensorRT] VERBOSE: Tactic: 512 time 0.017344 [TensorRT] VERBOSE: Tactic: -32 time 0.033216 [TensorRT] VERBOSE: Tactic: -64 time 0.023552 [TensorRT] VERBOSE: Tactic: -128 time 0.023616 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.016864 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008064 [TensorRT] VERBOSE: Tactic: 1 time 0.00768 [TensorRT] VERBOSE: Tactic: 2 time 0.006208 [TensorRT] VERBOSE: Tactic: 3 time 0.007584 [TensorRT] VERBOSE: Tactic: 4 time 0.007712 [TensorRT] VERBOSE: Tactic: 5 time 0.008032 [TensorRT] VERBOSE: Tactic: 6 time 0.009184 [TensorRT] VERBOSE: Tactic: 7 time 0.007392 [TensorRT] VERBOSE: Tactic: 8 time 0.009216 [TensorRT] VERBOSE: Tactic: 9 time 0.00928 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.008288 [TensorRT] VERBOSE: Tactic: 12 time 0.007648 [TensorRT] VERBOSE: Tactic: 13 time 0.00784 [TensorRT] VERBOSE: Tactic: 14 time 0.007648 [TensorRT] VERBOSE: Tactic: 15 time 0.00816 [TensorRT] VERBOSE: Tactic: 16 time 0.009664 [TensorRT] VERBOSE: Tactic: 17 time 0.009344 [TensorRT] VERBOSE: Tactic: 18 time 0.007968 [TensorRT] VERBOSE: Tactic: 19 time 0.008384 [TensorRT] VERBOSE: Tactic: 20 time 0.012704 [TensorRT] VERBOSE: Tactic: 21 time 0.010752 [TensorRT] VERBOSE: Tactic: 22 time 0.009184 [TensorRT] VERBOSE: Tactic: 23 time 0.009408 [TensorRT] VERBOSE: Tactic: 28 time 0.009472 [TensorRT] VERBOSE: Tactic: 29 time 0.009472 [TensorRT] VERBOSE: Tactic: 30 time 0.012608 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006208 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017344 [TensorRT] VERBOSE: Tactic: 256 time 0.01728 [TensorRT] VERBOSE: Tactic: 512 time 0.017184 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.017184 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007616 [TensorRT] VERBOSE: Tactic: 11 time 0.009184 [TensorRT] VERBOSE: Tactic: 12 time 0.007872 [TensorRT] VERBOSE: Tactic: 13 time 0.012288 [TensorRT] VERBOSE: Tactic: 14 time 0.01056 [TensorRT] VERBOSE: Tactic: 15 time 0.010848 [TensorRT] VERBOSE: Tactic: 16 time 0.020224 [TensorRT] VERBOSE: Tactic: 17 time 0.015744 [TensorRT] VERBOSE: Tactic: 18 time 0.016736 [TensorRT] VERBOSE: Tactic: 19 time 0.017152 [TensorRT] VERBOSE: Tactic: 20 time 0.007872 [TensorRT] VERBOSE: Tactic: 21 time 0.007424 [TensorRT] VERBOSE: Tactic: 22 time 0.009376 [TensorRT] VERBOSE: Tactic: 23 time 0.014304 [TensorRT] VERBOSE: Tactic: 24 time 0.007936 [TensorRT] VERBOSE: Tactic: 25 time 0.007584 [TensorRT] VERBOSE: Tactic: 26 time 0.009088 [TensorRT] VERBOSE: Tactic: 27 time 0.012256 [TensorRT] VERBOSE: Tactic: 29 time 0.025088 [TensorRT] VERBOSE: Tactic: 30 time 0.01408 [TensorRT] VERBOSE: Tactic: 31 time 0.010816 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.007424 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011168 [TensorRT] VERBOSE: Tactic: 256 time 0.011328 [TensorRT] VERBOSE: Tactic: 512 time 0.011072 [TensorRT] VERBOSE: Tactic: -32 time 0.027264 [TensorRT] VERBOSE: Tactic: -64 time 0.017792 [TensorRT] VERBOSE: Tactic: -128 time 0.014304 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.011072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006368 [TensorRT] VERBOSE: Tactic: 1 time 0.006752 [TensorRT] VERBOSE: Tactic: 2 time 0.006528 [TensorRT] VERBOSE: Tactic: 3 time 0.0064 [TensorRT] VERBOSE: Tactic: 4 time 0.006272 [TensorRT] VERBOSE: Tactic: 5 time 0.006272 [TensorRT] VERBOSE: Tactic: 6 time 0.006336 [TensorRT] VERBOSE: Tactic: 7 time 0.006528 [TensorRT] VERBOSE: Tactic: 8 time 0.0064 [TensorRT] VERBOSE: Tactic: 9 time 0.006688 [TensorRT] VERBOSE: Tactic: 28 time 0.00656 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.006272 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0112 [TensorRT] VERBOSE: Tactic: 256 time 0.011552 [TensorRT] VERBOSE: Tactic: 512 time 0.011456 [TensorRT] VERBOSE: Tactic: -32 time 0.02752 [TensorRT] VERBOSE: Tactic: -64 time 0.017344 [TensorRT] VERBOSE: Tactic: -128 time 0.014208 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.0112 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.00896 [TensorRT] VERBOSE: Tactic: 25 time 0.009472 [TensorRT] VERBOSE: Tactic: 26 time 0.008672 [TensorRT] VERBOSE: Tactic: 27 time 0.008608 [TensorRT] VERBOSE: Tactic: 31 time 0.009248 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.008608 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013792 [TensorRT] VERBOSE: Tactic: 256 time 0.01408 [TensorRT] VERBOSE: Tactic: 512 time 0.013856 [TensorRT] VERBOSE: Tactic: -32 time 0.024736 [TensorRT] VERBOSE: Tactic: -64 time 0.01888 [TensorRT] VERBOSE: Tactic: -128 time 0.017408 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013792 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.007712 [TensorRT] VERBOSE: Tactic: 7 time 0.007552 [TensorRT] VERBOSE: Tactic: 8 time 0.007456 [TensorRT] VERBOSE: Tactic: 9 time 0.00752 [TensorRT] VERBOSE: Tactic: 10 time 0.009248 [TensorRT] VERBOSE: Tactic: 11 time 0.00784 [TensorRT] VERBOSE: Tactic: 12 time 0.007904 [TensorRT] VERBOSE: Tactic: 13 time 0.00768 [TensorRT] VERBOSE: Tactic: 14 time 0.007616 [TensorRT] VERBOSE: Tactic: 15 time 0.006144 [TensorRT] VERBOSE: Tactic: 16 time 0.007584 [TensorRT] VERBOSE: Tactic: 17 time 0.007776 [TensorRT] VERBOSE: Tactic: 18 time 0.007488 [TensorRT] VERBOSE: Tactic: 19 time 0.00784 [TensorRT] VERBOSE: Tactic: 20 time 0.01136 [TensorRT] VERBOSE: Tactic: 21 time 0.009216 [TensorRT] VERBOSE: Tactic: 22 time 0.008032 [TensorRT] VERBOSE: Tactic: 23 time 0.00768 [TensorRT] VERBOSE: Tactic: 28 time 0.007872 [TensorRT] VERBOSE: Tactic: 29 time 0.008768 [TensorRT] VERBOSE: Tactic: 30 time 0.01104 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014144 [TensorRT] VERBOSE: Tactic: 256 time 0.01376 [TensorRT] VERBOSE: Tactic: 512 time 0.014016 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.01376 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.0064 [TensorRT] VERBOSE: Tactic: 11 time 0.007552 [TensorRT] VERBOSE: Tactic: 12 time 0.007392 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009472 [TensorRT] VERBOSE: Tactic: 15 time 0.009312 [TensorRT] VERBOSE: Tactic: 16 time 0.014144 [TensorRT] VERBOSE: Tactic: 17 time 0.013056 [TensorRT] VERBOSE: Tactic: 18 time 0.01392 [TensorRT] VERBOSE: Tactic: 19 time 0.015744 [TensorRT] VERBOSE: Tactic: 20 time 0.00624 [TensorRT] VERBOSE: Tactic: 21 time 0.006048 [TensorRT] VERBOSE: Tactic: 22 time 0.007392 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 24 time 0.006016 [TensorRT] VERBOSE: Tactic: 25 time 0.006752 [TensorRT] VERBOSE: Tactic: 26 time 0.00608 [TensorRT] VERBOSE: Tactic: 27 time 0.00784 [TensorRT] VERBOSE: Tactic: 29 time 0.01568 [TensorRT] VERBOSE: Tactic: 30 time 0.010592 [TensorRT] VERBOSE: Tactic: 31 time 0.007648 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_152 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_152 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_152 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_152 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_152 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.015584 [TensorRT] VERBOSE: Tactic: 256 time 0.015392 [TensorRT] VERBOSE: Tactic: 512 time 0.015264 [TensorRT] VERBOSE: Tactic: -32 time 0.048736 [TensorRT] VERBOSE: Tactic: -64 time 0.028256 [TensorRT] VERBOSE: Tactic: -128 time 0.018976 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.015264 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00992 [TensorRT] VERBOSE: Tactic: 1 time 0.009728 [TensorRT] VERBOSE: Tactic: 2 time 0.009184 [TensorRT] VERBOSE: Tactic: 3 time 0.009696 [TensorRT] VERBOSE: Tactic: 4 time 0.01024 [TensorRT] VERBOSE: Tactic: 5 time 0.01024 [TensorRT] VERBOSE: Tactic: 6 time 0.010336 [TensorRT] VERBOSE: Tactic: 7 time 0.00928 [TensorRT] VERBOSE: Tactic: 8 time 0.010528 [TensorRT] VERBOSE: Tactic: 9 time 0.009152 [TensorRT] VERBOSE: Tactic: 28 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 9 Time: 0.009152 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014208 [TensorRT] VERBOSE: Tactic: 256 time 0.014336 [TensorRT] VERBOSE: Tactic: 512 time 0.015168 [TensorRT] VERBOSE: Tactic: -32 time 0.048352 [TensorRT] VERBOSE: Tactic: -64 time 0.02928 [TensorRT] VERBOSE: Tactic: -128 time 0.020032 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014208 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.0128 [TensorRT] VERBOSE: Tactic: 25 time 0.013856 [TensorRT] VERBOSE: Tactic: 26 time 0.013888 [TensorRT] VERBOSE: Tactic: 27 time 0.016864 [TensorRT] VERBOSE: Tactic: 31 time 0.013504 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.0128 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017248 [TensorRT] VERBOSE: Tactic: 256 time 0.017536 [TensorRT] VERBOSE: Tactic: 512 time 0.016992 [TensorRT] VERBOSE: Tactic: -32 time 0.033056 [TensorRT] VERBOSE: Tactic: -64 time 0.024096 [TensorRT] VERBOSE: Tactic: -128 time 0.023104 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.016992 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008032 [TensorRT] VERBOSE: Tactic: 1 time 0.007616 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.007616 [TensorRT] VERBOSE: Tactic: 4 time 0.007648 [TensorRT] VERBOSE: Tactic: 5 time 0.007968 [TensorRT] VERBOSE: Tactic: 6 time 0.009216 [TensorRT] VERBOSE: Tactic: 7 time 0.007616 [TensorRT] VERBOSE: Tactic: 8 time 0.009184 [TensorRT] VERBOSE: Tactic: 9 time 0.01024 [TensorRT] VERBOSE: Tactic: 10 time 0.00928 [TensorRT] VERBOSE: Tactic: 11 time 0.009216 [TensorRT] VERBOSE: Tactic: 12 time 0.008192 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.007872 [TensorRT] VERBOSE: Tactic: 15 time 0.008128 [TensorRT] VERBOSE: Tactic: 16 time 0.008576 [TensorRT] VERBOSE: Tactic: 17 time 0.009184 [TensorRT] VERBOSE: Tactic: 18 time 0.009344 [TensorRT] VERBOSE: Tactic: 19 time 0.00944 [TensorRT] VERBOSE: Tactic: 20 time 0.012864 [TensorRT] VERBOSE: Tactic: 21 time 0.011008 [TensorRT] VERBOSE: Tactic: 22 time 0.009376 [TensorRT] VERBOSE: Tactic: 23 time 0.00928 [TensorRT] VERBOSE: Tactic: 28 time 0.009632 [TensorRT] VERBOSE: Tactic: 29 time 0.009216 [TensorRT] VERBOSE: Tactic: 30 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017408 [TensorRT] VERBOSE: Tactic: 256 time 0.0176 [TensorRT] VERBOSE: Tactic: 512 time 0.01728 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.01728 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007712 [TensorRT] VERBOSE: Tactic: 11 time 0.009312 [TensorRT] VERBOSE: Tactic: 12 time 0.008032 [TensorRT] VERBOSE: Tactic: 13 time 0.012608 [TensorRT] VERBOSE: Tactic: 14 time 0.009888 [TensorRT] VERBOSE: Tactic: 15 time 0.011008 [TensorRT] VERBOSE: Tactic: 16 time 0.020416 [TensorRT] VERBOSE: Tactic: 17 time 0.015648 [TensorRT] VERBOSE: Tactic: 18 time 0.015744 [TensorRT] VERBOSE: Tactic: 19 time 0.017408 [TensorRT] VERBOSE: Tactic: 20 time 0.007648 [TensorRT] VERBOSE: Tactic: 21 time 0.007616 [TensorRT] VERBOSE: Tactic: 22 time 0.00944 [TensorRT] VERBOSE: Tactic: 23 time 0.013312 [TensorRT] VERBOSE: Tactic: 24 time 0.007552 [TensorRT] VERBOSE: Tactic: 25 time 0.00752 [TensorRT] VERBOSE: Tactic: 26 time 0.009216 [TensorRT] VERBOSE: Tactic: 27 time 0.010848 [TensorRT] VERBOSE: Tactic: 29 time 0.02464 [TensorRT] VERBOSE: Tactic: 30 time 0.014272 [TensorRT] VERBOSE: Tactic: 31 time 0.009568 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.00752 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011456 [TensorRT] VERBOSE: Tactic: 256 time 0.011424 [TensorRT] VERBOSE: Tactic: 512 time 0.012032 [TensorRT] VERBOSE: Tactic: -32 time 0.027008 [TensorRT] VERBOSE: Tactic: -64 time 0.017504 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.011424 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00624 [TensorRT] VERBOSE: Tactic: 1 time 0.006656 [TensorRT] VERBOSE: Tactic: 2 time 0.006592 [TensorRT] VERBOSE: Tactic: 3 time 0.006688 [TensorRT] VERBOSE: Tactic: 4 time 0.006688 [TensorRT] VERBOSE: Tactic: 5 time 0.006592 [TensorRT] VERBOSE: Tactic: 6 time 0.006144 [TensorRT] VERBOSE: Tactic: 7 time 0.006304 [TensorRT] VERBOSE: Tactic: 8 time 0.006496 [TensorRT] VERBOSE: Tactic: 9 time 0.00656 [TensorRT] VERBOSE: Tactic: 28 time 0.00624 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 256 time 0.011264 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.027488 [TensorRT] VERBOSE: Tactic: -64 time 0.017472 [TensorRT] VERBOSE: Tactic: -128 time 0.014304 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009344 [TensorRT] VERBOSE: Tactic: 25 time 0.009248 [TensorRT] VERBOSE: Tactic: 26 time 0.008192 [TensorRT] VERBOSE: Tactic: 27 time 0.00864 [TensorRT] VERBOSE: Tactic: 31 time 0.009248 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.008192 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013312 [TensorRT] VERBOSE: Tactic: 256 time 0.014176 [TensorRT] VERBOSE: Tactic: 512 time 0.01408 [TensorRT] VERBOSE: Tactic: -32 time 0.024896 [TensorRT] VERBOSE: Tactic: -64 time 0.018688 [TensorRT] VERBOSE: Tactic: -128 time 0.017344 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013312 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.00608 [TensorRT] VERBOSE: Tactic: 2 time 0.006048 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.007616 [TensorRT] VERBOSE: Tactic: 7 time 0.007488 [TensorRT] VERBOSE: Tactic: 8 time 0.007776 [TensorRT] VERBOSE: Tactic: 9 time 0.007712 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.007392 [TensorRT] VERBOSE: Tactic: 12 time 0.006784 [TensorRT] VERBOSE: Tactic: 13 time 0.007552 [TensorRT] VERBOSE: Tactic: 14 time 0.007552 [TensorRT] VERBOSE: Tactic: 15 time 0.006528 [TensorRT] VERBOSE: Tactic: 16 time 0.007616 [TensorRT] VERBOSE: Tactic: 17 time 0.007456 [TensorRT] VERBOSE: Tactic: 18 time 0.007392 [TensorRT] VERBOSE: Tactic: 19 time 0.00768 [TensorRT] VERBOSE: Tactic: 20 time 0.012544 [TensorRT] VERBOSE: Tactic: 21 time 0.009344 [TensorRT] VERBOSE: Tactic: 22 time 0.007488 [TensorRT] VERBOSE: Tactic: 23 time 0.007648 [TensorRT] VERBOSE: Tactic: 28 time 0.007808 [TensorRT] VERBOSE: Tactic: 29 time 0.009312 [TensorRT] VERBOSE: Tactic: 30 time 0.011168 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014112 [TensorRT] VERBOSE: Tactic: 256 time 0.013856 [TensorRT] VERBOSE: Tactic: 512 time 0.013408 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.013408 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006016 [TensorRT] VERBOSE: Tactic: 11 time 0.007584 [TensorRT] VERBOSE: Tactic: 12 time 0.007776 [TensorRT] VERBOSE: Tactic: 13 time 0.009152 [TensorRT] VERBOSE: Tactic: 14 time 0.009088 [TensorRT] VERBOSE: Tactic: 15 time 0.010496 [TensorRT] VERBOSE: Tactic: 16 time 0.013824 [TensorRT] VERBOSE: Tactic: 17 time 0.012896 [TensorRT] VERBOSE: Tactic: 18 time 0.01424 [TensorRT] VERBOSE: Tactic: 19 time 0.015392 [TensorRT] VERBOSE: Tactic: 20 time 0.006016 [TensorRT] VERBOSE: Tactic: 21 time 0.006144 [TensorRT] VERBOSE: Tactic: 22 time 0.007552 [TensorRT] VERBOSE: Tactic: 23 time 0.009504 [TensorRT] VERBOSE: Tactic: 24 time 0.006112 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.006048 [TensorRT] VERBOSE: Tactic: 27 time 0.007552 [TensorRT] VERBOSE: Tactic: 29 time 0.01584 [TensorRT] VERBOSE: Tactic: 30 time 0.01072 [TensorRT] VERBOSE: Tactic: 31 time 0.007808 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_157 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_157 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_157 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_157 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_157 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014304 [TensorRT] VERBOSE: Tactic: 256 time 0.014848 [TensorRT] VERBOSE: Tactic: 512 time 0.016096 [TensorRT] VERBOSE: Tactic: -32 time 0.049312 [TensorRT] VERBOSE: Tactic: -64 time 0.02784 [TensorRT] VERBOSE: Tactic: -128 time 0.019456 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014304 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Tactic: 1 time 0.009536 [TensorRT] VERBOSE: Tactic: 2 time 0.009952 [TensorRT] VERBOSE: Tactic: 3 time 0.009984 [TensorRT] VERBOSE: Tactic: 4 time 0.00992 [TensorRT] VERBOSE: Tactic: 5 time 0.009024 [TensorRT] VERBOSE: Tactic: 6 time 0.01072 [TensorRT] VERBOSE: Tactic: 7 time 0.009696 [TensorRT] VERBOSE: Tactic: 8 time 0.01024 [TensorRT] VERBOSE: Tactic: 9 time 0.009792 [TensorRT] VERBOSE: Tactic: 28 time 0.009792 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.009024 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01408 [TensorRT] VERBOSE: Tactic: 256 time 0.014368 [TensorRT] VERBOSE: Tactic: 512 time 0.015072 [TensorRT] VERBOSE: Tactic: -32 time 0.048032 [TensorRT] VERBOSE: Tactic: -64 time 0.029984 [TensorRT] VERBOSE: Tactic: -128 time 0.020192 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01408 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013088 [TensorRT] VERBOSE: Tactic: 25 time 0.014048 [TensorRT] VERBOSE: Tactic: 26 time 0.014144 [TensorRT] VERBOSE: Tactic: 27 time 0.016032 [TensorRT] VERBOSE: Tactic: 31 time 0.013312 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.013088 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016448 [TensorRT] VERBOSE: Tactic: 256 time 0.017216 [TensorRT] VERBOSE: Tactic: 512 time 0.017248 [TensorRT] VERBOSE: Tactic: -32 time 0.033216 [TensorRT] VERBOSE: Tactic: -64 time 0.023808 [TensorRT] VERBOSE: Tactic: -128 time 0.023552 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.016448 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007712 [TensorRT] VERBOSE: Tactic: 1 time 0.007584 [TensorRT] VERBOSE: Tactic: 2 time 0.00624 [TensorRT] VERBOSE: Tactic: 3 time 0.007776 [TensorRT] VERBOSE: Tactic: 4 time 0.007616 [TensorRT] VERBOSE: Tactic: 5 time 0.00752 [TensorRT] VERBOSE: Tactic: 6 time 0.009216 [TensorRT] VERBOSE: Tactic: 7 time 0.008096 [TensorRT] VERBOSE: Tactic: 8 time 0.009248 [TensorRT] VERBOSE: Tactic: 9 time 0.011264 [TensorRT] VERBOSE: Tactic: 10 time 0.009472 [TensorRT] VERBOSE: Tactic: 11 time 0.009376 [TensorRT] VERBOSE: Tactic: 12 time 0.007968 [TensorRT] VERBOSE: Tactic: 13 time 0.00784 [TensorRT] VERBOSE: Tactic: 14 time 0.007648 [TensorRT] VERBOSE: Tactic: 15 time 0.008128 [TensorRT] VERBOSE: Tactic: 16 time 0.009248 [TensorRT] VERBOSE: Tactic: 17 time 0.00784 [TensorRT] VERBOSE: Tactic: 18 time 0.00784 [TensorRT] VERBOSE: Tactic: 19 time 0.009408 [TensorRT] VERBOSE: Tactic: 20 time 0.012384 [TensorRT] VERBOSE: Tactic: 21 time 0.01072 [TensorRT] VERBOSE: Tactic: 22 time 0.009184 [TensorRT] VERBOSE: Tactic: 23 time 0.009184 [TensorRT] VERBOSE: Tactic: 28 time 0.009568 [TensorRT] VERBOSE: Tactic: 29 time 0.009216 [TensorRT] VERBOSE: Tactic: 30 time 0.012576 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.00624 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017248 [TensorRT] VERBOSE: Tactic: 256 time 0.017248 [TensorRT] VERBOSE: Tactic: 512 time 0.017344 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.017248 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007712 [TensorRT] VERBOSE: Tactic: 11 time 0.008704 [TensorRT] VERBOSE: Tactic: 12 time 0.007712 [TensorRT] VERBOSE: Tactic: 13 time 0.01248 [TensorRT] VERBOSE: Tactic: 14 time 0.01088 [TensorRT] VERBOSE: Tactic: 15 time 0.011168 [TensorRT] VERBOSE: Tactic: 16 time 0.02 [TensorRT] VERBOSE: Tactic: 17 time 0.015552 [TensorRT] VERBOSE: Tactic: 18 time 0.015968 [TensorRT] VERBOSE: Tactic: 19 time 0.017888 [TensorRT] VERBOSE: Tactic: 20 time 0.008 [TensorRT] VERBOSE: Tactic: 21 time 0.007744 [TensorRT] VERBOSE: Tactic: 22 time 0.009216 [TensorRT] VERBOSE: Tactic: 23 time 0.013856 [TensorRT] VERBOSE: Tactic: 24 time 0.008 [TensorRT] VERBOSE: Tactic: 25 time 0.007712 [TensorRT] VERBOSE: Tactic: 26 time 0.008064 [TensorRT] VERBOSE: Tactic: 27 time 0.012288 [TensorRT] VERBOSE: Tactic: 29 time 0.025312 [TensorRT] VERBOSE: Tactic: 30 time 0.014208 [TensorRT] VERBOSE: Tactic: 31 time 0.009984 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.007712 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01136 [TensorRT] VERBOSE: Tactic: 256 time 0.011264 [TensorRT] VERBOSE: Tactic: 512 time 0.011776 [TensorRT] VERBOSE: Tactic: -32 time 0.028256 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.014432 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00656 [TensorRT] VERBOSE: Tactic: 1 time 0.006336 [TensorRT] VERBOSE: Tactic: 2 time 0.006176 [TensorRT] VERBOSE: Tactic: 3 time 0.006368 [TensorRT] VERBOSE: Tactic: 4 time 0.006656 [TensorRT] VERBOSE: Tactic: 5 time 0.006336 [TensorRT] VERBOSE: Tactic: 6 time 0.006688 [TensorRT] VERBOSE: Tactic: 7 time 0.00656 [TensorRT] VERBOSE: Tactic: 8 time 0.006304 [TensorRT] VERBOSE: Tactic: 9 time 0.006528 [TensorRT] VERBOSE: Tactic: 28 time 0.0064 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006176 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011456 [TensorRT] VERBOSE: Tactic: 256 time 0.011424 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.027648 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.014592 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009184 [TensorRT] VERBOSE: Tactic: 25 time 0.009568 [TensorRT] VERBOSE: Tactic: 26 time 0.008544 [TensorRT] VERBOSE: Tactic: 27 time 0.008544 [TensorRT] VERBOSE: Tactic: 31 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.008544 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013312 [TensorRT] VERBOSE: Tactic: 256 time 0.013376 [TensorRT] VERBOSE: Tactic: 512 time 0.013824 [TensorRT] VERBOSE: Tactic: -32 time 0.024096 [TensorRT] VERBOSE: Tactic: -64 time 0.017696 [TensorRT] VERBOSE: Tactic: -128 time 0.01728 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013312 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006304 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.005984 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.006112 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.007648 [TensorRT] VERBOSE: Tactic: 7 time 0.007776 [TensorRT] VERBOSE: Tactic: 8 time 0.007616 [TensorRT] VERBOSE: Tactic: 9 time 0.007648 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.00784 [TensorRT] VERBOSE: Tactic: 12 time 0.007616 [TensorRT] VERBOSE: Tactic: 13 time 0.007456 [TensorRT] VERBOSE: Tactic: 14 time 0.00752 [TensorRT] VERBOSE: Tactic: 15 time 0.006176 [TensorRT] VERBOSE: Tactic: 16 time 0.007456 [TensorRT] VERBOSE: Tactic: 17 time 0.007584 [TensorRT] VERBOSE: Tactic: 18 time 0.007552 [TensorRT] VERBOSE: Tactic: 19 time 0.007648 [TensorRT] VERBOSE: Tactic: 20 time 0.012192 [TensorRT] VERBOSE: Tactic: 21 time 0.009216 [TensorRT] VERBOSE: Tactic: 22 time 0.007744 [TensorRT] VERBOSE: Tactic: 23 time 0.007584 [TensorRT] VERBOSE: Tactic: 28 time 0.00752 [TensorRT] VERBOSE: Tactic: 29 time 0.009568 [TensorRT] VERBOSE: Tactic: 30 time 0.010976 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01328 [TensorRT] VERBOSE: Tactic: 256 time 0.013696 [TensorRT] VERBOSE: Tactic: 512 time 0.013856 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01328 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006112 [TensorRT] VERBOSE: Tactic: 11 time 0.007616 [TensorRT] VERBOSE: Tactic: 12 time 0.007488 [TensorRT] VERBOSE: Tactic: 13 time 0.009312 [TensorRT] VERBOSE: Tactic: 14 time 0.009344 [TensorRT] VERBOSE: Tactic: 15 time 0.009952 [TensorRT] VERBOSE: Tactic: 16 time 0.013856 [TensorRT] VERBOSE: Tactic: 17 time 0.012928 [TensorRT] VERBOSE: Tactic: 18 time 0.014336 [TensorRT] VERBOSE: Tactic: 19 time 0.01552 [TensorRT] VERBOSE: Tactic: 20 time 0.006304 [TensorRT] VERBOSE: Tactic: 21 time 0.006048 [TensorRT] VERBOSE: Tactic: 22 time 0.007872 [TensorRT] VERBOSE: Tactic: 23 time 0.009184 [TensorRT] VERBOSE: Tactic: 24 time 0.006304 [TensorRT] VERBOSE: Tactic: 25 time 0.006048 [TensorRT] VERBOSE: Tactic: 26 time 0.006144 [TensorRT] VERBOSE: Tactic: 27 time 0.007424 [TensorRT] VERBOSE: Tactic: 29 time 0.015392 [TensorRT] VERBOSE: Tactic: 30 time 0.010752 [TensorRT] VERBOSE: Tactic: 31 time 0.00768 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.006048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_162 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_162 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_162 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_162 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_162 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014176 [TensorRT] VERBOSE: Tactic: 256 time 0.014336 [TensorRT] VERBOSE: Tactic: 512 time 0.01536 [TensorRT] VERBOSE: Tactic: -32 time 0.049152 [TensorRT] VERBOSE: Tactic: -64 time 0.028064 [TensorRT] VERBOSE: Tactic: -128 time 0.018752 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014176 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01008 [TensorRT] VERBOSE: Tactic: 1 time 0.009632 [TensorRT] VERBOSE: Tactic: 2 time 0.01024 [TensorRT] VERBOSE: Tactic: 3 time 0.009408 [TensorRT] VERBOSE: Tactic: 4 time 0.01024 [TensorRT] VERBOSE: Tactic: 5 time 0.009824 [TensorRT] VERBOSE: Tactic: 6 time 0.010592 [TensorRT] VERBOSE: Tactic: 7 time 0.009664 [TensorRT] VERBOSE: Tactic: 8 time 0.010144 [TensorRT] VERBOSE: Tactic: 9 time 0.010592 [TensorRT] VERBOSE: Tactic: 28 time 0.00992 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.009408 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01424 [TensorRT] VERBOSE: Tactic: 256 time 0.014272 [TensorRT] VERBOSE: Tactic: 512 time 0.015456 [TensorRT] VERBOSE: Tactic: -32 time 0.048992 [TensorRT] VERBOSE: Tactic: -64 time 0.028224 [TensorRT] VERBOSE: Tactic: -128 time 0.019872 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01424 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013408 [TensorRT] VERBOSE: Tactic: 25 time 0.013728 [TensorRT] VERBOSE: Tactic: 26 time 0.01392 [TensorRT] VERBOSE: Tactic: 27 time 0.016704 [TensorRT] VERBOSE: Tactic: 31 time 0.013696 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.013408 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016096 [TensorRT] VERBOSE: Tactic: 256 time 0.017088 [TensorRT] VERBOSE: Tactic: 512 time 0.017408 [TensorRT] VERBOSE: Tactic: -32 time 0.032832 [TensorRT] VERBOSE: Tactic: -64 time 0.023552 [TensorRT] VERBOSE: Tactic: -128 time 0.022656 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.016096 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007776 [TensorRT] VERBOSE: Tactic: 1 time 0.007584 [TensorRT] VERBOSE: Tactic: 2 time 0.006432 [TensorRT] VERBOSE: Tactic: 3 time 0.007648 [TensorRT] VERBOSE: Tactic: 4 time 0.007776 [TensorRT] VERBOSE: Tactic: 5 time 0.00816 [TensorRT] VERBOSE: Tactic: 6 time 0.009216 [TensorRT] VERBOSE: Tactic: 7 time 0.007584 [TensorRT] VERBOSE: Tactic: 8 time 0.009216 [TensorRT] VERBOSE: Tactic: 9 time 0.0112 [TensorRT] VERBOSE: Tactic: 10 time 0.009344 [TensorRT] VERBOSE: Tactic: 11 time 0.009344 [TensorRT] VERBOSE: Tactic: 12 time 0.008192 [TensorRT] VERBOSE: Tactic: 13 time 0.007808 [TensorRT] VERBOSE: Tactic: 14 time 0.007936 [TensorRT] VERBOSE: Tactic: 15 time 0.008064 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.007904 [TensorRT] VERBOSE: Tactic: 19 time 0.009216 [TensorRT] VERBOSE: Tactic: 20 time 0.012576 [TensorRT] VERBOSE: Tactic: 21 time 0.01104 [TensorRT] VERBOSE: Tactic: 22 time 0.009216 [TensorRT] VERBOSE: Tactic: 23 time 0.009344 [TensorRT] VERBOSE: Tactic: 28 time 0.009664 [TensorRT] VERBOSE: Tactic: 29 time 0.009216 [TensorRT] VERBOSE: Tactic: 30 time 0.012544 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006432 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016384 [TensorRT] VERBOSE: Tactic: 256 time 0.016448 [TensorRT] VERBOSE: Tactic: 512 time 0.017408 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.016384 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007936 [TensorRT] VERBOSE: Tactic: 11 time 0.009152 [TensorRT] VERBOSE: Tactic: 12 time 0.007936 [TensorRT] VERBOSE: Tactic: 13 time 0.012576 [TensorRT] VERBOSE: Tactic: 14 time 0.010976 [TensorRT] VERBOSE: Tactic: 15 time 0.011392 [TensorRT] VERBOSE: Tactic: 16 time 0.020384 [TensorRT] VERBOSE: Tactic: 17 time 0.01552 [TensorRT] VERBOSE: Tactic: 18 time 0.016 [TensorRT] VERBOSE: Tactic: 19 time 0.017824 [TensorRT] VERBOSE: Tactic: 20 time 0.007936 [TensorRT] VERBOSE: Tactic: 21 time 0.007904 [TensorRT] VERBOSE: Tactic: 22 time 0.00912 [TensorRT] VERBOSE: Tactic: 23 time 0.014112 [TensorRT] VERBOSE: Tactic: 24 time 0.007808 [TensorRT] VERBOSE: Tactic: 25 time 0.007616 [TensorRT] VERBOSE: Tactic: 26 time 0.008736 [TensorRT] VERBOSE: Tactic: 27 time 0.011264 [TensorRT] VERBOSE: Tactic: 29 time 0.02496 [TensorRT] VERBOSE: Tactic: 30 time 0.014272 [TensorRT] VERBOSE: Tactic: 31 time 0.00976 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.007616 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011584 [TensorRT] VERBOSE: Tactic: 256 time 0.011264 [TensorRT] VERBOSE: Tactic: 512 time 0.011328 [TensorRT] VERBOSE: Tactic: -32 time 0.027328 [TensorRT] VERBOSE: Tactic: -64 time 0.017536 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00672 [TensorRT] VERBOSE: Tactic: 1 time 0.006848 [TensorRT] VERBOSE: Tactic: 2 time 0.006656 [TensorRT] VERBOSE: Tactic: 3 time 0.006272 [TensorRT] VERBOSE: Tactic: 4 time 0.006432 [TensorRT] VERBOSE: Tactic: 5 time 0.00624 [TensorRT] VERBOSE: Tactic: 6 time 0.00624 [TensorRT] VERBOSE: Tactic: 7 time 0.00656 [TensorRT] VERBOSE: Tactic: 8 time 0.006624 [TensorRT] VERBOSE: Tactic: 9 time 0.006304 [TensorRT] VERBOSE: Tactic: 28 time 0.006208 [TensorRT] VERBOSE: Fastest Tactic: 28 Time: 0.006208 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01072 [TensorRT] VERBOSE: Tactic: 256 time 0.01152 [TensorRT] VERBOSE: Tactic: 512 time 0.011712 [TensorRT] VERBOSE: Tactic: -32 time 0.027232 [TensorRT] VERBOSE: Tactic: -64 time 0.0176 [TensorRT] VERBOSE: Tactic: -128 time 0.014144 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009312 [TensorRT] VERBOSE: Tactic: 25 time 0.009088 [TensorRT] VERBOSE: Tactic: 26 time 0.008256 [TensorRT] VERBOSE: Tactic: 27 time 0.008608 [TensorRT] VERBOSE: Tactic: 31 time 0.009568 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.008256 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013856 [TensorRT] VERBOSE: Tactic: 256 time 0.014336 [TensorRT] VERBOSE: Tactic: 512 time 0.014112 [TensorRT] VERBOSE: Tactic: -32 time 0.023936 [TensorRT] VERBOSE: Tactic: -64 time 0.017472 [TensorRT] VERBOSE: Tactic: -128 time 0.017408 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013856 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.0064 [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 2 time 0.006112 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.006048 [TensorRT] VERBOSE: Tactic: 5 time 0.005952 [TensorRT] VERBOSE: Tactic: 6 time 0.007648 [TensorRT] VERBOSE: Tactic: 7 time 0.00768 [TensorRT] VERBOSE: Tactic: 8 time 0.007776 [TensorRT] VERBOSE: Tactic: 9 time 0.007616 [TensorRT] VERBOSE: Tactic: 10 time 0.00944 [TensorRT] VERBOSE: Tactic: 11 time 0.007872 [TensorRT] VERBOSE: Tactic: 12 time 0.00768 [TensorRT] VERBOSE: Tactic: 13 time 0.007616 [TensorRT] VERBOSE: Tactic: 14 time 0.007776 [TensorRT] VERBOSE: Tactic: 15 time 0.006144 [TensorRT] VERBOSE: Tactic: 16 time 0.007488 [TensorRT] VERBOSE: Tactic: 17 time 0.007776 [TensorRT] VERBOSE: Tactic: 18 time 0.007648 [TensorRT] VERBOSE: Tactic: 19 time 0.007616 [TensorRT] VERBOSE: Tactic: 20 time 0.011072 [TensorRT] VERBOSE: Tactic: 21 time 0.009248 [TensorRT] VERBOSE: Tactic: 22 time 0.00752 [TensorRT] VERBOSE: Tactic: 23 time 0.007584 [TensorRT] VERBOSE: Tactic: 28 time 0.007552 [TensorRT] VERBOSE: Tactic: 29 time 0.008192 [TensorRT] VERBOSE: Tactic: 30 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.012576 [TensorRT] VERBOSE: Tactic: 256 time 0.013952 [TensorRT] VERBOSE: Tactic: 512 time 0.014272 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.012576 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00608 [TensorRT] VERBOSE: Tactic: 11 time 0.007584 [TensorRT] VERBOSE: Tactic: 12 time 0.00736 [TensorRT] VERBOSE: Tactic: 13 time 0.009088 [TensorRT] VERBOSE: Tactic: 14 time 0.008672 [TensorRT] VERBOSE: Tactic: 15 time 0.00976 [TensorRT] VERBOSE: Tactic: 16 time 0.014272 [TensorRT] VERBOSE: Tactic: 17 time 0.013664 [TensorRT] VERBOSE: Tactic: 18 time 0.013568 [TensorRT] VERBOSE: Tactic: 19 time 0.01536 [TensorRT] VERBOSE: Tactic: 20 time 0.006176 [TensorRT] VERBOSE: Tactic: 21 time 0.005952 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 24 time 0.006048 [TensorRT] VERBOSE: Tactic: 25 time 0.006176 [TensorRT] VERBOSE: Tactic: 26 time 0.006048 [TensorRT] VERBOSE: Tactic: 27 time 0.007552 [TensorRT] VERBOSE: Tactic: 29 time 0.015744 [TensorRT] VERBOSE: Tactic: 30 time 0.010848 [TensorRT] VERBOSE: Tactic: 31 time 0.007776 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_167 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_167 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_167 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_167 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_167 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01408 [TensorRT] VERBOSE: Tactic: 256 time 0.015616 [TensorRT] VERBOSE: Tactic: 512 time 0.015616 [TensorRT] VERBOSE: Tactic: -32 time 0.047936 [TensorRT] VERBOSE: Tactic: -64 time 0.028128 [TensorRT] VERBOSE: Tactic: -128 time 0.01984 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01408 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009824 [TensorRT] VERBOSE: Tactic: 1 time 0.010272 [TensorRT] VERBOSE: Tactic: 2 time 0.009504 [TensorRT] VERBOSE: Tactic: 3 time 0.010176 [TensorRT] VERBOSE: Tactic: 4 time 0.009216 [TensorRT] VERBOSE: Tactic: 5 time 0.009984 [TensorRT] VERBOSE: Tactic: 6 time 0.010912 [TensorRT] VERBOSE: Tactic: 7 time 0.010112 [TensorRT] VERBOSE: Tactic: 8 time 0.01024 [TensorRT] VERBOSE: Tactic: 9 time 0.009472 [TensorRT] VERBOSE: Tactic: 28 time 0.009792 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.015584 [TensorRT] VERBOSE: Tactic: 256 time 0.014336 [TensorRT] VERBOSE: Tactic: 512 time 0.015584 [TensorRT] VERBOSE: Tactic: -32 time 0.048928 [TensorRT] VERBOSE: Tactic: -64 time 0.02912 [TensorRT] VERBOSE: Tactic: -128 time 0.0192 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013376 [TensorRT] VERBOSE: Tactic: 25 time 0.013856 [TensorRT] VERBOSE: Tactic: 26 time 0.0136 [TensorRT] VERBOSE: Tactic: 27 time 0.016 [TensorRT] VERBOSE: Tactic: 31 time 0.013056 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.013056 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017248 [TensorRT] VERBOSE: Tactic: 256 time 0.017088 [TensorRT] VERBOSE: Tactic: 512 time 0.017312 [TensorRT] VERBOSE: Tactic: -32 time 0.033344 [TensorRT] VERBOSE: Tactic: -64 time 0.023264 [TensorRT] VERBOSE: Tactic: -128 time 0.022304 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.017088 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008032 [TensorRT] VERBOSE: Tactic: 1 time 0.007616 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.007424 [TensorRT] VERBOSE: Tactic: 4 time 0.007744 [TensorRT] VERBOSE: Tactic: 5 time 0.007616 [TensorRT] VERBOSE: Tactic: 6 time 0.008864 [TensorRT] VERBOSE: Tactic: 7 time 0.007904 [TensorRT] VERBOSE: Tactic: 8 time 0.009472 [TensorRT] VERBOSE: Tactic: 9 time 0.01152 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.00944 [TensorRT] VERBOSE: Tactic: 12 time 0.007456 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.00736 [TensorRT] VERBOSE: Tactic: 15 time 0.007584 [TensorRT] VERBOSE: Tactic: 16 time 0.009152 [TensorRT] VERBOSE: Tactic: 17 time 0.009152 [TensorRT] VERBOSE: Tactic: 18 time 0.008128 [TensorRT] VERBOSE: Tactic: 19 time 0.009312 [TensorRT] VERBOSE: Tactic: 20 time 0.012896 [TensorRT] VERBOSE: Tactic: 21 time 0.010784 [TensorRT] VERBOSE: Tactic: 22 time 0.009312 [TensorRT] VERBOSE: Tactic: 23 time 0.009312 [TensorRT] VERBOSE: Tactic: 28 time 0.009664 [TensorRT] VERBOSE: Tactic: 29 time 0.009536 [TensorRT] VERBOSE: Tactic: 30 time 0.012704 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017376 [TensorRT] VERBOSE: Tactic: 256 time 0.017056 [TensorRT] VERBOSE: Tactic: 512 time 0.017472 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.017056 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007904 [TensorRT] VERBOSE: Tactic: 11 time 0.009216 [TensorRT] VERBOSE: Tactic: 12 time 0.007808 [TensorRT] VERBOSE: Tactic: 13 time 0.012608 [TensorRT] VERBOSE: Tactic: 14 time 0.010496 [TensorRT] VERBOSE: Tactic: 15 time 0.011648 [TensorRT] VERBOSE: Tactic: 16 time 0.020768 [TensorRT] VERBOSE: Tactic: 17 time 0.015648 [TensorRT] VERBOSE: Tactic: 18 time 0.017088 [TensorRT] VERBOSE: Tactic: 19 time 0.01792 [TensorRT] VERBOSE: Tactic: 20 time 0.007584 [TensorRT] VERBOSE: Tactic: 21 time 0.007584 [TensorRT] VERBOSE: Tactic: 22 time 0.009568 [TensorRT] VERBOSE: Tactic: 23 time 0.013824 [TensorRT] VERBOSE: Tactic: 24 time 0.007968 [TensorRT] VERBOSE: Tactic: 25 time 0.00688 [TensorRT] VERBOSE: Tactic: 26 time 0.009152 [TensorRT] VERBOSE: Tactic: 27 time 0.011008 [TensorRT] VERBOSE: Tactic: 29 time 0.025152 [TensorRT] VERBOSE: Tactic: 30 time 0.014144 [TensorRT] VERBOSE: Tactic: 31 time 0.009504 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.00688 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011296 [TensorRT] VERBOSE: Tactic: 256 time 0.011424 [TensorRT] VERBOSE: Tactic: 512 time 0.010912 [TensorRT] VERBOSE: Tactic: -32 time 0.027104 [TensorRT] VERBOSE: Tactic: -64 time 0.018656 [TensorRT] VERBOSE: Tactic: -128 time 0.01424 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.010912 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006688 [TensorRT] VERBOSE: Tactic: 1 time 0.006176 [TensorRT] VERBOSE: Tactic: 2 time 0.006496 [TensorRT] VERBOSE: Tactic: 3 time 0.006496 [TensorRT] VERBOSE: Tactic: 4 time 0.006528 [TensorRT] VERBOSE: Tactic: 5 time 0.006272 [TensorRT] VERBOSE: Tactic: 6 time 0.006624 [TensorRT] VERBOSE: Tactic: 7 time 0.0064 [TensorRT] VERBOSE: Tactic: 8 time 0.006624 [TensorRT] VERBOSE: Tactic: 9 time 0.00672 [TensorRT] VERBOSE: Tactic: 28 time 0.006784 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.006176 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 256 time 0.010848 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.027808 [TensorRT] VERBOSE: Tactic: -64 time 0.017632 [TensorRT] VERBOSE: Tactic: -128 time 0.014528 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.010848 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.00928 [TensorRT] VERBOSE: Tactic: 25 time 0.008928 [TensorRT] VERBOSE: Tactic: 26 time 0.00816 [TensorRT] VERBOSE: Tactic: 27 time 0.008544 [TensorRT] VERBOSE: Tactic: 31 time 0.009504 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.00816 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013984 [TensorRT] VERBOSE: Tactic: 256 time 0.014208 [TensorRT] VERBOSE: Tactic: 512 time 0.014304 [TensorRT] VERBOSE: Tactic: -32 time 0.025184 [TensorRT] VERBOSE: Tactic: -64 time 0.017504 [TensorRT] VERBOSE: Tactic: -128 time 0.017376 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013984 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006688 [TensorRT] VERBOSE: Tactic: 1 time 0.006432 [TensorRT] VERBOSE: Tactic: 2 time 0.006304 [TensorRT] VERBOSE: Tactic: 3 time 0.005984 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.006272 [TensorRT] VERBOSE: Tactic: 6 time 0.007328 [TensorRT] VERBOSE: Tactic: 7 time 0.007616 [TensorRT] VERBOSE: Tactic: 8 time 0.007808 [TensorRT] VERBOSE: Tactic: 9 time 0.007744 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.007808 [TensorRT] VERBOSE: Tactic: 12 time 0.007424 [TensorRT] VERBOSE: Tactic: 13 time 0.007616 [TensorRT] VERBOSE: Tactic: 14 time 0.007584 [TensorRT] VERBOSE: Tactic: 15 time 0.0072 [TensorRT] VERBOSE: Tactic: 16 time 0.007872 [TensorRT] VERBOSE: Tactic: 17 time 0.007744 [TensorRT] VERBOSE: Tactic: 18 time 0.007616 [TensorRT] VERBOSE: Tactic: 19 time 0.00752 [TensorRT] VERBOSE: Tactic: 20 time 0.012288 [TensorRT] VERBOSE: Tactic: 21 time 0.009184 [TensorRT] VERBOSE: Tactic: 22 time 0.009472 [TensorRT] VERBOSE: Tactic: 23 time 0.007712 [TensorRT] VERBOSE: Tactic: 28 time 0.007584 [TensorRT] VERBOSE: Tactic: 29 time 0.009152 [TensorRT] VERBOSE: Tactic: 30 time 0.011104 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01408 [TensorRT] VERBOSE: Tactic: 256 time 0.01408 [TensorRT] VERBOSE: Tactic: 512 time 0.014144 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01408 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.005984 [TensorRT] VERBOSE: Tactic: 11 time 0.007168 [TensorRT] VERBOSE: Tactic: 12 time 0.007648 [TensorRT] VERBOSE: Tactic: 13 time 0.009152 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.010656 [TensorRT] VERBOSE: Tactic: 16 time 0.01392 [TensorRT] VERBOSE: Tactic: 17 time 0.014144 [TensorRT] VERBOSE: Tactic: 18 time 0.01376 [TensorRT] VERBOSE: Tactic: 19 time 0.01536 [TensorRT] VERBOSE: Tactic: 20 time 0.006016 [TensorRT] VERBOSE: Tactic: 21 time 0.00656 [TensorRT] VERBOSE: Tactic: 22 time 0.006784 [TensorRT] VERBOSE: Tactic: 23 time 0.009408 [TensorRT] VERBOSE: Tactic: 24 time 0.005952 [TensorRT] VERBOSE: Tactic: 25 time 0.006016 [TensorRT] VERBOSE: Tactic: 26 time 0.006016 [TensorRT] VERBOSE: Tactic: 27 time 0.007552 [TensorRT] VERBOSE: Tactic: 29 time 0.016128 [TensorRT] VERBOSE: Tactic: 30 time 0.011232 [TensorRT] VERBOSE: Tactic: 31 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_172 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_172 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_172 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_172 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_172 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014432 [TensorRT] VERBOSE: Tactic: 256 time 0.014368 [TensorRT] VERBOSE: Tactic: 512 time 0.014464 [TensorRT] VERBOSE: Tactic: -32 time 0.047712 [TensorRT] VERBOSE: Tactic: -64 time 0.02864 [TensorRT] VERBOSE: Tactic: -128 time 0.019488 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014368 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009152 [TensorRT] VERBOSE: Tactic: 1 time 0.009696 [TensorRT] VERBOSE: Tactic: 2 time 0.010176 [TensorRT] VERBOSE: Tactic: 3 time 0.009408 [TensorRT] VERBOSE: Tactic: 4 time 0.010144 [TensorRT] VERBOSE: Tactic: 5 time 0.01024 [TensorRT] VERBOSE: Tactic: 6 time 0.011968 [TensorRT] VERBOSE: Tactic: 7 time 0.009824 [TensorRT] VERBOSE: Tactic: 8 time 0.010368 [TensorRT] VERBOSE: Tactic: 9 time 0.00944 [TensorRT] VERBOSE: Tactic: 28 time 0.009824 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009152 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014432 [TensorRT] VERBOSE: Tactic: 256 time 0.014272 [TensorRT] VERBOSE: Tactic: 512 time 0.015872 [TensorRT] VERBOSE: Tactic: -32 time 0.049376 [TensorRT] VERBOSE: Tactic: -64 time 0.028384 [TensorRT] VERBOSE: Tactic: -128 time 0.019104 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014272 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014496 [TensorRT] VERBOSE: Tactic: 25 time 0.014016 [TensorRT] VERBOSE: Tactic: 26 time 0.014336 [TensorRT] VERBOSE: Tactic: 27 time 0.01648 [TensorRT] VERBOSE: Tactic: 31 time 0.013632 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.013632 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017088 [TensorRT] VERBOSE: Tactic: 256 time 0.016864 [TensorRT] VERBOSE: Tactic: 512 time 0.017056 [TensorRT] VERBOSE: Tactic: -32 time 0.03312 [TensorRT] VERBOSE: Tactic: -64 time 0.024096 [TensorRT] VERBOSE: Tactic: -128 time 0.022368 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.016864 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008064 [TensorRT] VERBOSE: Tactic: 1 time 0.007424 [TensorRT] VERBOSE: Tactic: 2 time 0.006528 [TensorRT] VERBOSE: Tactic: 3 time 0.007648 [TensorRT] VERBOSE: Tactic: 4 time 0.008 [TensorRT] VERBOSE: Tactic: 5 time 0.007936 [TensorRT] VERBOSE: Tactic: 6 time 0.009184 [TensorRT] VERBOSE: Tactic: 7 time 0.008 [TensorRT] VERBOSE: Tactic: 8 time 0.009472 [TensorRT] VERBOSE: Tactic: 9 time 0.00976 [TensorRT] VERBOSE: Tactic: 10 time 0.009248 [TensorRT] VERBOSE: Tactic: 11 time 0.009152 [TensorRT] VERBOSE: Tactic: 12 time 0.008 [TensorRT] VERBOSE: Tactic: 13 time 0.007616 [TensorRT] VERBOSE: Tactic: 14 time 0.00752 [TensorRT] VERBOSE: Tactic: 15 time 0.008064 [TensorRT] VERBOSE: Tactic: 16 time 0.009184 [TensorRT] VERBOSE: Tactic: 17 time 0.00768 [TensorRT] VERBOSE: Tactic: 18 time 0.009216 [TensorRT] VERBOSE: Tactic: 19 time 0.00944 [TensorRT] VERBOSE: Tactic: 20 time 0.012544 [TensorRT] VERBOSE: Tactic: 21 time 0.010624 [TensorRT] VERBOSE: Tactic: 22 time 0.009312 [TensorRT] VERBOSE: Tactic: 23 time 0.008736 [TensorRT] VERBOSE: Tactic: 28 time 0.009728 [TensorRT] VERBOSE: Tactic: 29 time 0.009472 [TensorRT] VERBOSE: Tactic: 30 time 0.01264 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006528 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017408 [TensorRT] VERBOSE: Tactic: 256 time 0.017216 [TensorRT] VERBOSE: Tactic: 512 time 0.017408 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.017216 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.008 [TensorRT] VERBOSE: Tactic: 11 time 0.009216 [TensorRT] VERBOSE: Tactic: 12 time 0.007584 [TensorRT] VERBOSE: Tactic: 13 time 0.012288 [TensorRT] VERBOSE: Tactic: 14 time 0.009824 [TensorRT] VERBOSE: Tactic: 15 time 0.010848 [TensorRT] VERBOSE: Tactic: 16 time 0.020384 [TensorRT] VERBOSE: Tactic: 17 time 0.015744 [TensorRT] VERBOSE: Tactic: 18 time 0.016928 [TensorRT] VERBOSE: Tactic: 19 time 0.017344 [TensorRT] VERBOSE: Tactic: 20 time 0.007712 [TensorRT] VERBOSE: Tactic: 21 time 0.00752 [TensorRT] VERBOSE: Tactic: 22 time 0.009216 [TensorRT] VERBOSE: Tactic: 23 time 0.013856 [TensorRT] VERBOSE: Tactic: 24 time 0.00768 [TensorRT] VERBOSE: Tactic: 25 time 0.007712 [TensorRT] VERBOSE: Tactic: 26 time 0.00912 [TensorRT] VERBOSE: Tactic: 27 time 0.010912 [TensorRT] VERBOSE: Tactic: 29 time 0.025568 [TensorRT] VERBOSE: Tactic: 30 time 0.014304 [TensorRT] VERBOSE: Tactic: 31 time 0.009888 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.00752 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010816 [TensorRT] VERBOSE: Tactic: 256 time 0.011616 [TensorRT] VERBOSE: Tactic: 512 time 0.011392 [TensorRT] VERBOSE: Tactic: -32 time 0.028352 [TensorRT] VERBOSE: Tactic: -64 time 0.0176 [TensorRT] VERBOSE: Tactic: -128 time 0.014368 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.010816 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.006528 [TensorRT] VERBOSE: Tactic: 2 time 0.00624 [TensorRT] VERBOSE: Tactic: 3 time 0.006752 [TensorRT] VERBOSE: Tactic: 4 time 0.006848 [TensorRT] VERBOSE: Tactic: 5 time 0.006432 [TensorRT] VERBOSE: Tactic: 6 time 0.006656 [TensorRT] VERBOSE: Tactic: 7 time 0.006464 [TensorRT] VERBOSE: Tactic: 8 time 0.006496 [TensorRT] VERBOSE: Tactic: 9 time 0.007104 [TensorRT] VERBOSE: Tactic: 28 time 0.006368 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011392 [TensorRT] VERBOSE: Tactic: 256 time 0.011296 [TensorRT] VERBOSE: Tactic: 512 time 0.0112 [TensorRT] VERBOSE: Tactic: -32 time 0.02816 [TensorRT] VERBOSE: Tactic: -64 time 0.0176 [TensorRT] VERBOSE: Tactic: -128 time 0.0152 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.0112 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009792 [TensorRT] VERBOSE: Tactic: 25 time 0.00912 [TensorRT] VERBOSE: Tactic: 26 time 0.008192 [TensorRT] VERBOSE: Tactic: 27 time 0.008608 [TensorRT] VERBOSE: Tactic: 31 time 0.01008 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.008192 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014176 [TensorRT] VERBOSE: Tactic: 256 time 0.013888 [TensorRT] VERBOSE: Tactic: 512 time 0.013984 [TensorRT] VERBOSE: Tactic: -32 time 0.024192 [TensorRT] VERBOSE: Tactic: -64 time 0.017312 [TensorRT] VERBOSE: Tactic: -128 time 0.017856 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013888 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Tactic: 1 time 0.006016 [TensorRT] VERBOSE: Tactic: 2 time 0.006272 [TensorRT] VERBOSE: Tactic: 3 time 0.00608 [TensorRT] VERBOSE: Tactic: 4 time 0.006048 [TensorRT] VERBOSE: Tactic: 5 time 0.006208 [TensorRT] VERBOSE: Tactic: 6 time 0.007168 [TensorRT] VERBOSE: Tactic: 7 time 0.00768 [TensorRT] VERBOSE: Tactic: 8 time 0.007616 [TensorRT] VERBOSE: Tactic: 9 time 0.00784 [TensorRT] VERBOSE: Tactic: 10 time 0.008512 [TensorRT] VERBOSE: Tactic: 11 time 0.007776 [TensorRT] VERBOSE: Tactic: 12 time 0.007616 [TensorRT] VERBOSE: Tactic: 13 time 0.007456 [TensorRT] VERBOSE: Tactic: 14 time 0.007744 [TensorRT] VERBOSE: Tactic: 15 time 0.006272 [TensorRT] VERBOSE: Tactic: 16 time 0.007616 [TensorRT] VERBOSE: Tactic: 17 time 0.007392 [TensorRT] VERBOSE: Tactic: 18 time 0.00752 [TensorRT] VERBOSE: Tactic: 19 time 0.007552 [TensorRT] VERBOSE: Tactic: 20 time 0.012064 [TensorRT] VERBOSE: Tactic: 21 time 0.009216 [TensorRT] VERBOSE: Tactic: 22 time 0.008512 [TensorRT] VERBOSE: Tactic: 23 time 0.007744 [TensorRT] VERBOSE: Tactic: 28 time 0.007552 [TensorRT] VERBOSE: Tactic: 29 time 0.009344 [TensorRT] VERBOSE: Tactic: 30 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014144 [TensorRT] VERBOSE: Tactic: 256 time 0.01424 [TensorRT] VERBOSE: Tactic: 512 time 0.01424 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014144 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006272 [TensorRT] VERBOSE: Tactic: 11 time 0.007552 [TensorRT] VERBOSE: Tactic: 12 time 0.006752 [TensorRT] VERBOSE: Tactic: 13 time 0.009088 [TensorRT] VERBOSE: Tactic: 14 time 0.008416 [TensorRT] VERBOSE: Tactic: 15 time 0.009632 [TensorRT] VERBOSE: Tactic: 16 time 0.013856 [TensorRT] VERBOSE: Tactic: 17 time 0.013984 [TensorRT] VERBOSE: Tactic: 18 time 0.013824 [TensorRT] VERBOSE: Tactic: 19 time 0.01536 [TensorRT] VERBOSE: Tactic: 20 time 0.006016 [TensorRT] VERBOSE: Tactic: 21 time 0.006144 [TensorRT] VERBOSE: Tactic: 22 time 0.00752 [TensorRT] VERBOSE: Tactic: 23 time 0.00928 [TensorRT] VERBOSE: Tactic: 24 time 0.006144 [TensorRT] VERBOSE: Tactic: 25 time 0.006016 [TensorRT] VERBOSE: Tactic: 26 time 0.006208 [TensorRT] VERBOSE: Tactic: 27 time 0.00768 [TensorRT] VERBOSE: Tactic: 29 time 0.015648 [TensorRT] VERBOSE: Tactic: 30 time 0.010784 [TensorRT] VERBOSE: Tactic: 31 time 0.007584 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_177 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_177 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_177 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_177 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_177 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01408 [TensorRT] VERBOSE: Tactic: 256 time 0.015552 [TensorRT] VERBOSE: Tactic: 512 time 0.01536 [TensorRT] VERBOSE: Tactic: -32 time 0.047648 [TensorRT] VERBOSE: Tactic: -64 time 0.029216 [TensorRT] VERBOSE: Tactic: -128 time 0.019456 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01408 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00976 [TensorRT] VERBOSE: Tactic: 1 time 0.009632 [TensorRT] VERBOSE: Tactic: 2 time 0.009216 [TensorRT] VERBOSE: Tactic: 3 time 0.009888 [TensorRT] VERBOSE: Tactic: 4 time 0.009952 [TensorRT] VERBOSE: Tactic: 5 time 0.010304 [TensorRT] VERBOSE: Tactic: 6 time 0.010176 [TensorRT] VERBOSE: Tactic: 7 time 0.009984 [TensorRT] VERBOSE: Tactic: 8 time 0.01008 [TensorRT] VERBOSE: Tactic: 9 time 0.009376 [TensorRT] VERBOSE: Tactic: 28 time 0.010016 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014368 [TensorRT] VERBOSE: Tactic: 256 time 0.01408 [TensorRT] VERBOSE: Tactic: 512 time 0.015808 [TensorRT] VERBOSE: Tactic: -32 time 0.048064 [TensorRT] VERBOSE: Tactic: -64 time 0.02912 [TensorRT] VERBOSE: Tactic: -128 time 0.019008 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.01408 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013856 [TensorRT] VERBOSE: Tactic: 25 time 0.013984 [TensorRT] VERBOSE: Tactic: 26 time 0.014304 [TensorRT] VERBOSE: Tactic: 27 time 0.015328 [TensorRT] VERBOSE: Tactic: 31 time 0.013664 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.013664 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0168 [TensorRT] VERBOSE: Tactic: 256 time 0.017408 [TensorRT] VERBOSE: Tactic: 512 time 0.017184 [TensorRT] VERBOSE: Tactic: -32 time 0.0328 [TensorRT] VERBOSE: Tactic: -64 time 0.023808 [TensorRT] VERBOSE: Tactic: -128 time 0.023136 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.0168 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007456 [TensorRT] VERBOSE: Tactic: 1 time 0.007552 [TensorRT] VERBOSE: Tactic: 2 time 0.0064 [TensorRT] VERBOSE: Tactic: 3 time 0.007776 [TensorRT] VERBOSE: Tactic: 4 time 0.007744 [TensorRT] VERBOSE: Tactic: 5 time 0.007744 [TensorRT] VERBOSE: Tactic: 6 time 0.009216 [TensorRT] VERBOSE: Tactic: 7 time 0.007872 [TensorRT] VERBOSE: Tactic: 8 time 0.009216 [TensorRT] VERBOSE: Tactic: 9 time 0.010528 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.009216 [TensorRT] VERBOSE: Tactic: 12 time 0.007808 [TensorRT] VERBOSE: Tactic: 13 time 0.008768 [TensorRT] VERBOSE: Tactic: 14 time 0.007936 [TensorRT] VERBOSE: Tactic: 15 time 0.008 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.009216 [TensorRT] VERBOSE: Tactic: 19 time 0.009696 [TensorRT] VERBOSE: Tactic: 20 time 0.012288 [TensorRT] VERBOSE: Tactic: 21 time 0.010784 [TensorRT] VERBOSE: Tactic: 22 time 0.009472 [TensorRT] VERBOSE: Tactic: 23 time 0.0096 [TensorRT] VERBOSE: Tactic: 28 time 0.009728 [TensorRT] VERBOSE: Tactic: 29 time 0.010784 [TensorRT] VERBOSE: Tactic: 30 time 0.01248 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.0064 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017312 [TensorRT] VERBOSE: Tactic: 256 time 0.016864 [TensorRT] VERBOSE: Tactic: 512 time 0.017632 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.016864 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007776 [TensorRT] VERBOSE: Tactic: 11 time 0.009152 [TensorRT] VERBOSE: Tactic: 12 time 0.007584 [TensorRT] VERBOSE: Tactic: 13 time 0.01248 [TensorRT] VERBOSE: Tactic: 14 time 0.010688 [TensorRT] VERBOSE: Tactic: 15 time 0.010816 [TensorRT] VERBOSE: Tactic: 16 time 0.020416 [TensorRT] VERBOSE: Tactic: 17 time 0.015392 [TensorRT] VERBOSE: Tactic: 18 time 0.017024 [TensorRT] VERBOSE: Tactic: 19 time 0.017472 [TensorRT] VERBOSE: Tactic: 20 time 0.007808 [TensorRT] VERBOSE: Tactic: 21 time 0.007456 [TensorRT] VERBOSE: Tactic: 22 time 0.009216 [TensorRT] VERBOSE: Tactic: 23 time 0.013792 [TensorRT] VERBOSE: Tactic: 24 time 0.007616 [TensorRT] VERBOSE: Tactic: 25 time 0.007648 [TensorRT] VERBOSE: Tactic: 26 time 0.00912 [TensorRT] VERBOSE: Tactic: 27 time 0.011552 [TensorRT] VERBOSE: Tactic: 29 time 0.025152 [TensorRT] VERBOSE: Tactic: 30 time 0.014336 [TensorRT] VERBOSE: Tactic: 31 time 0.00976 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.007456 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.008192 [TensorRT] VERBOSE: Tactic: 0 time 0.005632 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005632 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.013056 [TensorRT] VERBOSE: Tactic: 0 time 0.02624 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.013056 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016256 [TensorRT] VERBOSE: Tactic: 0 time 0.010752 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010752 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01536 [TensorRT] VERBOSE: Tactic: 0 time 0.01856 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01536 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022784 [TensorRT] VERBOSE: Tactic: 0 time 0.0128 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0128 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014592 [TensorRT] VERBOSE: Tactic: 0 time 0.006272 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006272 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017376 [TensorRT] VERBOSE: Tactic: 0 time 0.012096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012096 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015776 [TensorRT] VERBOSE: Tactic: 0 time 0.023424 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015776 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013024 [TensorRT] VERBOSE: Tactic: 256 time 0.012608 [TensorRT] VERBOSE: Tactic: 512 time 0.01328 [TensorRT] VERBOSE: Tactic: -32 time 0.028512 [TensorRT] VERBOSE: Tactic: -64 time 0.017696 [TensorRT] VERBOSE: Tactic: -128 time 0.014848 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.012608 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008032 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.00656 [TensorRT] VERBOSE: Tactic: 3 time 0.006272 [TensorRT] VERBOSE: Tactic: 4 time 0.006528 [TensorRT] VERBOSE: Tactic: 5 time 0.00656 [TensorRT] VERBOSE: Tactic: 6 time 0.006144 [TensorRT] VERBOSE: Tactic: 7 time 0.006656 [TensorRT] VERBOSE: Tactic: 8 time 0.00656 [TensorRT] VERBOSE: Tactic: 9 time 0.006464 [TensorRT] VERBOSE: Tactic: 28 time 0.008192 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.012736 [TensorRT] VERBOSE: Tactic: 256 time 0.012736 [TensorRT] VERBOSE: Tactic: 512 time 0.01296 [TensorRT] VERBOSE: Tactic: -32 time 0.027904 [TensorRT] VERBOSE: Tactic: -64 time 0.017856 [TensorRT] VERBOSE: Tactic: -128 time 0.014656 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.012736 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009216 [TensorRT] VERBOSE: Tactic: 25 time 0.009024 [TensorRT] VERBOSE: Tactic: 26 time 0.008768 [TensorRT] VERBOSE: Tactic: 27 time 0.008192 [TensorRT] VERBOSE: Tactic: 31 time 0.010624 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.008192 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.012864 [TensorRT] VERBOSE: Tactic: 256 time 0.014208 [TensorRT] VERBOSE: Tactic: 512 time 0.013824 [TensorRT] VERBOSE: Tactic: -32 time 0.024288 [TensorRT] VERBOSE: Tactic: -64 time 0.017696 [TensorRT] VERBOSE: Tactic: -128 time 0.017248 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.012864 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.00592 [TensorRT] VERBOSE: Tactic: 2 time 0.006016 [TensorRT] VERBOSE: Tactic: 3 time 0.006016 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.005888 [TensorRT] VERBOSE: Tactic: 6 time 0.007616 [TensorRT] VERBOSE: Tactic: 7 time 0.00752 [TensorRT] VERBOSE: Tactic: 8 time 0.007488 [TensorRT] VERBOSE: Tactic: 9 time 0.007552 [TensorRT] VERBOSE: Tactic: 10 time 0.009184 [TensorRT] VERBOSE: Tactic: 11 time 0.007424 [TensorRT] VERBOSE: Tactic: 12 time 0.00752 [TensorRT] VERBOSE: Tactic: 13 time 0.007744 [TensorRT] VERBOSE: Tactic: 14 time 0.007392 [TensorRT] VERBOSE: Tactic: 15 time 0.007808 [TensorRT] VERBOSE: Tactic: 16 time 0.00768 [TensorRT] VERBOSE: Tactic: 17 time 0.007552 [TensorRT] VERBOSE: Tactic: 18 time 0.007424 [TensorRT] VERBOSE: Tactic: 19 time 0.007648 [TensorRT] VERBOSE: Tactic: 20 time 0.011584 [TensorRT] VERBOSE: Tactic: 21 time 0.009216 [TensorRT] VERBOSE: Tactic: 22 time 0.008 [TensorRT] VERBOSE: Tactic: 23 time 0.007712 [TensorRT] VERBOSE: Tactic: 28 time 0.007552 [TensorRT] VERBOSE: Tactic: 29 time 0.009248 [TensorRT] VERBOSE: Tactic: 30 time 0.01088 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.005888 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014208 [TensorRT] VERBOSE: Tactic: 256 time 0.013984 [TensorRT] VERBOSE: Tactic: 512 time 0.01392 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.01392 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006048 [TensorRT] VERBOSE: Tactic: 11 time 0.007168 [TensorRT] VERBOSE: Tactic: 12 time 0.007392 [TensorRT] VERBOSE: Tactic: 13 time 0.009152 [TensorRT] VERBOSE: Tactic: 14 time 0.00912 [TensorRT] VERBOSE: Tactic: 15 time 0.009472 [TensorRT] VERBOSE: Tactic: 16 time 0.01392 [TensorRT] VERBOSE: Tactic: 17 time 0.012928 [TensorRT] VERBOSE: Tactic: 18 time 0.013952 [TensorRT] VERBOSE: Tactic: 19 time 0.015424 [TensorRT] VERBOSE: Tactic: 20 time 0.005984 [TensorRT] VERBOSE: Tactic: 21 time 0.006176 [TensorRT] VERBOSE: Tactic: 22 time 0.007488 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 24 time 0.006048 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.006144 [TensorRT] VERBOSE: Tactic: 27 time 0.007488 [TensorRT] VERBOSE: Tactic: 29 time 0.015872 [TensorRT] VERBOSE: Tactic: 30 time 0.010528 [TensorRT] VERBOSE: Tactic: 31 time 0.007872 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014336 [TensorRT] VERBOSE: Tactic: 0 time 0.025248 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01568 [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006016 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015712 [TensorRT] VERBOSE: Tactic: 0 time 0.01888 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015712 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02128 [TensorRT] VERBOSE: Tactic: 0 time 0.012064 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012064 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017056 [TensorRT] VERBOSE: Tactic: 0 time 0.012608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016896 [TensorRT] VERBOSE: Tactic: 0 time 0.022112 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016896 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017568 [TensorRT] VERBOSE: Tactic: 0 time 0.009344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009344 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016096 [TensorRT] VERBOSE: Tactic: 0 time 0.025728 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016096 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017344 [TensorRT] VERBOSE: Tactic: 0 time 0.006112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006112 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016384 [TensorRT] VERBOSE: Tactic: 0 time 0.0096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0096 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016032 [TensorRT] VERBOSE: Tactic: 0 time 0.025888 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016032 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017216 [TensorRT] VERBOSE: Tactic: 0 time 0.009184 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009184 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019072 [TensorRT] VERBOSE: Tactic: 256 time 0.020672 [TensorRT] VERBOSE: Tactic: 512 time 0.02 [TensorRT] VERBOSE: Tactic: -32 time 0.044352 [TensorRT] VERBOSE: Tactic: -64 time 0.026752 [TensorRT] VERBOSE: Tactic: -128 time 0.026368 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013312 [TensorRT] VERBOSE: Tactic: 1 time 0.01488 [TensorRT] VERBOSE: Tactic: 2 time 0.011136 [TensorRT] VERBOSE: Tactic: 3 time 0.0128 [TensorRT] VERBOSE: Tactic: 4 time 0.010976 [TensorRT] VERBOSE: Tactic: 5 time 0.012064 [TensorRT] VERBOSE: Tactic: 6 time 0.012544 [TensorRT] VERBOSE: Tactic: 7 time 0.011872 [TensorRT] VERBOSE: Tactic: 8 time 0.011424 [TensorRT] VERBOSE: Tactic: 9 time 0.012 [TensorRT] VERBOSE: Tactic: 28 time 0.012864 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.010976 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019808 [TensorRT] VERBOSE: Tactic: 256 time 0.019584 [TensorRT] VERBOSE: Tactic: 512 time 0.019744 [TensorRT] VERBOSE: Tactic: -32 time 0.043008 [TensorRT] VERBOSE: Tactic: -64 time 0.028032 [TensorRT] VERBOSE: Tactic: -128 time 0.026464 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.019584 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014752 [TensorRT] VERBOSE: Tactic: 25 time 0.016128 [TensorRT] VERBOSE: Tactic: 26 time 0.014496 [TensorRT] VERBOSE: Tactic: 27 time 0.014368 [TensorRT] VERBOSE: Tactic: 31 time 0.015392 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.014368 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022176 [TensorRT] VERBOSE: Tactic: 256 time 0.021824 [TensorRT] VERBOSE: Tactic: 512 time 0.0232 [TensorRT] VERBOSE: Tactic: -32 time 0.026848 [TensorRT] VERBOSE: Tactic: -64 time 0.029984 [TensorRT] VERBOSE: Tactic: -128 time 0.031168 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009408 [TensorRT] VERBOSE: Tactic: 1 time 0.008064 [TensorRT] VERBOSE: Tactic: 2 time 0.008288 [TensorRT] VERBOSE: Tactic: 3 time 0.007616 [TensorRT] VERBOSE: Tactic: 4 time 0.008096 [TensorRT] VERBOSE: Tactic: 5 time 0.007168 [TensorRT] VERBOSE: Tactic: 6 time 0.007456 [TensorRT] VERBOSE: Tactic: 7 time 0.008128 [TensorRT] VERBOSE: Tactic: 8 time 0.008064 [TensorRT] VERBOSE: Tactic: 9 time 0.010208 [TensorRT] VERBOSE: Tactic: 10 time 0.01248 [TensorRT] VERBOSE: Tactic: 11 time 0.011328 [TensorRT] VERBOSE: Tactic: 12 time 0.00976 [TensorRT] VERBOSE: Tactic: 13 time 0.009696 [TensorRT] VERBOSE: Tactic: 14 time 0.009472 [TensorRT] VERBOSE: Tactic: 15 time 0.00864 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.00944 [TensorRT] VERBOSE: Tactic: 18 time 0.009568 [TensorRT] VERBOSE: Tactic: 19 time 0.008672 [TensorRT] VERBOSE: Tactic: 20 time 0.019008 [TensorRT] VERBOSE: Tactic: 21 time 0.015328 [TensorRT] VERBOSE: Tactic: 22 time 0.012352 [TensorRT] VERBOSE: Tactic: 23 time 0.010848 [TensorRT] VERBOSE: Tactic: 28 time 0.0112 [TensorRT] VERBOSE: Tactic: 29 time 0.012832 [TensorRT] VERBOSE: Tactic: 30 time 0.018432 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.007168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023552 [TensorRT] VERBOSE: Tactic: 256 time 0.020832 [TensorRT] VERBOSE: Tactic: 512 time 0.021792 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.020832 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007872 [TensorRT] VERBOSE: Tactic: 11 time 0.008128 [TensorRT] VERBOSE: Tactic: 12 time 0.008032 [TensorRT] VERBOSE: Tactic: 13 time 0.010784 [TensorRT] VERBOSE: Tactic: 14 time 0.009536 [TensorRT] VERBOSE: Tactic: 15 time 0.01024 [TensorRT] VERBOSE: Tactic: 16 time 0.013728 [TensorRT] VERBOSE: Tactic: 17 time 0.013984 [TensorRT] VERBOSE: Tactic: 18 time 0.014368 [TensorRT] VERBOSE: Tactic: 19 time 0.015296 [TensorRT] VERBOSE: Tactic: 20 time 0.007168 [TensorRT] VERBOSE: Tactic: 21 time 0.00784 [TensorRT] VERBOSE: Tactic: 22 time 0.007744 [TensorRT] VERBOSE: Tactic: 23 time 0.010752 [TensorRT] VERBOSE: Tactic: 24 time 0.009344 [TensorRT] VERBOSE: Tactic: 25 time 0.00784 [TensorRT] VERBOSE: Tactic: 26 time 0.007872 [TensorRT] VERBOSE: Tactic: 27 time 0.009248 [TensorRT] VERBOSE: Tactic: 29 time 0.027328 [TensorRT] VERBOSE: Tactic: 30 time 0.01584 [TensorRT] VERBOSE: Tactic: 31 time 0.011296 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.007168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.720704 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.720704 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.93408 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.97744 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.93392 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.944928 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.96304 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 1.00752 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 1.08544 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 1.2841 [TensorRT] VERBOSE: Fastest Tactic: 3915320020053085238 Time: 0.93392 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.795168 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 903168, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 2288386048, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 38351360, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.795168 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.242304 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.366016 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.31872 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.261376 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.362592 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.335264 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.25344 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.250688 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.242528 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.242688 [TensorRT] VERBOSE: Fastest Tactic: 892787096507693407 Time: 0.242304 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 892787096507693407 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.307616 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.307616 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.25696 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.247648 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.273792 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.243008 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.330784 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.238496 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.308096 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.240512 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.355168 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.247808 [TensorRT] VERBOSE: Fastest Tactic: -7210942453088153035 Time: 0.238496 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7210942453088153035 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.359008 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.322368 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.245632 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.309888 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.247776 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.353024 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.234432 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.256448 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.239456 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.239872 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.234432 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.182272 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.182272 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.100384 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.136864 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.130368 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.12544 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.124672 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.109504 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.143328 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.129152 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.1344 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.121536 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.12496 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.087232 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.087232 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016384 [TensorRT] VERBOSE: Tactic: 0 time 0.024736 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016384 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018656 [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018688 [TensorRT] VERBOSE: Tactic: 0 time 0.018912 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.018688 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0504 [TensorRT] VERBOSE: Tactic: 0 time 0.010112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010112 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.019456 [TensorRT] VERBOSE: Tactic: 0 time 0.01248 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01248 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018432 [TensorRT] VERBOSE: Tactic: 0 time 0.020416 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.018432 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01792 [TensorRT] VERBOSE: Tactic: 0 time 0.006368 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006368 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.019008 [TensorRT] VERBOSE: Tactic: 0 time 0.024608 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.019008 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.019296 [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017536 [TensorRT] VERBOSE: Tactic: 0 time 0.009632 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009632 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018976 [TensorRT] VERBOSE: Tactic: 0 time 0.025376 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.018976 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01888 [TensorRT] VERBOSE: Tactic: 0 time 0.009152 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009152 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 256 time 0.011264 [TensorRT] VERBOSE: Tactic: 512 time 0.011456 [TensorRT] VERBOSE: Tactic: -32 time 0.027136 [TensorRT] VERBOSE: Tactic: -64 time 0.017344 [TensorRT] VERBOSE: Tactic: -128 time 0.014368 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006272 [TensorRT] VERBOSE: Tactic: 1 time 0.006432 [TensorRT] VERBOSE: Tactic: 2 time 0.006752 [TensorRT] VERBOSE: Tactic: 3 time 0.006752 [TensorRT] VERBOSE: Tactic: 4 time 0.006336 [TensorRT] VERBOSE: Tactic: 5 time 0.006816 [TensorRT] VERBOSE: Tactic: 6 time 0.006528 [TensorRT] VERBOSE: Tactic: 7 time 0.006464 [TensorRT] VERBOSE: Tactic: 8 time 0.006176 [TensorRT] VERBOSE: Tactic: 9 time 0.006752 [TensorRT] VERBOSE: Tactic: 28 time 0.006368 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.006176 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011072 [TensorRT] VERBOSE: Tactic: 256 time 0.011264 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.027264 [TensorRT] VERBOSE: Tactic: -64 time 0.01776 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009952 [TensorRT] VERBOSE: Tactic: 25 time 0.008896 [TensorRT] VERBOSE: Tactic: 26 time 0.008384 [TensorRT] VERBOSE: Tactic: 27 time 0.008192 [TensorRT] VERBOSE: Tactic: 31 time 0.009664 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.008192 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013984 [TensorRT] VERBOSE: Tactic: 256 time 0.01408 [TensorRT] VERBOSE: Tactic: 512 time 0.014144 [TensorRT] VERBOSE: Tactic: -32 time 0.018976 [TensorRT] VERBOSE: Tactic: -64 time 0.020416 [TensorRT] VERBOSE: Tactic: -128 time 0.02048 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013984 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007744 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.007616 [TensorRT] VERBOSE: Tactic: 4 time 0.006304 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.009408 [TensorRT] VERBOSE: Tactic: 7 time 0.007424 [TensorRT] VERBOSE: Tactic: 8 time 0.007872 [TensorRT] VERBOSE: Tactic: 9 time 0.006272 [TensorRT] VERBOSE: Tactic: 10 time 0.00928 [TensorRT] VERBOSE: Tactic: 11 time 0.008 [TensorRT] VERBOSE: Tactic: 12 time 0.007648 [TensorRT] VERBOSE: Tactic: 13 time 0.007552 [TensorRT] VERBOSE: Tactic: 14 time 0.007424 [TensorRT] VERBOSE: Tactic: 15 time 0.006976 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.007808 [TensorRT] VERBOSE: Tactic: 18 time 0.007488 [TensorRT] VERBOSE: Tactic: 19 time 0.00784 [TensorRT] VERBOSE: Tactic: 20 time 0.012544 [TensorRT] VERBOSE: Tactic: 21 time 0.010912 [TensorRT] VERBOSE: Tactic: 22 time 0.009216 [TensorRT] VERBOSE: Tactic: 23 time 0.007456 [TensorRT] VERBOSE: Tactic: 28 time 0.00768 [TensorRT] VERBOSE: Tactic: 29 time 0.009472 [TensorRT] VERBOSE: Tactic: 30 time 0.01072 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01408 [TensorRT] VERBOSE: Tactic: 256 time 0.014112 [TensorRT] VERBOSE: Tactic: 512 time 0.014144 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01408 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006112 [TensorRT] VERBOSE: Tactic: 11 time 0.007648 [TensorRT] VERBOSE: Tactic: 12 time 0.007392 [TensorRT] VERBOSE: Tactic: 13 time 0.009184 [TensorRT] VERBOSE: Tactic: 14 time 0.009312 [TensorRT] VERBOSE: Tactic: 15 time 0.011008 [TensorRT] VERBOSE: Tactic: 16 time 0.012768 [TensorRT] VERBOSE: Tactic: 17 time 0.010656 [TensorRT] VERBOSE: Tactic: 18 time 0.010688 [TensorRT] VERBOSE: Tactic: 19 time 0.012288 [TensorRT] VERBOSE: Tactic: 20 time 0.006272 [TensorRT] VERBOSE: Tactic: 21 time 0.006144 [TensorRT] VERBOSE: Tactic: 22 time 0.007552 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 24 time 0.006048 [TensorRT] VERBOSE: Tactic: 25 time 0.006016 [TensorRT] VERBOSE: Tactic: 26 time 0.006016 [TensorRT] VERBOSE: Tactic: 27 time 0.007872 [TensorRT] VERBOSE: Tactic: 29 time 0.016192 [TensorRT] VERBOSE: Tactic: 30 time 0.010624 [TensorRT] VERBOSE: Tactic: 31 time 0.007648 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.606816 [TensorRT] VERBOSE: Tactic: 655359 time 0.389952 [TensorRT] VERBOSE: Tactic: 786431 time 0.284672 [TensorRT] VERBOSE: Tactic: 851967 time 0.22864 [TensorRT] VERBOSE: Tactic: 1179647 time 0.220064 [TensorRT] VERBOSE: Tactic: 1310719 time 0.395104 [TensorRT] VERBOSE: Tactic: 1376255 time 0.394304 [TensorRT] VERBOSE: Tactic: 1441791 time 0.374176 [TensorRT] VERBOSE: Tactic: 1507327 time 0.219872 [TensorRT] VERBOSE: Tactic: 1638399 time 0.286944 [TensorRT] VERBOSE: Tactic: 1835007 time 0.275616 [TensorRT] VERBOSE: Tactic: 1900543 time 0.408128 [TensorRT] VERBOSE: Tactic: 2097151 time 0.175072 [TensorRT] VERBOSE: Tactic: 2162687 time 0.404672 [TensorRT] VERBOSE: Tactic: 2293759 time 0.382656 [TensorRT] VERBOSE: Tactic: 2359295 time 0.253312 [TensorRT] VERBOSE: Tactic: 2686975 time 0.386464 [TensorRT] VERBOSE: Tactic: 3080191 time 0.205088 [TensorRT] VERBOSE: Tactic: 3342335 time 0.409536 [TensorRT] VERBOSE: Tactic: 3407871 time 0.213856 [TensorRT] VERBOSE: Tactic: 3538943 time 0.217792 [TensorRT] VERBOSE: Tactic: 3670015 time 0.749024 [TensorRT] VERBOSE: Tactic: 3932159 time 0.347584 [TensorRT] VERBOSE: Tactic: 3997695 time 0.294912 [TensorRT] VERBOSE: Tactic: 4063231 time 0.229376 [TensorRT] VERBOSE: Tactic: 4194303 time 0.156864 [TensorRT] VERBOSE: Tactic: 4259839 time 0.185216 [TensorRT] VERBOSE: Tactic: 4325375 time 0.248128 [TensorRT] VERBOSE: Tactic: 4521983 time 0.362656 [TensorRT] VERBOSE: Tactic: 4587519 time 0.207712 [TensorRT] VERBOSE: Tactic: 4653055 time 0.193856 [TensorRT] VERBOSE: Tactic: 4915199 time 0.166016 [TensorRT] VERBOSE: Tactic: 4980735 time 0.226976 [TensorRT] VERBOSE: Tactic: 5177343 time 0.224224 [TensorRT] VERBOSE: Tactic: 5242879 time 0.201728 [TensorRT] VERBOSE: Tactic: 5373951 time 0.225664 [TensorRT] VERBOSE: Tactic: 5439487 time 0.255136 [TensorRT] VERBOSE: Tactic: 5570559 time 0.217568 [TensorRT] VERBOSE: Tactic: 5636095 time 0.230144 [TensorRT] VERBOSE: Tactic: 5701631 time 0.375808 [TensorRT] VERBOSE: Tactic: 5767167 time 0.244416 [TensorRT] VERBOSE: Tactic: 5832703 time 0.216416 [TensorRT] VERBOSE: Tactic: 5898239 time 0.15712 [TensorRT] VERBOSE: Tactic: 6029311 time 0.36896 [TensorRT] VERBOSE: Tactic: 6225919 time 0.218176 [TensorRT] VERBOSE: Tactic: 6291455 time 0.217632 [TensorRT] VERBOSE: Tactic: 6422527 time 0.196608 [TensorRT] VERBOSE: Tactic: 6750207 time 0.242752 [TensorRT] VERBOSE: Tactic: 6815743 time 0.204512 [TensorRT] VERBOSE: Tactic: 6946815 time 0.204832 [TensorRT] VERBOSE: Tactic: 7012351 time 0.178144 [TensorRT] VERBOSE: Tactic: 7077887 time 0.233664 [TensorRT] VERBOSE: Tactic: 7143423 time 0.242912 [TensorRT] VERBOSE: Tactic: 7208959 time 0.217568 [TensorRT] VERBOSE: Tactic: 7340031 time 0.165312 [TensorRT] VERBOSE: Tactic: 7405567 time 0.210656 [TensorRT] VERBOSE: Tactic: 7536639 time 0.329216 [TensorRT] VERBOSE: Tactic: 7602175 time 0.198048 [TensorRT] VERBOSE: Tactic: 7733247 time 0.149984 [TensorRT] VERBOSE: Tactic: 7798783 time 0.288032 [TensorRT] VERBOSE: Tactic: 8191999 time 0.41152 [TensorRT] VERBOSE: Tactic: 8257535 time 0.17424 [TensorRT] VERBOSE: Tactic: 8323071 time 0.249856 [TensorRT] VERBOSE: Tactic: 8650751 time 0.198976 [TensorRT] VERBOSE: Tactic: 8716287 time 0.229856 [TensorRT] VERBOSE: Tactic: 9109503 time 0.178368 [TensorRT] VERBOSE: Tactic: 9568255 time 0.166528 [TensorRT] VERBOSE: Tactic: 9895935 time 0.154016 [TensorRT] VERBOSE: Tactic: 10223615 time 0.386624 [TensorRT] VERBOSE: Tactic: 10354687 time 0.20224 [TensorRT] VERBOSE: Tactic: 10551295 time 0.218976 [TensorRT] VERBOSE: Tactic: 10747903 time 0.14768 [TensorRT] VERBOSE: Tactic: 10944511 time 0.22816 [TensorRT] VERBOSE: Fastest Tactic: 10747903 Time: 0.14768 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.213088 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.215904 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.270496 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.216288 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.221952 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.21488 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.23008 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.24528 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.28352 [TensorRT] VERBOSE: Fastest Tactic: 1754569683116234317 Time: 0.213088 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.184512 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 200704, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 144556032, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 4596224, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.184512 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10747903 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.064448 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.093056 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.079232 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.067968 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.089888 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.082496 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.06752 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.064736 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.087776 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.063936 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.074688 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.062496 [TensorRT] VERBOSE: Fastest Tactic: -1765942417666394360 Time: 0.062496 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1765942417666394360 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.167616 [TensorRT] VERBOSE: Tactic: 655359 time 0.107104 [TensorRT] VERBOSE: Tactic: 786431 time 0.077664 [TensorRT] VERBOSE: Tactic: 851967 time 0.067776 [TensorRT] VERBOSE: Tactic: 1179647 time 0.07232 [TensorRT] VERBOSE: Tactic: 1310719 time 0.104064 [TensorRT] VERBOSE: Tactic: 1376255 time 0.130624 [TensorRT] VERBOSE: Tactic: 1441791 time 0.092192 [TensorRT] VERBOSE: Tactic: 1507327 time 0.063616 [TensorRT] VERBOSE: Tactic: 1638399 time 0.083488 [TensorRT] VERBOSE: Tactic: 1835007 time 0.070688 [TensorRT] VERBOSE: Tactic: 1900543 time 0.110848 [TensorRT] VERBOSE: Tactic: 2097151 time 0.052832 [TensorRT] VERBOSE: Tactic: 2162687 time 0.225856 [TensorRT] VERBOSE: Tactic: 2293759 time 0.124544 [TensorRT] VERBOSE: Tactic: 2359295 time 0.145056 [TensorRT] VERBOSE: Tactic: 2686975 time 0.191168 [TensorRT] VERBOSE: Tactic: 3080191 time 0.058912 [TensorRT] VERBOSE: Tactic: 3342335 time 0.115808 [TensorRT] VERBOSE: Tactic: 3407871 time 0.074976 [TensorRT] VERBOSE: Tactic: 3538943 time 0.06896 [TensorRT] VERBOSE: Tactic: 3670015 time 0.196032 [TensorRT] VERBOSE: Tactic: 3932159 time 0.093632 [TensorRT] VERBOSE: Tactic: 3997695 time 0.075744 [TensorRT] VERBOSE: Tactic: 4063231 time 0.063872 [TensorRT] VERBOSE: Tactic: 4194303 time 0.05664 [TensorRT] VERBOSE: Tactic: 4259839 time 0.065024 [TensorRT] VERBOSE: Tactic: 4325375 time 0.14736 [TensorRT] VERBOSE: Tactic: 4521983 time 0.150144 [TensorRT] VERBOSE: Tactic: 4587519 time 0.065184 [TensorRT] VERBOSE: Tactic: 4653055 time 0.077824 [TensorRT] VERBOSE: Tactic: 4915199 time 0.044736 [TensorRT] VERBOSE: Tactic: 4980735 time 0.163584 [TensorRT] VERBOSE: Tactic: 5177343 time 0.072352 [TensorRT] VERBOSE: Tactic: 5242879 time 0.070656 [TensorRT] VERBOSE: Tactic: 5373951 time 0.0712 [TensorRT] VERBOSE: Tactic: 5439487 time 0.06608 [TensorRT] VERBOSE: Tactic: 5570559 time 0.06128 [TensorRT] VERBOSE: Tactic: 5636095 time 0.06576 [TensorRT] VERBOSE: Tactic: 5701631 time 0.121952 [TensorRT] VERBOSE: Tactic: 5767167 time 0.076224 [TensorRT] VERBOSE: Tactic: 5832703 time 0.073088 [TensorRT] VERBOSE: Tactic: 5898239 time 0.058944 [TensorRT] VERBOSE: Tactic: 6029311 time 0.11232 [TensorRT] VERBOSE: Tactic: 6225919 time 0.058432 [TensorRT] VERBOSE: Tactic: 6291455 time 0.07168 [TensorRT] VERBOSE: Tactic: 6422527 time 0.056416 [TensorRT] VERBOSE: Tactic: 6750207 time 0.077568 [TensorRT] VERBOSE: Tactic: 6815743 time 0.075776 [TensorRT] VERBOSE: Tactic: 6946815 time 0.067712 [TensorRT] VERBOSE: Tactic: 7012351 time 0.053504 [TensorRT] VERBOSE: Tactic: 7077887 time 0.068256 [TensorRT] VERBOSE: Tactic: 7143423 time 0.083264 [TensorRT] VERBOSE: Tactic: 7208959 time 0.074528 [TensorRT] VERBOSE: Tactic: 7340031 time 0.060416 [TensorRT] VERBOSE: Tactic: 7405567 time 0.060768 [TensorRT] VERBOSE: Tactic: 7536639 time 0.100928 [TensorRT] VERBOSE: Tactic: 7602175 time 0.066272 [TensorRT] VERBOSE: Tactic: 7733247 time 0.055968 [TensorRT] VERBOSE: Tactic: 7798783 time 0.07808 [TensorRT] VERBOSE: Tactic: 8191999 time 0.097376 [TensorRT] VERBOSE: Tactic: 8257535 time 0.05984 [TensorRT] VERBOSE: Tactic: 8323071 time 0.063136 [TensorRT] VERBOSE: Tactic: 8650751 time 0.069952 [TensorRT] VERBOSE: Tactic: 8716287 time 0.061984 [TensorRT] VERBOSE: Tactic: 9109503 time 0.065792 [TensorRT] VERBOSE: Tactic: 9568255 time 0.046688 [TensorRT] VERBOSE: Tactic: 9895935 time 0.056512 [TensorRT] VERBOSE: Tactic: 10223615 time 0.190976 [TensorRT] VERBOSE: Tactic: 10354687 time 0.111392 [TensorRT] VERBOSE: Tactic: 10551295 time 0.06608 [TensorRT] VERBOSE: Tactic: 10747903 time 0.053536 [TensorRT] VERBOSE: Tactic: 10944511 time 0.159072 [TensorRT] VERBOSE: Fastest Tactic: 4915199 Time: 0.044736 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.061952 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.062016 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.063776 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.063904 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.0912 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.060064 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.078208 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.071104 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.060704 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.075424 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.088576 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.088096 [TensorRT] VERBOSE: Fastest Tactic: 6797040896965118050 Time: 0.060064 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4915199 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.059232 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.089696 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.0768 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.061408 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.07392 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.065088 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.085888 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.089472 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.059136 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.071136 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.062688 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.06192 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.059136 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.146912 [TensorRT] VERBOSE: Tactic: 655359 time 0.101952 [TensorRT] VERBOSE: Tactic: 786431 time 0.08928 [TensorRT] VERBOSE: Tactic: 851967 time 0.065184 [TensorRT] VERBOSE: Tactic: 1179647 time 0.07168 [TensorRT] VERBOSE: Tactic: 1310719 time 0.091904 [TensorRT] VERBOSE: Tactic: 1376255 time 0.161664 [TensorRT] VERBOSE: Tactic: 1441791 time 0.087136 [TensorRT] VERBOSE: Tactic: 1507327 time 0.062368 [TensorRT] VERBOSE: Tactic: 1638399 time 0.087776 [TensorRT] VERBOSE: Tactic: 1835007 time 0.07296 [TensorRT] VERBOSE: Tactic: 1900543 time 0.107232 [TensorRT] VERBOSE: Tactic: 2097151 time 0.062528 [TensorRT] VERBOSE: Tactic: 2162687 time 0.188896 [TensorRT] VERBOSE: Tactic: 2293759 time 0.140192 [TensorRT] VERBOSE: Tactic: 2359295 time 0.120544 [TensorRT] VERBOSE: Tactic: 2686975 time 0.155872 [TensorRT] VERBOSE: Tactic: 3080191 time 0.056544 [TensorRT] VERBOSE: Tactic: 3342335 time 0.110528 [TensorRT] VERBOSE: Tactic: 3407871 time 0.084512 [TensorRT] VERBOSE: Tactic: 3538943 time 0.08064 [TensorRT] VERBOSE: Tactic: 3670015 time 0.19232 [TensorRT] VERBOSE: Tactic: 3932159 time 0.089088 [TensorRT] VERBOSE: Tactic: 3997695 time 0.08432 [TensorRT] VERBOSE: Tactic: 4063231 time 0.065216 [TensorRT] VERBOSE: Tactic: 4194303 time 0.058016 [TensorRT] VERBOSE: Tactic: 4259839 time 0.06656 [TensorRT] VERBOSE: Tactic: 4325375 time 0.155584 [TensorRT] VERBOSE: Tactic: 4521983 time 0.155712 [TensorRT] VERBOSE: Tactic: 4587519 time 0.07264 [TensorRT] VERBOSE: Tactic: 4653055 time 0.082592 [TensorRT] VERBOSE: Tactic: 4915199 time 0.062304 [TensorRT] VERBOSE: Tactic: 4980735 time 0.170752 [TensorRT] VERBOSE: Tactic: 5177343 time 0.074464 [TensorRT] VERBOSE: Tactic: 5242879 time 0.079776 [TensorRT] VERBOSE: Tactic: 5373951 time 0.07168 [TensorRT] VERBOSE: Tactic: 5439487 time 0.069088 [TensorRT] VERBOSE: Tactic: 5570559 time 0.057152 [TensorRT] VERBOSE: Tactic: 5636095 time 0.062336 [TensorRT] VERBOSE: Tactic: 5701631 time 0.116064 [TensorRT] VERBOSE: Tactic: 5767167 time 0.086592 [TensorRT] VERBOSE: Tactic: 5832703 time 0.08704 [TensorRT] VERBOSE: Tactic: 5898239 time 0.068608 [TensorRT] VERBOSE: Tactic: 6029311 time 0.106944 [TensorRT] VERBOSE: Tactic: 6225919 time 0.066528 [TensorRT] VERBOSE: Tactic: 6291455 time 0.07184 [TensorRT] VERBOSE: Tactic: 6422527 time 0.052352 [TensorRT] VERBOSE: Tactic: 6750207 time 0.084704 [TensorRT] VERBOSE: Tactic: 6815743 time 0.080672 [TensorRT] VERBOSE: Tactic: 6946815 time 0.065728 [TensorRT] VERBOSE: Tactic: 7012351 time 0.061952 [TensorRT] VERBOSE: Tactic: 7077887 time 0.069728 [TensorRT] VERBOSE: Tactic: 7143423 time 0.09264 [TensorRT] VERBOSE: Tactic: 7208959 time 0.08688 [TensorRT] VERBOSE: Tactic: 7340031 time 0.067968 [TensorRT] VERBOSE: Tactic: 7405567 time 0.05808 [TensorRT] VERBOSE: Tactic: 7536639 time 0.095232 [TensorRT] VERBOSE: Tactic: 7602175 time 0.072704 [TensorRT] VERBOSE: Tactic: 7733247 time 0.063904 [TensorRT] VERBOSE: Tactic: 7798783 time 0.08736 [TensorRT] VERBOSE: Tactic: 8191999 time 0.110592 [TensorRT] VERBOSE: Tactic: 8257535 time 0.0512 [TensorRT] VERBOSE: Tactic: 8323071 time 0.06896 [TensorRT] VERBOSE: Tactic: 8650751 time 0.074208 [TensorRT] VERBOSE: Tactic: 8716287 time 0.063776 [TensorRT] VERBOSE: Tactic: 9109503 time 0.056608 [TensorRT] VERBOSE: Tactic: 9568255 time 0.061536 [TensorRT] VERBOSE: Tactic: 9895935 time 0.05872 [TensorRT] VERBOSE: Tactic: 10223615 time 0.156672 [TensorRT] VERBOSE: Tactic: 10354687 time 0.112896 [TensorRT] VERBOSE: Tactic: 10551295 time 0.066592 [TensorRT] VERBOSE: Tactic: 10747903 time 0.061792 [TensorRT] VERBOSE: Tactic: 10944511 time 0.171104 [TensorRT] VERBOSE: Fastest Tactic: 8257535 Time: 0.0512 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.029696 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.037824 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.030848 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.037728 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.038176 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.035776 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.0384 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.035872 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.035904 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.036288 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.03632 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.028096 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.028096 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011168 [TensorRT] VERBOSE: Tactic: 256 time 0.01152 [TensorRT] VERBOSE: Tactic: 512 time 0.011552 [TensorRT] VERBOSE: Tactic: -32 time 0.027648 [TensorRT] VERBOSE: Tactic: -64 time 0.01744 [TensorRT] VERBOSE: Tactic: -128 time 0.014624 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011168 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006688 [TensorRT] VERBOSE: Tactic: 1 time 0.006656 [TensorRT] VERBOSE: Tactic: 2 time 0.006528 [TensorRT] VERBOSE: Tactic: 3 time 0.00656 [TensorRT] VERBOSE: Tactic: 4 time 0.006496 [TensorRT] VERBOSE: Tactic: 5 time 0.006624 [TensorRT] VERBOSE: Tactic: 6 time 0.006592 [TensorRT] VERBOSE: Tactic: 7 time 0.00672 [TensorRT] VERBOSE: Tactic: 8 time 0.00656 [TensorRT] VERBOSE: Tactic: 9 time 0.006528 [TensorRT] VERBOSE: Tactic: 28 time 0.00624 [TensorRT] VERBOSE: Fastest Tactic: 28 Time: 0.00624 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 256 time 0.011456 [TensorRT] VERBOSE: Tactic: 512 time 0.011488 [TensorRT] VERBOSE: Tactic: -32 time 0.027456 [TensorRT] VERBOSE: Tactic: -64 time 0.017664 [TensorRT] VERBOSE: Tactic: -128 time 0.014272 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.008928 [TensorRT] VERBOSE: Tactic: 25 time 0.008768 [TensorRT] VERBOSE: Tactic: 26 time 0.008192 [TensorRT] VERBOSE: Tactic: 27 time 0.008192 [TensorRT] VERBOSE: Tactic: 31 time 0.010144 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.008192 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] WARNING: No implementation of layer LeakyRelu_188 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016288 [TensorRT] VERBOSE: Tactic: 0 time 0.024 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016288 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049248 [TensorRT] VERBOSE: Tactic: 0 time 0.010048 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010048 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006144 [TensorRT] VERBOSE: Tactic: 0 time 0.004512 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004512 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011072 [TensorRT] VERBOSE: Tactic: 0 time 0.0144 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011072 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0128 [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011904 [TensorRT] VERBOSE: Tactic: 0 time 0.012608 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011904 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027168 [TensorRT] VERBOSE: Tactic: 0 time 0.007776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007776 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010976 [TensorRT] VERBOSE: Tactic: 0 time 0.00448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00448 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012288 [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012416 [TensorRT] VERBOSE: Tactic: 0 time 0.0128 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012416 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011808 [TensorRT] VERBOSE: Tactic: 0 time 0.004576 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004576 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012512 [TensorRT] VERBOSE: Tactic: 0 time 0.012544 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012512 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02832 [TensorRT] VERBOSE: Tactic: 0 time 0.006976 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006976 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012448 [TensorRT] VERBOSE: Tactic: 0 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007552 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011424 [TensorRT] VERBOSE: Tactic: 0 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011424 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010944 [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012288 [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006016 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011104 [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012384 [TensorRT] VERBOSE: Tactic: 0 time 0.007168 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007168 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.299616 [TensorRT] VERBOSE: Tactic: 655359 time 0.199872 [TensorRT] VERBOSE: Tactic: 786431 time 0.081408 [TensorRT] VERBOSE: Tactic: 851967 time 0.065088 [TensorRT] VERBOSE: Tactic: 1179647 time 0.06848 [TensorRT] VERBOSE: Tactic: 1310719 time 0.169248 [TensorRT] VERBOSE: Tactic: 1376255 time 0.201696 [TensorRT] VERBOSE: Tactic: 1441791 time 0.107872 [TensorRT] VERBOSE: Tactic: 1507327 time 0.112032 [TensorRT] VERBOSE: Tactic: 1638399 time 0.09472 [TensorRT] VERBOSE: Tactic: 1835007 time 0.070112 [TensorRT] VERBOSE: Tactic: 1900543 time 0.208704 [TensorRT] VERBOSE: Tactic: 2097151 time 0.053408 [TensorRT] VERBOSE: Tactic: 2162687 time 0.1976 [TensorRT] VERBOSE: Tactic: 2293759 time 0.189376 [TensorRT] VERBOSE: Tactic: 2359295 time 0.112064 [TensorRT] VERBOSE: Tactic: 2686975 time 0.1888 [TensorRT] VERBOSE: Tactic: 3080191 time 0.104384 [TensorRT] VERBOSE: Tactic: 3342335 time 0.112992 [TensorRT] VERBOSE: Tactic: 3407871 time 0.104288 [TensorRT] VERBOSE: Tactic: 3538943 time 0.062112 [TensorRT] VERBOSE: Tactic: 3670015 time 0.377728 [TensorRT] VERBOSE: Tactic: 3932159 time 0.174848 [TensorRT] VERBOSE: Tactic: 3997695 time 0.078144 [TensorRT] VERBOSE: Tactic: 4063231 time 0.06544 [TensorRT] VERBOSE: Tactic: 4194303 time 0.07232 [TensorRT] VERBOSE: Tactic: 4259839 time 0.058944 [TensorRT] VERBOSE: Tactic: 4325375 time 0.065056 [TensorRT] VERBOSE: Tactic: 4521983 time 0.177312 [TensorRT] VERBOSE: Tactic: 4587519 time 0.058816 [TensorRT] VERBOSE: Tactic: 4653055 time 0.060192 [TensorRT] VERBOSE: Tactic: 4915199 time 0.047392 [TensorRT] VERBOSE: Tactic: 4980735 time 0.102304 [TensorRT] VERBOSE: Tactic: 5177343 time 0.068224 [TensorRT] VERBOSE: Tactic: 5242879 time 0.10032 [TensorRT] VERBOSE: Tactic: 5373951 time 0.068352 [TensorRT] VERBOSE: Tactic: 5439487 time 0.071808 [TensorRT] VERBOSE: Tactic: 5570559 time 0.110752 [TensorRT] VERBOSE: Tactic: 5636095 time 0.06448 [TensorRT] VERBOSE: Tactic: 5701631 time 0.183104 [TensorRT] VERBOSE: Tactic: 5767167 time 0.102784 [TensorRT] VERBOSE: Tactic: 5832703 time 0.105344 [TensorRT] VERBOSE: Tactic: 5898239 time 0.046368 [TensorRT] VERBOSE: Tactic: 6029311 time 0.178912 [TensorRT] VERBOSE: Tactic: 6225919 time 0.05984 [TensorRT] VERBOSE: Tactic: 6291455 time 0.067232 [TensorRT] VERBOSE: Tactic: 6422527 time 0.099808 [TensorRT] VERBOSE: Tactic: 6750207 time 0.072384 [TensorRT] VERBOSE: Tactic: 6815743 time 0.10224 [TensorRT] VERBOSE: Tactic: 6946815 time 0.06688 [TensorRT] VERBOSE: Tactic: 7012351 time 0.053248 [TensorRT] VERBOSE: Tactic: 7077887 time 0.0632 [TensorRT] VERBOSE: Tactic: 7143423 time 0.101376 [TensorRT] VERBOSE: Tactic: 7208959 time 0.10688 [TensorRT] VERBOSE: Tactic: 7340031 time 0.047552 [TensorRT] VERBOSE: Tactic: 7405567 time 0.058112 [TensorRT] VERBOSE: Tactic: 7536639 time 0.165248 [TensorRT] VERBOSE: Tactic: 7602175 time 0.067072 [TensorRT] VERBOSE: Tactic: 7733247 time 0.065792 [TensorRT] VERBOSE: Tactic: 7798783 time 0.079104 [TensorRT] VERBOSE: Tactic: 8191999 time 0.069664 [TensorRT] VERBOSE: Tactic: 8257535 time 0.048736 [TensorRT] VERBOSE: Tactic: 8323071 time 0.072832 [TensorRT] VERBOSE: Tactic: 8650751 time 0.06944 [TensorRT] VERBOSE: Tactic: 8716287 time 0.062496 [TensorRT] VERBOSE: Tactic: 9109503 time 0.054656 [TensorRT] VERBOSE: Tactic: 9568255 time 0.048576 [TensorRT] VERBOSE: Tactic: 9895935 time 0.072416 [TensorRT] VERBOSE: Tactic: 10223615 time 0.18944 [TensorRT] VERBOSE: Tactic: 10354687 time 0.06784 [TensorRT] VERBOSE: Tactic: 10551295 time 0.105984 [TensorRT] VERBOSE: Tactic: 10747903 time 0.065152 [TensorRT] VERBOSE: Tactic: 10944511 time 0.101664 [TensorRT] VERBOSE: Fastest Tactic: 5898239 Time: 0.046368 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.109568 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.113536 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.126976 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.110592 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.07904 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.076096 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.085344 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.116064 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.138016 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.076096 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.068032 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 100352, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 36626432, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.09008 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.068032 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5898239 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.034816 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.03648 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.036736 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.02544 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.036288 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.0376 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.02384 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.024032 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.035264 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.034784 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.034816 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.035616 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.02384 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.039552 [TensorRT] VERBOSE: Tactic: 655359 time 0.036768 [TensorRT] VERBOSE: Tactic: 786431 time 0.023776 [TensorRT] VERBOSE: Tactic: 851967 time 0.018752 [TensorRT] VERBOSE: Tactic: 1179647 time 0.020544 [TensorRT] VERBOSE: Tactic: 1310719 time 0.029984 [TensorRT] VERBOSE: Tactic: 1376255 time 0.044224 [TensorRT] VERBOSE: Tactic: 1441791 time 0.0256 [TensorRT] VERBOSE: Tactic: 1507327 time 0.023072 [TensorRT] VERBOSE: Tactic: 1638399 time 0.023328 [TensorRT] VERBOSE: Tactic: 1835007 time 0.023552 [TensorRT] VERBOSE: Tactic: 1900543 time 0.039488 [TensorRT] VERBOSE: Tactic: 2097151 time 0.016224 [TensorRT] VERBOSE: Tactic: 2162687 time 0.066656 [TensorRT] VERBOSE: Tactic: 2293759 time 0.038912 [TensorRT] VERBOSE: Tactic: 2359295 time 0.051008 [TensorRT] VERBOSE: Tactic: 2686975 time 0.048416 [TensorRT] VERBOSE: Tactic: 3080191 time 0.018432 [TensorRT] VERBOSE: Tactic: 3342335 time 0.02192 [TensorRT] VERBOSE: Tactic: 3407871 time 0.026656 [TensorRT] VERBOSE: Tactic: 3538943 time 0.02208 [TensorRT] VERBOSE: Tactic: 3670015 time 0.0528 [TensorRT] VERBOSE: Tactic: 3932159 time 0.024928 [TensorRT] VERBOSE: Tactic: 3997695 time 0.022432 [TensorRT] VERBOSE: Tactic: 4063231 time 0.018848 [TensorRT] VERBOSE: Tactic: 4194303 time 0.019072 [TensorRT] VERBOSE: Tactic: 4259839 time 0.018752 [TensorRT] VERBOSE: Tactic: 4325375 time 0.041472 [TensorRT] VERBOSE: Tactic: 4521983 time 0.050624 [TensorRT] VERBOSE: Tactic: 4587519 time 0.018752 [TensorRT] VERBOSE: Tactic: 4653055 time 0.02384 [TensorRT] VERBOSE: Tactic: 4915199 time 0.015808 [TensorRT] VERBOSE: Tactic: 4980735 time 0.049408 [TensorRT] VERBOSE: Tactic: 5177343 time 0.020384 [TensorRT] VERBOSE: Tactic: 5242879 time 0.02528 [TensorRT] VERBOSE: Tactic: 5373951 time 0.020768 [TensorRT] VERBOSE: Tactic: 5439487 time 0.022144 [TensorRT] VERBOSE: Tactic: 5570559 time 0.018784 [TensorRT] VERBOSE: Tactic: 5636095 time 0.01872 [TensorRT] VERBOSE: Tactic: 5701631 time 0.036128 [TensorRT] VERBOSE: Tactic: 5767167 time 0.025152 [TensorRT] VERBOSE: Tactic: 5832703 time 0.02432 [TensorRT] VERBOSE: Tactic: 5898239 time 0.018656 [TensorRT] VERBOSE: Tactic: 6029311 time 0.033312 [TensorRT] VERBOSE: Tactic: 6225919 time 0.01904 [TensorRT] VERBOSE: Tactic: 6291455 time 0.020288 [TensorRT] VERBOSE: Tactic: 6422527 time 0.017856 [TensorRT] VERBOSE: Tactic: 6750207 time 0.019232 [TensorRT] VERBOSE: Tactic: 6815743 time 0.027872 [TensorRT] VERBOSE: Tactic: 6946815 time 0.02112 [TensorRT] VERBOSE: Tactic: 7012351 time 0.015712 [TensorRT] VERBOSE: Tactic: 7077887 time 0.02032 [TensorRT] VERBOSE: Tactic: 7143423 time 0.026848 [TensorRT] VERBOSE: Tactic: 7208959 time 0.025376 [TensorRT] VERBOSE: Tactic: 7340031 time 0.018752 [TensorRT] VERBOSE: Tactic: 7405567 time 0.01728 [TensorRT] VERBOSE: Tactic: 7536639 time 0.028832 [TensorRT] VERBOSE: Tactic: 7602175 time 0.022304 [TensorRT] VERBOSE: Tactic: 7733247 time 0.020256 [TensorRT] VERBOSE: Tactic: 7798783 time 0.023776 [TensorRT] VERBOSE: Tactic: 8191999 time 0.027168 [TensorRT] VERBOSE: Tactic: 8257535 time 0.015552 [TensorRT] VERBOSE: Tactic: 8323071 time 0.021152 [TensorRT] VERBOSE: Tactic: 8650751 time 0.022016 [TensorRT] VERBOSE: Tactic: 8716287 time 0.019456 [TensorRT] VERBOSE: Tactic: 9109503 time 0.017408 [TensorRT] VERBOSE: Tactic: 9568255 time 0.01536 [TensorRT] VERBOSE: Tactic: 9895935 time 0.018496 [TensorRT] VERBOSE: Tactic: 10223615 time 0.04848 [TensorRT] VERBOSE: Tactic: 10354687 time 0.032256 [TensorRT] VERBOSE: Tactic: 10551295 time 0.021984 [TensorRT] VERBOSE: Tactic: 10747903 time 0.020416 [TensorRT] VERBOSE: Tactic: 10944511 time 0.050176 [TensorRT] VERBOSE: Fastest Tactic: 9568255 Time: 0.01536 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.021504 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.03232 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.0224 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.02224 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.03328 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.032832 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.03584 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.032832 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.032768 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.034112 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.033952 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.034176 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.021504 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9568255 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.031776 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.033568 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.034816 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.020768 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.034592 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.021952 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.033408 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.033248 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.033152 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.032768 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.022656 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.032032 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.020768 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.033184 [TensorRT] VERBOSE: Tactic: 655359 time 0.03616 [TensorRT] VERBOSE: Tactic: 786431 time 0.02864 [TensorRT] VERBOSE: Tactic: 851967 time 0.019008 [TensorRT] VERBOSE: Tactic: 1179647 time 0.022432 [TensorRT] VERBOSE: Tactic: 1310719 time 0.029696 [TensorRT] VERBOSE: Tactic: 1376255 time 0.054176 [TensorRT] VERBOSE: Tactic: 1441791 time 0.0256 [TensorRT] VERBOSE: Tactic: 1507327 time 0.023168 [TensorRT] VERBOSE: Tactic: 1638399 time 0.02384 [TensorRT] VERBOSE: Tactic: 1835007 time 0.022336 [TensorRT] VERBOSE: Tactic: 1900543 time 0.038784 [TensorRT] VERBOSE: Tactic: 2097151 time 0.018848 [TensorRT] VERBOSE: Tactic: 2162687 time 0.065024 [TensorRT] VERBOSE: Tactic: 2293759 time 0.04048 [TensorRT] VERBOSE: Tactic: 2359295 time 0.043616 [TensorRT] VERBOSE: Tactic: 2686975 time 0.047232 [TensorRT] VERBOSE: Tactic: 3080191 time 0.018688 [TensorRT] VERBOSE: Tactic: 3342335 time 0.02384 [TensorRT] VERBOSE: Tactic: 3407871 time 0.02672 [TensorRT] VERBOSE: Tactic: 3538943 time 0.022976 [TensorRT] VERBOSE: Tactic: 3670015 time 0.050592 [TensorRT] VERBOSE: Tactic: 3932159 time 0.022432 [TensorRT] VERBOSE: Tactic: 3997695 time 0.025632 [TensorRT] VERBOSE: Tactic: 4063231 time 0.018592 [TensorRT] VERBOSE: Tactic: 4194303 time 0.021728 [TensorRT] VERBOSE: Tactic: 4259839 time 0.020448 [TensorRT] VERBOSE: Tactic: 4325375 time 0.042816 [TensorRT] VERBOSE: Tactic: 4521983 time 0.054048 [TensorRT] VERBOSE: Tactic: 4587519 time 0.0208 [TensorRT] VERBOSE: Tactic: 4653055 time 0.024192 [TensorRT] VERBOSE: Tactic: 4915199 time 0.017408 [TensorRT] VERBOSE: Tactic: 4980735 time 0.051584 [TensorRT] VERBOSE: Tactic: 5177343 time 0.022272 [TensorRT] VERBOSE: Tactic: 5242879 time 0.028672 [TensorRT] VERBOSE: Tactic: 5373951 time 0.022016 [TensorRT] VERBOSE: Tactic: 5439487 time 0.023936 [TensorRT] VERBOSE: Tactic: 5570559 time 0.018816 [TensorRT] VERBOSE: Tactic: 5636095 time 0.018752 [TensorRT] VERBOSE: Tactic: 5701631 time 0.03648 [TensorRT] VERBOSE: Tactic: 5767167 time 0.02704 [TensorRT] VERBOSE: Tactic: 5832703 time 0.031584 [TensorRT] VERBOSE: Tactic: 5898239 time 0.019136 [TensorRT] VERBOSE: Tactic: 6029311 time 0.031744 [TensorRT] VERBOSE: Tactic: 6225919 time 0.0208 [TensorRT] VERBOSE: Tactic: 6291455 time 0.021888 [TensorRT] VERBOSE: Tactic: 6422527 time 0.015904 [TensorRT] VERBOSE: Tactic: 6750207 time 0.023872 [TensorRT] VERBOSE: Tactic: 6815743 time 0.028416 [TensorRT] VERBOSE: Tactic: 6946815 time 0.025024 [TensorRT] VERBOSE: Tactic: 7012351 time 0.017984 [TensorRT] VERBOSE: Tactic: 7077887 time 0.021856 [TensorRT] VERBOSE: Tactic: 7143423 time 0.03072 [TensorRT] VERBOSE: Tactic: 7208959 time 0.031648 [TensorRT] VERBOSE: Tactic: 7340031 time 0.0192 [TensorRT] VERBOSE: Tactic: 7405567 time 0.017344 [TensorRT] VERBOSE: Tactic: 7536639 time 0.030816 [TensorRT] VERBOSE: Tactic: 7602175 time 0.024448 [TensorRT] VERBOSE: Tactic: 7733247 time 0.022304 [TensorRT] VERBOSE: Tactic: 7798783 time 0.029088 [TensorRT] VERBOSE: Tactic: 8191999 time 0.03152 [TensorRT] VERBOSE: Tactic: 8257535 time 0.017408 [TensorRT] VERBOSE: Tactic: 8323071 time 0.023136 [TensorRT] VERBOSE: Tactic: 8650751 time 0.023904 [TensorRT] VERBOSE: Tactic: 8716287 time 0.020448 [TensorRT] VERBOSE: Tactic: 9109503 time 0.017664 [TensorRT] VERBOSE: Tactic: 9568255 time 0.017216 [TensorRT] VERBOSE: Tactic: 9895935 time 0.021856 [TensorRT] VERBOSE: Tactic: 10223615 time 0.047296 [TensorRT] VERBOSE: Tactic: 10354687 time 0.031744 [TensorRT] VERBOSE: Tactic: 10551295 time 0.023648 [TensorRT] VERBOSE: Tactic: 10747903 time 0.021152 [TensorRT] VERBOSE: Tactic: 10944511 time 0.052928 [TensorRT] VERBOSE: Fastest Tactic: 6422527 Time: 0.015904 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.01536 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.022176 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.015904 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.015648 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.022144 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.015808 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.01632 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.015904 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.016128 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.016032 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.022176 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.014848 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.014848 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010976 [TensorRT] VERBOSE: Tactic: 0 time 0.014688 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010976 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012768 [TensorRT] VERBOSE: Tactic: 0 time 0.01392 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012768 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012512 [TensorRT] VERBOSE: Tactic: 0 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012512 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007712 [TensorRT] VERBOSE: Tactic: 256 time 0.007808 [TensorRT] VERBOSE: Tactic: 512 time 0.00784 [TensorRT] VERBOSE: Tactic: -32 time 0.023552 [TensorRT] VERBOSE: Tactic: -64 time 0.014144 [TensorRT] VERBOSE: Tactic: -128 time 0.011104 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.007712 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.004544 [TensorRT] VERBOSE: Tactic: 3 time 0.00624 [TensorRT] VERBOSE: Tactic: 4 time 0.004512 [TensorRT] VERBOSE: Tactic: 5 time 0.004256 [TensorRT] VERBOSE: Tactic: 6 time 0.006176 [TensorRT] VERBOSE: Tactic: 7 time 0.00608 [TensorRT] VERBOSE: Tactic: 8 time 0.004512 [TensorRT] VERBOSE: Tactic: 9 time 0.005984 [TensorRT] VERBOSE: Tactic: 28 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.004256 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007808 [TensorRT] VERBOSE: Tactic: 256 time 0.007488 [TensorRT] VERBOSE: Tactic: 512 time 0.007968 [TensorRT] VERBOSE: Tactic: -32 time 0.02432 [TensorRT] VERBOSE: Tactic: -64 time 0.014336 [TensorRT] VERBOSE: Tactic: -128 time 0.011008 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.007488 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.006176 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.006176 [TensorRT] VERBOSE: Tactic: 27 time 0.00608 [TensorRT] VERBOSE: Tactic: 31 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.00608 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.008864 [TensorRT] VERBOSE: Tactic: 512 time 0.009248 [TensorRT] VERBOSE: Tactic: -32 time 0.011008 [TensorRT] VERBOSE: Tactic: -64 time 0.012352 [TensorRT] VERBOSE: Tactic: -128 time 0.01232 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.008864 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.006112 [TensorRT] VERBOSE: Tactic: 3 time 0.006336 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.005952 [TensorRT] VERBOSE: Tactic: 6 time 0.007616 [TensorRT] VERBOSE: Tactic: 7 time 0.006048 [TensorRT] VERBOSE: Tactic: 8 time 0.006112 [TensorRT] VERBOSE: Tactic: 9 time 0.006016 [TensorRT] VERBOSE: Tactic: 10 time 0.007776 [TensorRT] VERBOSE: Tactic: 11 time 0.006048 [TensorRT] VERBOSE: Tactic: 12 time 0.006144 [TensorRT] VERBOSE: Tactic: 13 time 0.00608 [TensorRT] VERBOSE: Tactic: 14 time 0.006176 [TensorRT] VERBOSE: Tactic: 15 time 0.006144 [TensorRT] VERBOSE: Tactic: 16 time 0.006144 [TensorRT] VERBOSE: Tactic: 17 time 0.006144 [TensorRT] VERBOSE: Tactic: 18 time 0.006144 [TensorRT] VERBOSE: Tactic: 19 time 0.006144 [TensorRT] VERBOSE: Tactic: 20 time 0.009088 [TensorRT] VERBOSE: Tactic: 21 time 0.007616 [TensorRT] VERBOSE: Tactic: 22 time 0.006048 [TensorRT] VERBOSE: Tactic: 23 time 0.006112 [TensorRT] VERBOSE: Tactic: 28 time 0.00608 [TensorRT] VERBOSE: Tactic: 29 time 0.006016 [TensorRT] VERBOSE: Tactic: 30 time 0.007968 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009184 [TensorRT] VERBOSE: Tactic: 256 time 0.00928 [TensorRT] VERBOSE: Tactic: 512 time 0.00928 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009184 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00608 [TensorRT] VERBOSE: Tactic: 11 time 0.006144 [TensorRT] VERBOSE: Tactic: 12 time 0.006432 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.00912 [TensorRT] VERBOSE: Tactic: 15 time 0.010496 [TensorRT] VERBOSE: Tactic: 16 time 0.012352 [TensorRT] VERBOSE: Tactic: 17 time 0.00912 [TensorRT] VERBOSE: Tactic: 18 time 0.010752 [TensorRT] VERBOSE: Tactic: 19 time 0.012288 [TensorRT] VERBOSE: Tactic: 20 time 0.00608 [TensorRT] VERBOSE: Tactic: 21 time 0.00608 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.009152 [TensorRT] VERBOSE: Tactic: 24 time 0.00608 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.006016 [TensorRT] VERBOSE: Tactic: 27 time 0.007584 [TensorRT] VERBOSE: Tactic: 29 time 0.010816 [TensorRT] VERBOSE: Tactic: 30 time 0.007584 [TensorRT] VERBOSE: Tactic: 31 time 0.00592 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.00592 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.522336 [TensorRT] VERBOSE: Tactic: 720895 time 0.510208 [TensorRT] VERBOSE: Tactic: 983039 time 0.260704 [TensorRT] VERBOSE: Tactic: 1048575 time 0.48304 [TensorRT] VERBOSE: Tactic: 1703935 time 0.320448 [TensorRT] VERBOSE: Tactic: 1769471 time 0.321536 [TensorRT] VERBOSE: Tactic: 1966079 time 0.754688 [TensorRT] VERBOSE: Tactic: 2031615 time 0.66288 [TensorRT] VERBOSE: Tactic: 2228223 time 0.414528 [TensorRT] VERBOSE: Tactic: 2424831 time 0.368608 [TensorRT] VERBOSE: Tactic: 2621439 time 0.333088 [TensorRT] VERBOSE: Tactic: 2752511 time 0.557056 [TensorRT] VERBOSE: Tactic: 2818047 time 0.455584 [TensorRT] VERBOSE: Tactic: 2883583 time 0.928768 [TensorRT] VERBOSE: Tactic: 3014655 time 0.258624 [TensorRT] VERBOSE: Tactic: 3145727 time 0.298144 [TensorRT] VERBOSE: Tactic: 3473407 time 0.632352 [TensorRT] VERBOSE: Tactic: 3604479 time 0.258592 [TensorRT] VERBOSE: Tactic: 3735551 time 0.518368 [TensorRT] VERBOSE: Tactic: 4390911 time 0.802272 [TensorRT] VERBOSE: Tactic: 5046271 time 0.36256 [TensorRT] VERBOSE: Tactic: 5963775 time 0.70832 [TensorRT] VERBOSE: Tactic: 6160383 time 0.405664 [TensorRT] VERBOSE: Tactic: 6488063 time 0.44672 [TensorRT] VERBOSE: Tactic: 6881279 time 0.61824 [TensorRT] VERBOSE: Tactic: 7274495 time 0.3144 [TensorRT] VERBOSE: Tactic: 7864319 time 0.36208 [TensorRT] VERBOSE: Tactic: 7995391 time 0.530464 [TensorRT] VERBOSE: Tactic: 8585215 time 0.560928 [TensorRT] VERBOSE: Tactic: 8847359 time 0.239264 [TensorRT] VERBOSE: Tactic: 8978431 time 0.70704 [TensorRT] VERBOSE: Tactic: 9043967 time 0.240608 [TensorRT] VERBOSE: Tactic: 9175039 time 0.25936 [TensorRT] VERBOSE: Tactic: 9502719 time 0.7992 [TensorRT] VERBOSE: Tactic: 9830399 time 0.494336 [TensorRT] VERBOSE: Tactic: 9961471 time 0.249216 [TensorRT] VERBOSE: Tactic: 10027007 time 0.321312 [TensorRT] VERBOSE: Tactic: 10092543 time 0.802144 [TensorRT] VERBOSE: Tactic: 10289151 time 0.756064 [TensorRT] VERBOSE: Tactic: 10485759 time 0.284512 [TensorRT] VERBOSE: Tactic: 10682367 time 0.33792 [TensorRT] VERBOSE: Tactic: 10813439 time 0.283104 [TensorRT] VERBOSE: Fastest Tactic: 8847359 Time: 0.239264 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.942368 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.2328 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.776096 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.926336 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.952416 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.680672 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.778336 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.966304 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 1.11027 [TensorRT] VERBOSE: Fastest Tactic: 2775507031594384867 Time: 0.2328 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.512 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 903168, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 1145307136, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 26216448, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 19075584, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.512 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.244256 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.27888 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.282688 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.200384 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.254976 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.320832 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.200704 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.17392 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.237408 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.246688 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.17392 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.137888 [TensorRT] VERBOSE: Tactic: 720895 time 0.188416 [TensorRT] VERBOSE: Tactic: 983039 time 0.07232 [TensorRT] VERBOSE: Tactic: 1048575 time 0.140384 [TensorRT] VERBOSE: Tactic: 1703935 time 0.1016 [TensorRT] VERBOSE: Tactic: 1769471 time 0.09504 [TensorRT] VERBOSE: Tactic: 1966079 time 0.2048 [TensorRT] VERBOSE: Tactic: 2031615 time 0.176064 [TensorRT] VERBOSE: Tactic: 2228223 time 0.195328 [TensorRT] VERBOSE: Tactic: 2424831 time 0.16384 [TensorRT] VERBOSE: Tactic: 2621439 time 0.102816 [TensorRT] VERBOSE: Tactic: 2752511 time 0.166752 [TensorRT] VERBOSE: Tactic: 2818047 time 0.127264 [TensorRT] VERBOSE: Tactic: 2883583 time 0.26624 [TensorRT] VERBOSE: Tactic: 3014655 time 0.084448 [TensorRT] VERBOSE: Tactic: 3145727 time 0.086016 [TensorRT] VERBOSE: Tactic: 3473407 time 0.171808 [TensorRT] VERBOSE: Tactic: 3604479 time 0.07296 [TensorRT] VERBOSE: Tactic: 3735551 time 0.091328 [TensorRT] VERBOSE: Tactic: 4390911 time 0.241664 [TensorRT] VERBOSE: Tactic: 5046271 time 0.095328 [TensorRT] VERBOSE: Tactic: 5963775 time 0.200192 [TensorRT] VERBOSE: Tactic: 6160383 time 0.257792 [TensorRT] VERBOSE: Tactic: 6488063 time 0.124928 [TensorRT] VERBOSE: Tactic: 6881279 time 0.17792 [TensorRT] VERBOSE: Tactic: 7274495 time 0.080896 [TensorRT] VERBOSE: Tactic: 7864319 time 0.107424 [TensorRT] VERBOSE: Tactic: 7995391 time 0.14 [TensorRT] VERBOSE: Tactic: 8585215 time 0.183264 [TensorRT] VERBOSE: Tactic: 8847359 time 0.06352 [TensorRT] VERBOSE: Tactic: 8978431 time 0.187968 [TensorRT] VERBOSE: Tactic: 9043967 time 0.077216 [TensorRT] VERBOSE: Tactic: 9175039 time 0.0736 [TensorRT] VERBOSE: Tactic: 9502719 time 0.25936 [TensorRT] VERBOSE: Tactic: 9830399 time 0.13616 [TensorRT] VERBOSE: Tactic: 9961471 time 0.090016 [TensorRT] VERBOSE: Tactic: 10027007 time 0.101376 [TensorRT] VERBOSE: Tactic: 10092543 time 0.24256 [TensorRT] VERBOSE: Tactic: 10289151 time 0.203328 [TensorRT] VERBOSE: Tactic: 10485759 time 0.090944 [TensorRT] VERBOSE: Tactic: 10682367 time 0.091008 [TensorRT] VERBOSE: Tactic: 10813439 time 0.07824 [TensorRT] VERBOSE: Fastest Tactic: 8847359 Time: 0.06352 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.198144 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.169376 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.277888 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.245216 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.317984 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.236384 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.286688 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.2472 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.253472 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.198912 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.169376 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 8847359 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.279456 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.317056 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.197344 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.284352 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.170528 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.2504 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.238272 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.19744 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.245152 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.24432 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.170528 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.140512 [TensorRT] VERBOSE: Tactic: 720895 time 0.138976 [TensorRT] VERBOSE: Tactic: 983039 time 0.073728 [TensorRT] VERBOSE: Tactic: 1048575 time 0.13824 [TensorRT] VERBOSE: Tactic: 1703935 time 0.107808 [TensorRT] VERBOSE: Tactic: 1769471 time 0.094144 [TensorRT] VERBOSE: Tactic: 1966079 time 0.20224 [TensorRT] VERBOSE: Tactic: 2031615 time 0.194048 [TensorRT] VERBOSE: Tactic: 2228223 time 0.20032 [TensorRT] VERBOSE: Tactic: 2424831 time 0.172032 [TensorRT] VERBOSE: Tactic: 2621439 time 0.096736 [TensorRT] VERBOSE: Tactic: 2752511 time 0.168064 [TensorRT] VERBOSE: Tactic: 2818047 time 0.129376 [TensorRT] VERBOSE: Tactic: 2883583 time 0.269024 [TensorRT] VERBOSE: Tactic: 3014655 time 0.082816 [TensorRT] VERBOSE: Tactic: 3145727 time 0.085248 [TensorRT] VERBOSE: Tactic: 3473407 time 0.176128 [TensorRT] VERBOSE: Tactic: 3604479 time 0.07552 [TensorRT] VERBOSE: Tactic: 3735551 time 0.095872 [TensorRT] VERBOSE: Tactic: 4390911 time 0.239008 [TensorRT] VERBOSE: Tactic: 5046271 time 0.107392 [TensorRT] VERBOSE: Tactic: 5963775 time 0.191232 [TensorRT] VERBOSE: Tactic: 6160383 time 0.27104 [TensorRT] VERBOSE: Tactic: 6488063 time 0.129024 [TensorRT] VERBOSE: Tactic: 6881279 time 0.178112 [TensorRT] VERBOSE: Tactic: 7274495 time 0.080864 [TensorRT] VERBOSE: Tactic: 7864319 time 0.110592 [TensorRT] VERBOSE: Tactic: 7995391 time 0.13856 [TensorRT] VERBOSE: Tactic: 8585215 time 0.183968 [TensorRT] VERBOSE: Tactic: 8847359 time 0.064352 [TensorRT] VERBOSE: Tactic: 8978431 time 0.189344 [TensorRT] VERBOSE: Tactic: 9043967 time 0.078304 [TensorRT] VERBOSE: Tactic: 9175039 time 0.073024 [TensorRT] VERBOSE: Tactic: 9502719 time 0.264 [TensorRT] VERBOSE: Tactic: 9830399 time 0.132096 [TensorRT] VERBOSE: Tactic: 9961471 time 0.10784 [TensorRT] VERBOSE: Tactic: 10027007 time 0.099584 [TensorRT] VERBOSE: Tactic: 10092543 time 0.24064 [TensorRT] VERBOSE: Tactic: 10289151 time 0.200416 [TensorRT] VERBOSE: Tactic: 10485759 time 0.093504 [TensorRT] VERBOSE: Tactic: 10682367 time 0.089664 [TensorRT] VERBOSE: Tactic: 10813439 time 0.07904 [TensorRT] VERBOSE: Fastest Tactic: 8847359 Time: 0.064352 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.099136 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.106688 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.128832 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.096064 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.095232 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.110816 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.139072 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.096896 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.106368 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.088032 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.123488 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.090816 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.088032 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 8847359 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.009344 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.030336 [TensorRT] VERBOSE: Tactic: -64 time 0.017472 [TensorRT] VERBOSE: Tactic: -128 time 0.012192 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009216 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.00512 [TensorRT] VERBOSE: Tactic: 2 time 0.00624 [TensorRT] VERBOSE: Tactic: 3 time 0.006016 [TensorRT] VERBOSE: Tactic: 4 time 0.00608 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.00624 [TensorRT] VERBOSE: Tactic: 7 time 0.006016 [TensorRT] VERBOSE: Tactic: 8 time 0.005984 [TensorRT] VERBOSE: Tactic: 9 time 0.006144 [TensorRT] VERBOSE: Tactic: 28 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.00512 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009184 [TensorRT] VERBOSE: Tactic: 256 time 0.009216 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.029728 [TensorRT] VERBOSE: Tactic: -64 time 0.017536 [TensorRT] VERBOSE: Tactic: -128 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009184 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.007712 [TensorRT] VERBOSE: Tactic: 25 time 0.008 [TensorRT] VERBOSE: Tactic: 26 time 0.006592 [TensorRT] VERBOSE: Tactic: 27 time 0.00784 [TensorRT] VERBOSE: Tactic: 31 time 0.007968 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.006592 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272), Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010784 [TensorRT] VERBOSE: Tactic: 256 time 0.01088 [TensorRT] VERBOSE: Tactic: 512 time 0.010912 [TensorRT] VERBOSE: Tactic: -32 time 0.014144 [TensorRT] VERBOSE: Tactic: -64 time 0.014848 [TensorRT] VERBOSE: Tactic: -128 time 0.01536 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.010784 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006336 [TensorRT] VERBOSE: Tactic: 1 time 0.005824 [TensorRT] VERBOSE: Tactic: 2 time 0.006368 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.006208 [TensorRT] VERBOSE: Tactic: 5 time 0.006048 [TensorRT] VERBOSE: Tactic: 6 time 0.007616 [TensorRT] VERBOSE: Tactic: 7 time 0.006144 [TensorRT] VERBOSE: Tactic: 8 time 0.006048 [TensorRT] VERBOSE: Tactic: 9 time 0.006016 [TensorRT] VERBOSE: Tactic: 10 time 0.007616 [TensorRT] VERBOSE: Tactic: 11 time 0.007616 [TensorRT] VERBOSE: Tactic: 12 time 0.006144 [TensorRT] VERBOSE: Tactic: 13 time 0.007456 [TensorRT] VERBOSE: Tactic: 14 time 0.006304 [TensorRT] VERBOSE: Tactic: 15 time 0.007552 [TensorRT] VERBOSE: Tactic: 16 time 0.007648 [TensorRT] VERBOSE: Tactic: 17 time 0.00752 [TensorRT] VERBOSE: Tactic: 18 time 0.007744 [TensorRT] VERBOSE: Tactic: 19 time 0.007616 [TensorRT] VERBOSE: Tactic: 20 time 0.009184 [TensorRT] VERBOSE: Tactic: 21 time 0.007968 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.007904 [TensorRT] VERBOSE: Tactic: 28 time 0.008032 [TensorRT] VERBOSE: Tactic: 29 time 0.007584 [TensorRT] VERBOSE: Tactic: 30 time 0.009184 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.005824 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784), Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010688 [TensorRT] VERBOSE: Tactic: 256 time 0.010848 [TensorRT] VERBOSE: Tactic: 512 time 0.011104 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.010688 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007552 [TensorRT] VERBOSE: Tactic: 11 time 0.009376 [TensorRT] VERBOSE: Tactic: 12 time 0.007648 [TensorRT] VERBOSE: Tactic: 13 time 0.0128 [TensorRT] VERBOSE: Tactic: 14 time 0.011104 [TensorRT] VERBOSE: Tactic: 15 time 0.010848 [TensorRT] VERBOSE: Tactic: 16 time 0.014112 [TensorRT] VERBOSE: Tactic: 17 time 0.011264 [TensorRT] VERBOSE: Tactic: 18 time 0.0112 [TensorRT] VERBOSE: Tactic: 19 time 0.01232 [TensorRT] VERBOSE: Tactic: 20 time 0.006112 [TensorRT] VERBOSE: Tactic: 21 time 0.00752 [TensorRT] VERBOSE: Tactic: 22 time 0.008704 [TensorRT] VERBOSE: Tactic: 23 time 0.012416 [TensorRT] VERBOSE: Tactic: 24 time 0.00624 [TensorRT] VERBOSE: Tactic: 25 time 0.006432 [TensorRT] VERBOSE: Tactic: 26 time 0.007488 [TensorRT] VERBOSE: Tactic: 27 time 0.010848 [TensorRT] VERBOSE: Tactic: 29 time 0.015488 [TensorRT] VERBOSE: Tactic: 30 time 0.009152 [TensorRT] VERBOSE: Tactic: 31 time 0.007584 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.006112 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010592 [TensorRT] VERBOSE: Tactic: 0 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010592 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012352 [TensorRT] VERBOSE: Tactic: 0 time 0.00432 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00432 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012448 [TensorRT] VERBOSE: Tactic: 0 time 0.011296 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011296 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0272 [TensorRT] VERBOSE: Tactic: 0 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007552 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01232 [TensorRT] VERBOSE: Tactic: 0 time 0.00768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00768 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011872 [TensorRT] VERBOSE: Tactic: 0 time 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011872 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01104 [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006144 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012416 [TensorRT] VERBOSE: Tactic: 0 time 0.015264 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012416 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012352 [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010784 [TensorRT] VERBOSE: Tactic: 0 time 0.0072 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0072 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012032 [TensorRT] VERBOSE: Tactic: 0 time 0.014688 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012032 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012384 [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006144 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.008032 [TensorRT] VERBOSE: Tactic: 256 time 0.007936 [TensorRT] VERBOSE: Tactic: 512 time 0.007648 [TensorRT] VERBOSE: Tactic: -32 time 0.02336 [TensorRT] VERBOSE: Tactic: -64 time 0.014272 [TensorRT] VERBOSE: Tactic: -128 time 0.011168 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.007648 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005984 [TensorRT] VERBOSE: Tactic: 1 time 0.006176 [TensorRT] VERBOSE: Tactic: 2 time 0.00448 [TensorRT] VERBOSE: Tactic: 3 time 0.005952 [TensorRT] VERBOSE: Tactic: 4 time 0.004256 [TensorRT] VERBOSE: Tactic: 5 time 0.006016 [TensorRT] VERBOSE: Tactic: 6 time 0.005984 [TensorRT] VERBOSE: Tactic: 7 time 0.005984 [TensorRT] VERBOSE: Tactic: 8 time 0.004512 [TensorRT] VERBOSE: Tactic: 9 time 0.005984 [TensorRT] VERBOSE: Tactic: 28 time 0.006016 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.004256 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.008 [TensorRT] VERBOSE: Tactic: 256 time 0.008064 [TensorRT] VERBOSE: Tactic: 512 time 0.007712 [TensorRT] VERBOSE: Tactic: -32 time 0.023904 [TensorRT] VERBOSE: Tactic: -64 time 0.014304 [TensorRT] VERBOSE: Tactic: -128 time 0.010848 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.007712 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.006528 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.00608 [TensorRT] VERBOSE: Tactic: 27 time 0.006144 [TensorRT] VERBOSE: Tactic: 31 time 0.006464 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.00608 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.009248 [TensorRT] VERBOSE: Tactic: 512 time 0.009408 [TensorRT] VERBOSE: Tactic: -32 time 0.010752 [TensorRT] VERBOSE: Tactic: -64 time 0.012384 [TensorRT] VERBOSE: Tactic: -128 time 0.012352 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009216 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Tactic: 1 time 0.006016 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.0056 [TensorRT] VERBOSE: Tactic: 5 time 0.006048 [TensorRT] VERBOSE: Tactic: 6 time 0.007424 [TensorRT] VERBOSE: Tactic: 7 time 0.005888 [TensorRT] VERBOSE: Tactic: 8 time 0.006048 [TensorRT] VERBOSE: Tactic: 9 time 0.00608 [TensorRT] VERBOSE: Tactic: 10 time 0.007584 [TensorRT] VERBOSE: Tactic: 11 time 0.005984 [TensorRT] VERBOSE: Tactic: 12 time 0.006144 [TensorRT] VERBOSE: Tactic: 13 time 0.006016 [TensorRT] VERBOSE: Tactic: 14 time 0.006016 [TensorRT] VERBOSE: Tactic: 15 time 0.006048 [TensorRT] VERBOSE: Tactic: 16 time 0.006112 [TensorRT] VERBOSE: Tactic: 17 time 0.006144 [TensorRT] VERBOSE: Tactic: 18 time 0.006144 [TensorRT] VERBOSE: Tactic: 19 time 0.006048 [TensorRT] VERBOSE: Tactic: 20 time 0.009184 [TensorRT] VERBOSE: Tactic: 21 time 0.007264 [TensorRT] VERBOSE: Tactic: 22 time 0.006016 [TensorRT] VERBOSE: Tactic: 23 time 0.006144 [TensorRT] VERBOSE: Tactic: 28 time 0.006144 [TensorRT] VERBOSE: Tactic: 29 time 0.006464 [TensorRT] VERBOSE: Tactic: 30 time 0.00768 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.0056 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009152 [TensorRT] VERBOSE: Tactic: 256 time 0.009408 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009152 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006752 [TensorRT] VERBOSE: Tactic: 11 time 0.007616 [TensorRT] VERBOSE: Tactic: 12 time 0.00608 [TensorRT] VERBOSE: Tactic: 13 time 0.008608 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.009504 [TensorRT] VERBOSE: Tactic: 16 time 0.013632 [TensorRT] VERBOSE: Tactic: 17 time 0.009344 [TensorRT] VERBOSE: Tactic: 18 time 0.010752 [TensorRT] VERBOSE: Tactic: 19 time 0.010944 [TensorRT] VERBOSE: Tactic: 20 time 0.005632 [TensorRT] VERBOSE: Tactic: 21 time 0.006016 [TensorRT] VERBOSE: Tactic: 22 time 0.006176 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 24 time 0.006112 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.006016 [TensorRT] VERBOSE: Tactic: 27 time 0.007616 [TensorRT] VERBOSE: Tactic: 29 time 0.0112 [TensorRT] VERBOSE: Tactic: 30 time 0.007744 [TensorRT] VERBOSE: Tactic: 31 time 0.006048 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.005632 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_209 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_209 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_209 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_209 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_209 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009248 [TensorRT] VERBOSE: Tactic: 256 time 0.009248 [TensorRT] VERBOSE: Tactic: 512 time 0.00912 [TensorRT] VERBOSE: Tactic: -32 time 0.030016 [TensorRT] VERBOSE: Tactic: -64 time 0.017696 [TensorRT] VERBOSE: Tactic: -128 time 0.012736 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.00912 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006304 [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 2 time 0.00608 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.005952 [TensorRT] VERBOSE: Tactic: 5 time 0.006016 [TensorRT] VERBOSE: Tactic: 6 time 0.006112 [TensorRT] VERBOSE: Tactic: 7 time 0.006144 [TensorRT] VERBOSE: Tactic: 8 time 0.006016 [TensorRT] VERBOSE: Tactic: 9 time 0.005888 [TensorRT] VERBOSE: Tactic: 28 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: 9 Time: 0.005888 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009376 [TensorRT] VERBOSE: Tactic: 256 time 0.009344 [TensorRT] VERBOSE: Tactic: 512 time 0.009152 [TensorRT] VERBOSE: Tactic: -32 time 0.029984 [TensorRT] VERBOSE: Tactic: -64 time 0.017696 [TensorRT] VERBOSE: Tactic: -128 time 0.012256 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.009152 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009216 [TensorRT] VERBOSE: Tactic: 25 time 0.006752 [TensorRT] VERBOSE: Tactic: 26 time 0.007776 [TensorRT] VERBOSE: Tactic: 27 time 0.007616 [TensorRT] VERBOSE: Tactic: 31 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006752 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272), Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011072 [TensorRT] VERBOSE: Tactic: 256 time 0.010912 [TensorRT] VERBOSE: Tactic: 512 time 0.012352 [TensorRT] VERBOSE: Tactic: -32 time 0.013984 [TensorRT] VERBOSE: Tactic: -64 time 0.014336 [TensorRT] VERBOSE: Tactic: -128 time 0.01456 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.010912 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 2 time 0.006016 [TensorRT] VERBOSE: Tactic: 3 time 0.006464 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.006016 [TensorRT] VERBOSE: Tactic: 6 time 0.007776 [TensorRT] VERBOSE: Tactic: 7 time 0.007552 [TensorRT] VERBOSE: Tactic: 8 time 0.007616 [TensorRT] VERBOSE: Tactic: 9 time 0.005984 [TensorRT] VERBOSE: Tactic: 10 time 0.007616 [TensorRT] VERBOSE: Tactic: 11 time 0.006688 [TensorRT] VERBOSE: Tactic: 12 time 0.006144 [TensorRT] VERBOSE: Tactic: 13 time 0.007712 [TensorRT] VERBOSE: Tactic: 14 time 0.006784 [TensorRT] VERBOSE: Tactic: 15 time 0.006208 [TensorRT] VERBOSE: Tactic: 16 time 0.007584 [TensorRT] VERBOSE: Tactic: 17 time 0.007808 [TensorRT] VERBOSE: Tactic: 18 time 0.00752 [TensorRT] VERBOSE: Tactic: 19 time 0.007424 [TensorRT] VERBOSE: Tactic: 20 time 0.009184 [TensorRT] VERBOSE: Tactic: 21 time 0.00784 [TensorRT] VERBOSE: Tactic: 22 time 0.007616 [TensorRT] VERBOSE: Tactic: 23 time 0.00752 [TensorRT] VERBOSE: Tactic: 28 time 0.00752 [TensorRT] VERBOSE: Tactic: 29 time 0.006976 [TensorRT] VERBOSE: Tactic: 30 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 9 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784), Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011072 [TensorRT] VERBOSE: Tactic: 256 time 0.01072 [TensorRT] VERBOSE: Tactic: 512 time 0.011232 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.01072 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007648 [TensorRT] VERBOSE: Tactic: 11 time 0.009312 [TensorRT] VERBOSE: Tactic: 12 time 0.007456 [TensorRT] VERBOSE: Tactic: 13 time 0.01248 [TensorRT] VERBOSE: Tactic: 14 time 0.010912 [TensorRT] VERBOSE: Tactic: 15 time 0.010784 [TensorRT] VERBOSE: Tactic: 16 time 0.01408 [TensorRT] VERBOSE: Tactic: 17 time 0.011264 [TensorRT] VERBOSE: Tactic: 18 time 0.012288 [TensorRT] VERBOSE: Tactic: 19 time 0.012448 [TensorRT] VERBOSE: Tactic: 20 time 0.005984 [TensorRT] VERBOSE: Tactic: 21 time 0.007456 [TensorRT] VERBOSE: Tactic: 22 time 0.009408 [TensorRT] VERBOSE: Tactic: 23 time 0.012288 [TensorRT] VERBOSE: Tactic: 24 time 0.006048 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.007776 [TensorRT] VERBOSE: Tactic: 27 time 0.010624 [TensorRT] VERBOSE: Tactic: 29 time 0.015776 [TensorRT] VERBOSE: Tactic: 30 time 0.0096 [TensorRT] VERBOSE: Tactic: 31 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.008 [TensorRT] VERBOSE: Tactic: 256 time 0.007488 [TensorRT] VERBOSE: Tactic: 512 time 0.007584 [TensorRT] VERBOSE: Tactic: -32 time 0.023456 [TensorRT] VERBOSE: Tactic: -64 time 0.014176 [TensorRT] VERBOSE: Tactic: -128 time 0.01056 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.007488 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Tactic: 1 time 0.006016 [TensorRT] VERBOSE: Tactic: 2 time 0.00464 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.00448 [TensorRT] VERBOSE: Tactic: 5 time 0.004608 [TensorRT] VERBOSE: Tactic: 6 time 0.006144 [TensorRT] VERBOSE: Tactic: 7 time 0.004544 [TensorRT] VERBOSE: Tactic: 8 time 0.004736 [TensorRT] VERBOSE: Tactic: 9 time 0.006208 [TensorRT] VERBOSE: Tactic: 28 time 0.006048 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.00448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007648 [TensorRT] VERBOSE: Tactic: 256 time 0.00768 [TensorRT] VERBOSE: Tactic: 512 time 0.007424 [TensorRT] VERBOSE: Tactic: -32 time 0.023552 [TensorRT] VERBOSE: Tactic: -64 time 0.013728 [TensorRT] VERBOSE: Tactic: -128 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.007424 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.006144 [TensorRT] VERBOSE: Tactic: 25 time 0.006048 [TensorRT] VERBOSE: Tactic: 26 time 0.006144 [TensorRT] VERBOSE: Tactic: 27 time 0.00672 [TensorRT] VERBOSE: Tactic: 31 time 0.006208 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009408 [TensorRT] VERBOSE: Tactic: 256 time 0.009312 [TensorRT] VERBOSE: Tactic: 512 time 0.009568 [TensorRT] VERBOSE: Tactic: -32 time 0.01072 [TensorRT] VERBOSE: Tactic: -64 time 0.012192 [TensorRT] VERBOSE: Tactic: -128 time 0.012384 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.009312 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.006272 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.00608 [TensorRT] VERBOSE: Tactic: 5 time 0.00608 [TensorRT] VERBOSE: Tactic: 6 time 0.007712 [TensorRT] VERBOSE: Tactic: 7 time 0.006144 [TensorRT] VERBOSE: Tactic: 8 time 0.006112 [TensorRT] VERBOSE: Tactic: 9 time 0.006144 [TensorRT] VERBOSE: Tactic: 10 time 0.007584 [TensorRT] VERBOSE: Tactic: 11 time 0.006048 [TensorRT] VERBOSE: Tactic: 12 time 0.006016 [TensorRT] VERBOSE: Tactic: 13 time 0.006144 [TensorRT] VERBOSE: Tactic: 14 time 0.006016 [TensorRT] VERBOSE: Tactic: 15 time 0.006048 [TensorRT] VERBOSE: Tactic: 16 time 0.006208 [TensorRT] VERBOSE: Tactic: 17 time 0.006176 [TensorRT] VERBOSE: Tactic: 18 time 0.00608 [TensorRT] VERBOSE: Tactic: 19 time 0.006208 [TensorRT] VERBOSE: Tactic: 20 time 0.009216 [TensorRT] VERBOSE: Tactic: 21 time 0.00784 [TensorRT] VERBOSE: Tactic: 22 time 0.006176 [TensorRT] VERBOSE: Tactic: 23 time 0.006144 [TensorRT] VERBOSE: Tactic: 28 time 0.00592 [TensorRT] VERBOSE: Tactic: 29 time 0.006304 [TensorRT] VERBOSE: Tactic: 30 time 0.007712 [TensorRT] VERBOSE: Fastest Tactic: 28 Time: 0.00592 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009248 [TensorRT] VERBOSE: Tactic: 256 time 0.009632 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.009216 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006016 [TensorRT] VERBOSE: Tactic: 11 time 0.00608 [TensorRT] VERBOSE: Tactic: 12 time 0.00608 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.00928 [TensorRT] VERBOSE: Tactic: 15 time 0.009216 [TensorRT] VERBOSE: Tactic: 16 time 0.012416 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.011008 [TensorRT] VERBOSE: Tactic: 19 time 0.010976 [TensorRT] VERBOSE: Tactic: 20 time 0.006016 [TensorRT] VERBOSE: Tactic: 21 time 0.006048 [TensorRT] VERBOSE: Tactic: 22 time 0.007328 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 24 time 0.006208 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.006016 [TensorRT] VERBOSE: Tactic: 27 time 0.007648 [TensorRT] VERBOSE: Tactic: 29 time 0.01104 [TensorRT] VERBOSE: Tactic: 30 time 0.007648 [TensorRT] VERBOSE: Tactic: 31 time 0.00624 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_214 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_214 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_214 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_214 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_214 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009312 [TensorRT] VERBOSE: Tactic: 256 time 0.009344 [TensorRT] VERBOSE: Tactic: 512 time 0.009248 [TensorRT] VERBOSE: Tactic: -32 time 0.029856 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.01248 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.009248 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005728 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.006048 [TensorRT] VERBOSE: Tactic: 3 time 0.006016 [TensorRT] VERBOSE: Tactic: 4 time 0.006112 [TensorRT] VERBOSE: Tactic: 5 time 0.006368 [TensorRT] VERBOSE: Tactic: 6 time 0.006144 [TensorRT] VERBOSE: Tactic: 7 time 0.005952 [TensorRT] VERBOSE: Tactic: 8 time 0.006112 [TensorRT] VERBOSE: Tactic: 9 time 0.006144 [TensorRT] VERBOSE: Tactic: 28 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005728 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.009216 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.029632 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.01232 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009216 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009408 [TensorRT] VERBOSE: Tactic: 25 time 0.006752 [TensorRT] VERBOSE: Tactic: 26 time 0.00672 [TensorRT] VERBOSE: Tactic: 27 time 0.007616 [TensorRT] VERBOSE: Tactic: 31 time 0.008192 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.00672 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272), Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010848 [TensorRT] VERBOSE: Tactic: 256 time 0.011104 [TensorRT] VERBOSE: Tactic: 512 time 0.010816 [TensorRT] VERBOSE: Tactic: -32 time 0.014336 [TensorRT] VERBOSE: Tactic: -64 time 0.015104 [TensorRT] VERBOSE: Tactic: -128 time 0.015744 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.010816 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006048 [TensorRT] VERBOSE: Tactic: 1 time 0.006016 [TensorRT] VERBOSE: Tactic: 2 time 0.00608 [TensorRT] VERBOSE: Tactic: 3 time 0.007712 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.005952 [TensorRT] VERBOSE: Tactic: 6 time 0.007456 [TensorRT] VERBOSE: Tactic: 7 time 0.006208 [TensorRT] VERBOSE: Tactic: 8 time 0.006592 [TensorRT] VERBOSE: Tactic: 9 time 0.006208 [TensorRT] VERBOSE: Tactic: 10 time 0.007584 [TensorRT] VERBOSE: Tactic: 11 time 0.007616 [TensorRT] VERBOSE: Tactic: 12 time 0.00624 [TensorRT] VERBOSE: Tactic: 13 time 0.007808 [TensorRT] VERBOSE: Tactic: 14 time 0.006432 [TensorRT] VERBOSE: Tactic: 15 time 0.006272 [TensorRT] VERBOSE: Tactic: 16 time 0.007424 [TensorRT] VERBOSE: Tactic: 17 time 0.006176 [TensorRT] VERBOSE: Tactic: 18 time 0.00784 [TensorRT] VERBOSE: Tactic: 19 time 0.007584 [TensorRT] VERBOSE: Tactic: 20 time 0.009248 [TensorRT] VERBOSE: Tactic: 21 time 0.007456 [TensorRT] VERBOSE: Tactic: 22 time 0.007552 [TensorRT] VERBOSE: Tactic: 23 time 0.007424 [TensorRT] VERBOSE: Tactic: 28 time 0.007648 [TensorRT] VERBOSE: Tactic: 29 time 0.007936 [TensorRT] VERBOSE: Tactic: 30 time 0.009184 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784), Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011776 [TensorRT] VERBOSE: Tactic: 256 time 0.010816 [TensorRT] VERBOSE: Tactic: 512 time 0.010592 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.010592 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007744 [TensorRT] VERBOSE: Tactic: 11 time 0.009408 [TensorRT] VERBOSE: Tactic: 12 time 0.00768 [TensorRT] VERBOSE: Tactic: 13 time 0.012704 [TensorRT] VERBOSE: Tactic: 14 time 0.010208 [TensorRT] VERBOSE: Tactic: 15 time 0.01072 [TensorRT] VERBOSE: Tactic: 16 time 0.013824 [TensorRT] VERBOSE: Tactic: 17 time 0.012288 [TensorRT] VERBOSE: Tactic: 18 time 0.012288 [TensorRT] VERBOSE: Tactic: 19 time 0.012512 [TensorRT] VERBOSE: Tactic: 20 time 0.006048 [TensorRT] VERBOSE: Tactic: 21 time 0.0072 [TensorRT] VERBOSE: Tactic: 22 time 0.00928 [TensorRT] VERBOSE: Tactic: 23 time 0.012672 [TensorRT] VERBOSE: Tactic: 24 time 0.006016 [TensorRT] VERBOSE: Tactic: 25 time 0.006048 [TensorRT] VERBOSE: Tactic: 26 time 0.007584 [TensorRT] VERBOSE: Tactic: 27 time 0.010624 [TensorRT] VERBOSE: Tactic: 29 time 0.01456 [TensorRT] VERBOSE: Tactic: 30 time 0.009216 [TensorRT] VERBOSE: Tactic: 31 time 0.007776 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007712 [TensorRT] VERBOSE: Tactic: 256 time 0.00768 [TensorRT] VERBOSE: Tactic: 512 time 0.00752 [TensorRT] VERBOSE: Tactic: -32 time 0.023808 [TensorRT] VERBOSE: Tactic: -64 time 0.014208 [TensorRT] VERBOSE: Tactic: -128 time 0.01072 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.00752 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006048 [TensorRT] VERBOSE: Tactic: 1 time 0.005984 [TensorRT] VERBOSE: Tactic: 2 time 0.004768 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.004832 [TensorRT] VERBOSE: Tactic: 6 time 0.00608 [TensorRT] VERBOSE: Tactic: 7 time 0.004512 [TensorRT] VERBOSE: Tactic: 8 time 0.00448 [TensorRT] VERBOSE: Tactic: 9 time 0.006112 [TensorRT] VERBOSE: Tactic: 28 time 0.006016 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.00448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007552 [TensorRT] VERBOSE: Tactic: 256 time 0.007552 [TensorRT] VERBOSE: Tactic: 512 time 0.00768 [TensorRT] VERBOSE: Tactic: -32 time 0.023552 [TensorRT] VERBOSE: Tactic: -64 time 0.014048 [TensorRT] VERBOSE: Tactic: -128 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.007552 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.006336 [TensorRT] VERBOSE: Tactic: 25 time 0.006048 [TensorRT] VERBOSE: Tactic: 26 time 0.006112 [TensorRT] VERBOSE: Tactic: 27 time 0.007008 [TensorRT] VERBOSE: Tactic: 31 time 0.006368 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00928 [TensorRT] VERBOSE: Tactic: 256 time 0.009408 [TensorRT] VERBOSE: Tactic: 512 time 0.009504 [TensorRT] VERBOSE: Tactic: -32 time 0.011072 [TensorRT] VERBOSE: Tactic: -64 time 0.011488 [TensorRT] VERBOSE: Tactic: -128 time 0.012576 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.00928 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00624 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.00592 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.006208 [TensorRT] VERBOSE: Tactic: 5 time 0.005952 [TensorRT] VERBOSE: Tactic: 6 time 0.007712 [TensorRT] VERBOSE: Tactic: 7 time 0.006144 [TensorRT] VERBOSE: Tactic: 8 time 0.006016 [TensorRT] VERBOSE: Tactic: 9 time 0.006304 [TensorRT] VERBOSE: Tactic: 10 time 0.006304 [TensorRT] VERBOSE: Tactic: 11 time 0.006048 [TensorRT] VERBOSE: Tactic: 12 time 0.006016 [TensorRT] VERBOSE: Tactic: 13 time 0.006016 [TensorRT] VERBOSE: Tactic: 14 time 0.00608 [TensorRT] VERBOSE: Tactic: 15 time 0.006304 [TensorRT] VERBOSE: Tactic: 16 time 0.00672 [TensorRT] VERBOSE: Tactic: 17 time 0.00608 [TensorRT] VERBOSE: Tactic: 18 time 0.006016 [TensorRT] VERBOSE: Tactic: 19 time 0.006016 [TensorRT] VERBOSE: Tactic: 20 time 0.007968 [TensorRT] VERBOSE: Tactic: 21 time 0.00752 [TensorRT] VERBOSE: Tactic: 22 time 0.006016 [TensorRT] VERBOSE: Tactic: 23 time 0.00608 [TensorRT] VERBOSE: Tactic: 28 time 0.006144 [TensorRT] VERBOSE: Tactic: 29 time 0.00624 [TensorRT] VERBOSE: Tactic: 30 time 0.007424 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.00592 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009184 [TensorRT] VERBOSE: Tactic: 256 time 0.009216 [TensorRT] VERBOSE: Tactic: 512 time 0.009344 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009184 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.005568 [TensorRT] VERBOSE: Tactic: 11 time 0.006048 [TensorRT] VERBOSE: Tactic: 12 time 0.006112 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.009408 [TensorRT] VERBOSE: Tactic: 16 time 0.013216 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.010688 [TensorRT] VERBOSE: Tactic: 19 time 0.012288 [TensorRT] VERBOSE: Tactic: 20 time 0.0048 [TensorRT] VERBOSE: Tactic: 21 time 0.005984 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.009344 [TensorRT] VERBOSE: Tactic: 24 time 0.006272 [TensorRT] VERBOSE: Tactic: 25 time 0.004928 [TensorRT] VERBOSE: Tactic: 26 time 0.006144 [TensorRT] VERBOSE: Tactic: 27 time 0.007616 [TensorRT] VERBOSE: Tactic: 29 time 0.011104 [TensorRT] VERBOSE: Tactic: 30 time 0.007584 [TensorRT] VERBOSE: Tactic: 31 time 0.006048 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.0048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_219 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_219 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_219 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_219 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_219 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.009184 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.030656 [TensorRT] VERBOSE: Tactic: -64 time 0.01744 [TensorRT] VERBOSE: Tactic: -128 time 0.011904 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.009184 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Tactic: 1 time 0.006112 [TensorRT] VERBOSE: Tactic: 2 time 0.006016 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.006144 [TensorRT] VERBOSE: Tactic: 7 time 0.004864 [TensorRT] VERBOSE: Tactic: 8 time 0.006016 [TensorRT] VERBOSE: Tactic: 9 time 0.00608 [TensorRT] VERBOSE: Tactic: 28 time 0.005984 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.004864 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009344 [TensorRT] VERBOSE: Tactic: 256 time 0.009696 [TensorRT] VERBOSE: Tactic: 512 time 0.009184 [TensorRT] VERBOSE: Tactic: -32 time 0.0296 [TensorRT] VERBOSE: Tactic: -64 time 0.017888 [TensorRT] VERBOSE: Tactic: -128 time 0.01248 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.009184 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009248 [TensorRT] VERBOSE: Tactic: 25 time 0.006624 [TensorRT] VERBOSE: Tactic: 26 time 0.006272 [TensorRT] VERBOSE: Tactic: 27 time 0.007552 [TensorRT] VERBOSE: Tactic: 31 time 0.008192 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.006272 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272), Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010752 [TensorRT] VERBOSE: Tactic: 256 time 0.010464 [TensorRT] VERBOSE: Tactic: 512 time 0.011008 [TensorRT] VERBOSE: Tactic: -32 time 0.014016 [TensorRT] VERBOSE: Tactic: -64 time 0.014688 [TensorRT] VERBOSE: Tactic: -128 time 0.014272 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.010464 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.006176 [TensorRT] VERBOSE: Tactic: 2 time 0.005888 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.005984 [TensorRT] VERBOSE: Tactic: 5 time 0.006048 [TensorRT] VERBOSE: Tactic: 6 time 0.00768 [TensorRT] VERBOSE: Tactic: 7 time 0.006144 [TensorRT] VERBOSE: Tactic: 8 time 0.006112 [TensorRT] VERBOSE: Tactic: 9 time 0.006144 [TensorRT] VERBOSE: Tactic: 10 time 0.007488 [TensorRT] VERBOSE: Tactic: 11 time 0.00752 [TensorRT] VERBOSE: Tactic: 12 time 0.00624 [TensorRT] VERBOSE: Tactic: 13 time 0.006656 [TensorRT] VERBOSE: Tactic: 14 time 0.006144 [TensorRT] VERBOSE: Tactic: 15 time 0.00624 [TensorRT] VERBOSE: Tactic: 16 time 0.007712 [TensorRT] VERBOSE: Tactic: 17 time 0.007616 [TensorRT] VERBOSE: Tactic: 18 time 0.007136 [TensorRT] VERBOSE: Tactic: 19 time 0.007104 [TensorRT] VERBOSE: Tactic: 20 time 0.009376 [TensorRT] VERBOSE: Tactic: 21 time 0.00784 [TensorRT] VERBOSE: Tactic: 22 time 0.007904 [TensorRT] VERBOSE: Tactic: 23 time 0.00736 [TensorRT] VERBOSE: Tactic: 28 time 0.007552 [TensorRT] VERBOSE: Tactic: 29 time 0.007584 [TensorRT] VERBOSE: Tactic: 30 time 0.008512 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.005888 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784), Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010976 [TensorRT] VERBOSE: Tactic: 256 time 0.010784 [TensorRT] VERBOSE: Tactic: 512 time 0.010912 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.010784 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007424 [TensorRT] VERBOSE: Tactic: 11 time 0.009568 [TensorRT] VERBOSE: Tactic: 12 time 0.007648 [TensorRT] VERBOSE: Tactic: 13 time 0.012512 [TensorRT] VERBOSE: Tactic: 14 time 0.010624 [TensorRT] VERBOSE: Tactic: 15 time 0.01088 [TensorRT] VERBOSE: Tactic: 16 time 0.013856 [TensorRT] VERBOSE: Tactic: 17 time 0.012256 [TensorRT] VERBOSE: Tactic: 18 time 0.010944 [TensorRT] VERBOSE: Tactic: 19 time 0.012352 [TensorRT] VERBOSE: Tactic: 20 time 0.006048 [TensorRT] VERBOSE: Tactic: 21 time 0.007808 [TensorRT] VERBOSE: Tactic: 22 time 0.009152 [TensorRT] VERBOSE: Tactic: 23 time 0.012416 [TensorRT] VERBOSE: Tactic: 24 time 0.006176 [TensorRT] VERBOSE: Tactic: 25 time 0.006048 [TensorRT] VERBOSE: Tactic: 26 time 0.007424 [TensorRT] VERBOSE: Tactic: 27 time 0.010816 [TensorRT] VERBOSE: Tactic: 29 time 0.015648 [TensorRT] VERBOSE: Tactic: 30 time 0.00928 [TensorRT] VERBOSE: Tactic: 31 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.006048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006432 [TensorRT] VERBOSE: Tactic: 0 time 0.00448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00448 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010976 [TensorRT] VERBOSE: Tactic: 0 time 0.014304 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010976 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012288 [TensorRT] VERBOSE: Tactic: 0 time 0.007392 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007392 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01264 [TensorRT] VERBOSE: Tactic: 0 time 0.011264 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027968 [TensorRT] VERBOSE: Tactic: 0 time 0.007904 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007904 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01104 [TensorRT] VERBOSE: Tactic: 0 time 0.004576 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004576 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012416 [TensorRT] VERBOSE: Tactic: 0 time 0.007968 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007968 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012544 [TensorRT] VERBOSE: Tactic: 0 time 0.012416 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012416 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.008096 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.023392 [TensorRT] VERBOSE: Tactic: -64 time 0.013984 [TensorRT] VERBOSE: Tactic: -128 time 0.010784 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.008096 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.005984 [TensorRT] VERBOSE: Tactic: 2 time 0.006016 [TensorRT] VERBOSE: Tactic: 3 time 0.005952 [TensorRT] VERBOSE: Tactic: 4 time 0.006048 [TensorRT] VERBOSE: Tactic: 5 time 0.006016 [TensorRT] VERBOSE: Tactic: 6 time 0.00608 [TensorRT] VERBOSE: Tactic: 7 time 0.006016 [TensorRT] VERBOSE: Tactic: 8 time 0.005952 [TensorRT] VERBOSE: Tactic: 9 time 0.005984 [TensorRT] VERBOSE: Tactic: 28 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009184 [TensorRT] VERBOSE: Tactic: 256 time 0.008096 [TensorRT] VERBOSE: Tactic: 512 time 0.009312 [TensorRT] VERBOSE: Tactic: -32 time 0.023776 [TensorRT] VERBOSE: Tactic: -64 time 0.014336 [TensorRT] VERBOSE: Tactic: -128 time 0.011232 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.008096 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.00656 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.005888 [TensorRT] VERBOSE: Tactic: 27 time 0.007648 [TensorRT] VERBOSE: Tactic: 31 time 0.0064 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.005888 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.009504 [TensorRT] VERBOSE: Tactic: 512 time 0.00896 [TensorRT] VERBOSE: Tactic: -32 time 0.011072 [TensorRT] VERBOSE: Tactic: -64 time 0.012384 [TensorRT] VERBOSE: Tactic: -128 time 0.011616 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.00896 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005984 [TensorRT] VERBOSE: Tactic: 1 time 0.005984 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.006016 [TensorRT] VERBOSE: Tactic: 4 time 0.006048 [TensorRT] VERBOSE: Tactic: 5 time 0.005888 [TensorRT] VERBOSE: Tactic: 6 time 0.007552 [TensorRT] VERBOSE: Tactic: 7 time 0.006144 [TensorRT] VERBOSE: Tactic: 8 time 0.005984 [TensorRT] VERBOSE: Tactic: 9 time 0.006144 [TensorRT] VERBOSE: Tactic: 10 time 0.007808 [TensorRT] VERBOSE: Tactic: 11 time 0.005984 [TensorRT] VERBOSE: Tactic: 12 time 0.005952 [TensorRT] VERBOSE: Tactic: 13 time 0.00592 [TensorRT] VERBOSE: Tactic: 14 time 0.005888 [TensorRT] VERBOSE: Tactic: 15 time 0.005664 [TensorRT] VERBOSE: Tactic: 16 time 0.006016 [TensorRT] VERBOSE: Tactic: 17 time 0.005888 [TensorRT] VERBOSE: Tactic: 18 time 0.00576 [TensorRT] VERBOSE: Tactic: 19 time 0.006112 [TensorRT] VERBOSE: Tactic: 20 time 0.008128 [TensorRT] VERBOSE: Tactic: 21 time 0.007424 [TensorRT] VERBOSE: Tactic: 22 time 0.005952 [TensorRT] VERBOSE: Tactic: 23 time 0.006048 [TensorRT] VERBOSE: Tactic: 28 time 0.006048 [TensorRT] VERBOSE: Tactic: 29 time 0.00624 [TensorRT] VERBOSE: Tactic: 30 time 0.007392 [TensorRT] VERBOSE: Fastest Tactic: 15 Time: 0.005664 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 15 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.009312 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009216 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00592 [TensorRT] VERBOSE: Tactic: 11 time 0.007488 [TensorRT] VERBOSE: Tactic: 12 time 0.006048 [TensorRT] VERBOSE: Tactic: 13 time 0.00912 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.010624 [TensorRT] VERBOSE: Tactic: 16 time 0.01248 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.011008 [TensorRT] VERBOSE: Tactic: 19 time 0.012608 [TensorRT] VERBOSE: Tactic: 20 time 0.00608 [TensorRT] VERBOSE: Tactic: 21 time 0.006048 [TensorRT] VERBOSE: Tactic: 22 time 0.006848 [TensorRT] VERBOSE: Tactic: 23 time 0.00912 [TensorRT] VERBOSE: Tactic: 24 time 0.006016 [TensorRT] VERBOSE: Tactic: 25 time 0.006048 [TensorRT] VERBOSE: Tactic: 26 time 0.006016 [TensorRT] VERBOSE: Tactic: 27 time 0.007616 [TensorRT] VERBOSE: Tactic: 29 time 0.011008 [TensorRT] VERBOSE: Tactic: 30 time 0.007584 [TensorRT] VERBOSE: Tactic: 31 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.00592 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011264 [TensorRT] VERBOSE: Tactic: 0 time 0.014208 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012384 [TensorRT] VERBOSE: Tactic: 0 time 0.004448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011296 [TensorRT] VERBOSE: Tactic: 0 time 0.011232 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011232 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027616 [TensorRT] VERBOSE: Tactic: 0 time 0.00768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00768 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012288 [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011264 [TensorRT] VERBOSE: Tactic: 0 time 0.012416 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010816 [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01264 [TensorRT] VERBOSE: Tactic: 0 time 0.014464 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01264 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012288 [TensorRT] VERBOSE: Tactic: 0 time 0.006048 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006048 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010976 [TensorRT] VERBOSE: Tactic: 0 time 0.007424 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007424 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012256 [TensorRT] VERBOSE: Tactic: 0 time 0.01488 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012256 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012672 [TensorRT] VERBOSE: Tactic: 0 time 0.007744 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007744 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 256 time 0.011616 [TensorRT] VERBOSE: Tactic: 512 time 0.011296 [TensorRT] VERBOSE: Tactic: -32 time 0.027072 [TensorRT] VERBOSE: Tactic: -64 time 0.017728 [TensorRT] VERBOSE: Tactic: -128 time 0.01408 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006336 [TensorRT] VERBOSE: Tactic: 1 time 0.006368 [TensorRT] VERBOSE: Tactic: 2 time 0.006432 [TensorRT] VERBOSE: Tactic: 3 time 0.006944 [TensorRT] VERBOSE: Tactic: 4 time 0.006432 [TensorRT] VERBOSE: Tactic: 5 time 0.0064 [TensorRT] VERBOSE: Tactic: 6 time 0.006656 [TensorRT] VERBOSE: Tactic: 7 time 0.006336 [TensorRT] VERBOSE: Tactic: 8 time 0.006304 [TensorRT] VERBOSE: Tactic: 9 time 0.007168 [TensorRT] VERBOSE: Tactic: 28 time 0.0064 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.006304 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 256 time 0.011392 [TensorRT] VERBOSE: Tactic: 512 time 0.011232 [TensorRT] VERBOSE: Tactic: -32 time 0.027264 [TensorRT] VERBOSE: Tactic: -64 time 0.018048 [TensorRT] VERBOSE: Tactic: -128 time 0.014368 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.011232 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009728 [TensorRT] VERBOSE: Tactic: 25 time 0.008608 [TensorRT] VERBOSE: Tactic: 26 time 0.008416 [TensorRT] VERBOSE: Tactic: 27 time 0.008224 [TensorRT] VERBOSE: Tactic: 31 time 0.008896 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.008224 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014144 [TensorRT] VERBOSE: Tactic: 256 time 0.014048 [TensorRT] VERBOSE: Tactic: 512 time 0.01408 [TensorRT] VERBOSE: Tactic: -32 time 0.01872 [TensorRT] VERBOSE: Tactic: -64 time 0.019136 [TensorRT] VERBOSE: Tactic: -128 time 0.02048 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014048 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007872 [TensorRT] VERBOSE: Tactic: 1 time 0.005984 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.007584 [TensorRT] VERBOSE: Tactic: 4 time 0.006112 [TensorRT] VERBOSE: Tactic: 5 time 0.00624 [TensorRT] VERBOSE: Tactic: 6 time 0.009568 [TensorRT] VERBOSE: Tactic: 7 time 0.007648 [TensorRT] VERBOSE: Tactic: 8 time 0.00768 [TensorRT] VERBOSE: Tactic: 9 time 0.0064 [TensorRT] VERBOSE: Tactic: 10 time 0.009248 [TensorRT] VERBOSE: Tactic: 11 time 0.007616 [TensorRT] VERBOSE: Tactic: 12 time 0.007456 [TensorRT] VERBOSE: Tactic: 13 time 0.006944 [TensorRT] VERBOSE: Tactic: 14 time 0.007616 [TensorRT] VERBOSE: Tactic: 15 time 0.006208 [TensorRT] VERBOSE: Tactic: 16 time 0.00912 [TensorRT] VERBOSE: Tactic: 17 time 0.007616 [TensorRT] VERBOSE: Tactic: 18 time 0.007872 [TensorRT] VERBOSE: Tactic: 19 time 0.007648 [TensorRT] VERBOSE: Tactic: 20 time 0.012352 [TensorRT] VERBOSE: Tactic: 21 time 0.010816 [TensorRT] VERBOSE: Tactic: 22 time 0.00864 [TensorRT] VERBOSE: Tactic: 23 time 0.007776 [TensorRT] VERBOSE: Tactic: 28 time 0.007488 [TensorRT] VERBOSE: Tactic: 29 time 0.00848 [TensorRT] VERBOSE: Tactic: 30 time 0.01072 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014208 [TensorRT] VERBOSE: Tactic: 256 time 0.014176 [TensorRT] VERBOSE: Tactic: 512 time 0.01392 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.01392 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006016 [TensorRT] VERBOSE: Tactic: 11 time 0.00768 [TensorRT] VERBOSE: Tactic: 12 time 0.007616 [TensorRT] VERBOSE: Tactic: 13 time 0.009184 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.010784 [TensorRT] VERBOSE: Tactic: 16 time 0.012384 [TensorRT] VERBOSE: Tactic: 17 time 0.009856 [TensorRT] VERBOSE: Tactic: 18 time 0.01104 [TensorRT] VERBOSE: Tactic: 19 time 0.011584 [TensorRT] VERBOSE: Tactic: 20 time 0.006016 [TensorRT] VERBOSE: Tactic: 21 time 0.006112 [TensorRT] VERBOSE: Tactic: 22 time 0.007744 [TensorRT] VERBOSE: Tactic: 23 time 0.009344 [TensorRT] VERBOSE: Tactic: 24 time 0.006016 [TensorRT] VERBOSE: Tactic: 25 time 0.005952 [TensorRT] VERBOSE: Tactic: 26 time 0.006144 [TensorRT] VERBOSE: Tactic: 27 time 0.007584 [TensorRT] VERBOSE: Tactic: 29 time 0.015712 [TensorRT] VERBOSE: Tactic: 30 time 0.010592 [TensorRT] VERBOSE: Tactic: 31 time 0.007744 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,1,1,1024) *************** [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (Pooling) [TensorRT] VERBOSE: Tactic: -1 time 0.006176 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.006176 [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (TiledPooling) [TensorRT] VERBOSE: Tactic: 8192257 time 0.010848 [TensorRT] VERBOSE: Tactic: 8257793 time 0.010784 [TensorRT] VERBOSE: Tactic: 8323329 time 0.01072 [TensorRT] VERBOSE: Tactic: 8388865 time 0.010976 [TensorRT] VERBOSE: Tactic: 8454401 time 0.010016 [TensorRT] VERBOSE: Tactic: 8519937 time 0.010752 [TensorRT] VERBOSE: Tactic: 8585473 time 0.010624 [TensorRT] VERBOSE: Tactic: 8651009 time 0.009824 [TensorRT] VERBOSE: Fastest Tactic: 8651009 Time: 0.009824 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,1,1:4,256) *************** [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (Pooling) [TensorRT] VERBOSE: Tactic: -3 time 0.010592 [TensorRT] VERBOSE: Fastest Tactic: -3 Time: 0.010592 [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (TiledPooling) [TensorRT] VERBOSE: Tactic: 8192257 time 0.007712 [TensorRT] VERBOSE: Tactic: 8257793 time 0.00752 [TensorRT] VERBOSE: Tactic: 8323329 time 0.007456 [TensorRT] VERBOSE: Tactic: 8388865 time 0.00864 [TensorRT] VERBOSE: Tactic: 8454401 time 0.00912 [TensorRT] VERBOSE: Tactic: 8519937 time 0.008992 [TensorRT] VERBOSE: Tactic: 8585473 time 0.010784 [TensorRT] VERBOSE: Tactic: 8651009 time 0.010528 [TensorRT] VERBOSE: Fastest Tactic: 8323329 Time: 0.007456 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 8323329 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Int8(1,1,1:32,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (Pooling) [TensorRT] VERBOSE: Tactic: -4 time 0.011072 [TensorRT] VERBOSE: Fastest Tactic: -4 Time: 0.011072 [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (TiledPooling) [TensorRT] VERBOSE: TiledPooling has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.007648 [TensorRT] VERBOSE: Tactic: 0 time 0.00432 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00432 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.007744 [TensorRT] VERBOSE: Tactic: 0 time 0.004544 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004544 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,1,1,1024) -> Float(1,1024) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Flatten_228 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 time 0.004416 [TensorRT] VERBOSE: Tactic: 1 skipped. Scratch requested: 4096, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004416 [TensorRT] WARNING: No implementation of layer Flatten_228 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: *************** Autotuning format combination: -> Float(1,3) *************** [TensorRT] WARNING: No implementation of layer head.fc.weight obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,1024), Float(1,3) -> Float(1,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Gemm_229 (MatrixMultiply) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] WARNING: No implementation of layer Gemm_229 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: *************** Autotuning format combination: -> Float(1,3) *************** [TensorRT] WARNING: No implementation of layer (Unnamed Layer* 463) [Constant] + (Unnamed Layer* 464) [Shuffle] obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,3), Float(1,3) -> Float(1,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: (Unnamed Layer* 465) [ElementWise] (ElementWise) [TensorRT] VERBOSE: Tactic: 1 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0 [TensorRT] WARNING: No implementation of layer (Unnamed Layer* 465) [ElementWise] obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: Reformatting format: [in] Float(1,224,50176,150528), [out] Int8(1,224,50176:4,50176) [TensorRT] WARNING: No implementation obeys reformatting-free rules, at least 1 reformatting nodes are needed, now picking the fastest path instead. [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.12768 [TensorRT] VERBOSE: Tactic: 0 time 0.065248 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.065248 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.142336 [TensorRT] VERBOSE: Tactic: 0 time 0.443744 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.142336 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.178304 [TensorRT] VERBOSE: Tactic: 0 time 0.099968 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.099968 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.170464 [TensorRT] VERBOSE: Tactic: 0 time 0.314208 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.170464 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.325664 [TensorRT] VERBOSE: Tactic: 0 time 0.344544 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.325664 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.148512 [TensorRT] VERBOSE: Tactic: 0 time 0.067808 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.067808 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.185248 [TensorRT] VERBOSE: Tactic: 0 time 0.351328 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.185248 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.17504 [TensorRT] VERBOSE: Tactic: 0 time 0.645664 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.17504 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.12704 [TensorRT] VERBOSE: Tactic: 0 time 0.064608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.064608 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.143616 [TensorRT] VERBOSE: Tactic: 0 time 0.387328 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.143616 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.181504 [TensorRT] VERBOSE: Tactic: 0 time 0.099424 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.099424 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.173184 [TensorRT] VERBOSE: Tactic: 0 time 0.403488 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.173184 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.338656 [TensorRT] VERBOSE: Tactic: 0 time 0.354624 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.338656 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.146592 [TensorRT] VERBOSE: Tactic: 0 time 0.069696 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.069696 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.18624 [TensorRT] VERBOSE: Tactic: 0 time 0.379872 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.18624 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.181152 [TensorRT] VERBOSE: Tactic: 0 time 0.678912 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.181152 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.036224 [TensorRT] VERBOSE: Tactic: 0 time 0.020544 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020544 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040704 [TensorRT] VERBOSE: Tactic: 0 time 0.09248 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040704 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051744 [TensorRT] VERBOSE: Tactic: 0 time 0.029504 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029504 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048608 [TensorRT] VERBOSE: Tactic: 0 time 0.062336 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048608 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.067936 [TensorRT] VERBOSE: Tactic: 0 time 0.04832 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04832 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.041472 [TensorRT] VERBOSE: Tactic: 0 time 0.019968 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019968 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051776 [TensorRT] VERBOSE: Tactic: 0 time 0.043424 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.043424 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049344 [TensorRT] VERBOSE: Tactic: 0 time 0.082304 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049344 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.035712 [TensorRT] VERBOSE: Tactic: 0 time 0.020512 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020512 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04096 [TensorRT] VERBOSE: Tactic: 0 time 0.092448 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04096 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0512 [TensorRT] VERBOSE: Tactic: 0 time 0.029856 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029856 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048128 [TensorRT] VERBOSE: Tactic: 0 time 0.061504 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048128 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.068864 [TensorRT] VERBOSE: Tactic: 0 time 0.048384 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.048384 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040832 [TensorRT] VERBOSE: Tactic: 0 time 0.019104 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019104 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051104 [TensorRT] VERBOSE: Tactic: 0 time 0.042912 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042912 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05104 [TensorRT] VERBOSE: Tactic: 0 time 0.082656 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.05104 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.019808 [TensorRT] VERBOSE: Tactic: 0 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012288 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.023552 [TensorRT] VERBOSE: Tactic: 0 time 0.048 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026656 [TensorRT] VERBOSE: Tactic: 0 time 0.016224 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016224 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02528 [TensorRT] VERBOSE: Tactic: 0 time 0.032032 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02528 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.041152 [TensorRT] VERBOSE: Tactic: 0 time 0.02496 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02496 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025984 [TensorRT] VERBOSE: Tactic: 0 time 0.012672 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012672 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027712 [TensorRT] VERBOSE: Tactic: 0 time 0.01952 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01952 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02704 [TensorRT] VERBOSE: Tactic: 0 time 0.03984 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02704 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.019648 [TensorRT] VERBOSE: Tactic: 0 time 0.012096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012096 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022848 [TensorRT] VERBOSE: Tactic: 0 time 0.048448 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.022848 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026464 [TensorRT] VERBOSE: Tactic: 0 time 0.015872 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015872 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02592 [TensorRT] VERBOSE: Tactic: 0 time 0.031552 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02592 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040736 [TensorRT] VERBOSE: Tactic: 0 time 0.025056 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.025056 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.024192 [TensorRT] VERBOSE: Tactic: 0 time 0.011136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011136 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027616 [TensorRT] VERBOSE: Tactic: 0 time 0.0192 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0192 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027552 [TensorRT] VERBOSE: Tactic: 0 time 0.039072 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.027552 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.008352 [TensorRT] VERBOSE: Tactic: 0 time 0.00624 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00624 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014368 [TensorRT] VERBOSE: Tactic: 0 time 0.025664 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.014368 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017344 [TensorRT] VERBOSE: Tactic: 0 time 0.010976 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010976 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015936 [TensorRT] VERBOSE: Tactic: 0 time 0.01904 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015936 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.021248 [TensorRT] VERBOSE: Tactic: 0 time 0.012256 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012256 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014336 [TensorRT] VERBOSE: Tactic: 0 time 0.006336 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006336 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016672 [TensorRT] VERBOSE: Tactic: 0 time 0.012352 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012352 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015488 [TensorRT] VERBOSE: Tactic: 0 time 0.022048 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015488 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.008192 [TensorRT] VERBOSE: Tactic: 0 time 0.0064 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0064 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.013376 [TensorRT] VERBOSE: Tactic: 0 time 0.025568 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.013376 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016192 [TensorRT] VERBOSE: Tactic: 0 time 0.010656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010656 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015776 [TensorRT] VERBOSE: Tactic: 0 time 0.018048 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015776 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022528 [TensorRT] VERBOSE: Tactic: 0 time 0.012672 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012672 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014336 [TensorRT] VERBOSE: Tactic: 0 time 0.006464 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006464 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018656 [TensorRT] VERBOSE: Tactic: 0 time 0.012352 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012352 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017056 [TensorRT] VERBOSE: Tactic: 0 time 0.02224 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.017056 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006016 [TensorRT] VERBOSE: Tactic: 0 time 0.004448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004448 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010624 [TensorRT] VERBOSE: Tactic: 0 time 0.01408 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010624 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012416 [TensorRT] VERBOSE: Tactic: 0 time 0.00752 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00752 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01264 [TensorRT] VERBOSE: Tactic: 0 time 0.011072 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011072 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027936 [TensorRT] VERBOSE: Tactic: 0 time 0.00768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00768 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010272 [TensorRT] VERBOSE: Tactic: 0 time 0.004704 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004704 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01248 [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012352 [TensorRT] VERBOSE: Tactic: 0 time 0.012576 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012352 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006048 [TensorRT] VERBOSE: Tactic: 0 time 0.004576 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004576 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011168 [TensorRT] VERBOSE: Tactic: 0 time 0.01408 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011168 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012416 [TensorRT] VERBOSE: Tactic: 0 time 0.007584 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007584 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012288 [TensorRT] VERBOSE: Tactic: 0 time 0.012352 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012288 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026752 [TensorRT] VERBOSE: Tactic: 0 time 0.007648 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007648 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010656 [TensorRT] VERBOSE: Tactic: 0 time 0.004384 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004384 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01232 [TensorRT] VERBOSE: Tactic: 0 time 0.007808 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007808 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012288 [TensorRT] VERBOSE: Tactic: 0 time 0.012352 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012288 [TensorRT] VERBOSE: Adding reformat layer: Conv_0 reformatted input 0 (input) from Float(1,224,50176,150528) to Int8(1,224,50176:4,50176) [TensorRT] VERBOSE: Adding reformat layer: Conv_4 reformatted input 0 (410) from Int8(1,112,12544:32,25088) to Int8(1,112,12544:4,200704) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_5 reformatted input 0 (748) from Int8(1,112,12544:4,401408) to Float(1,112,12544,1605632) [TensorRT] VERBOSE: Adding reformat layer: PWN(LeakyRelu_22, Add_23) reformatted input 0 (754) from Int8(1,112,12544:32,25088) to Int8(1,112,12544:4,200704) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_32 reformatted input 0 (766) from Int8(1,56,3136:32,12544) to Float(1,56,3136,401408) [TensorRT] VERBOSE: Adding reformat layer: PWN(LeakyRelu_49, Add_50) reformatted input 1 (475) from Int8(1,56,3136:4,50176) to Int8(1,56,3136:32,6272) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_64 reformatted input 0 (790) from Int8(1,28,784:32,6272) to Float(1,28,784,200704) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_126 reformatted input 0 (850) from Int8(1,14,196:32,3136) to Float(1,14,196,100352) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_188 reformatted input 0 (910) from Int8(1,7,49:32,1568) to Float(1,7,49,50176) [TensorRT] VERBOSE: Adding reformat layer: Conv_225 reformatted input 0 (735) from Int8(1,7,49:4,12544) to Int8(1,7,49:32,1568) [TensorRT] VERBOSE: Adding reformat layer: Flatten_228 reformatted input 0 (739) from Int8(1,1,1:32,32) to Float(1,1,1,1024) [TensorRT] VERBOSE: Formats and tactics selection completed in 123.067 seconds. [TensorRT] VERBOSE: After reformat layers: 161 layers [TensorRT] VERBOSE: Block size 6422528 [TensorRT] VERBOSE: Block size 6422528 [TensorRT] VERBOSE: Block size 802816 [TensorRT] VERBOSE: Block size 802816 [TensorRT] VERBOSE: Block size 401408 [TensorRT] VERBOSE: Block size 1 [TensorRT] VERBOSE: Total Activation Memory: 14852097 [TensorRT] INFO: Detected 1 inputs and 1 output network tensors. [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_51 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_53 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_56 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_59 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_83 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_85 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_88 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_90 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_93 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_95 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_98 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_100 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_103 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_105 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_108 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_110 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_113 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_115 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_118 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_121 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_145 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_147 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_150 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_152 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_155 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_157 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_160 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_162 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_165 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_167 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_170 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_172 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_175 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_177 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_180 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_183 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_225 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Layer: Conv_0 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_0 Weights: 0 HostPersistent: 1664 DevicePersistent: 303104 [TensorRT] VERBOSE: Layer: LeakyRelu_1 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_2 Weights: 0 HostPersistent: 1664 DevicePersistent: 113664 [TensorRT] VERBOSE: Layer: LeakyRelu_3 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_4 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_4 Weights: 0 HostPersistent: 3200 DevicePersistent: 86528 [TensorRT] VERBOSE: Layer: LeakyRelu_5 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_5 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_18 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_19 Weights: 0 HostPersistent: 1664 DevicePersistent: 78336 [TensorRT] VERBOSE: Layer: LeakyRelu_20 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_21 Weights: 0 HostPersistent: 1664 DevicePersistent: 113664 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_22, Add_23) input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_22, Add_23) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_24 Weights: 0 HostPersistent: 3200 DevicePersistent: 80896 [TensorRT] VERBOSE: Layer: Slice_15 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_25 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_27 Weights: 0 HostPersistent: 3200 DevicePersistent: 84992 [TensorRT] VERBOSE: Layer: LeakyRelu_28 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_29 Weights: 0 HostPersistent: 1664 DevicePersistent: 168960 [TensorRT] VERBOSE: Layer: LeakyRelu_30 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_31 Weights: 0 HostPersistent: 2176 DevicePersistent: 54272 [TensorRT] VERBOSE: Layer: LeakyRelu_32 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_32 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_45 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_46 Weights: 0 HostPersistent: 3200 DevicePersistent: 24576 [TensorRT] VERBOSE: Layer: LeakyRelu_47 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_48 Weights: 0 HostPersistent: 1664 DevicePersistent: 94208 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_49, Add_50) input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_49, Add_50) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_51 Weights: 0 HostPersistent: 1664 DevicePersistent: 28672 [TensorRT] VERBOSE: Layer: LeakyRelu_52 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_53 Weights: 0 HostPersistent: 1664 DevicePersistent: 94208 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_54, Add_55) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_56 Weights: 0 HostPersistent: 1664 DevicePersistent: 28672 [TensorRT] VERBOSE: Layer: Slice_42 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_57 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_59 Weights: 0 HostPersistent: 2176 DevicePersistent: 54272 [TensorRT] VERBOSE: Layer: LeakyRelu_60 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_61 Weights: 0 HostPersistent: 1664 DevicePersistent: 600064 [TensorRT] VERBOSE: Layer: LeakyRelu_62 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_63 Weights: 0 HostPersistent: 2176 DevicePersistent: 141312 [TensorRT] VERBOSE: Layer: LeakyRelu_64 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_64 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_77 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_78 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_79 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_80 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_81, Add_82) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_83 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_84 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_85 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_86, Add_87) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_88 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_89 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_90 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_91, Add_92) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_93 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_94 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_95 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_96, Add_97) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_98 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_99 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_100 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_101, Add_102) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_103 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_104 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_105 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_106, Add_107) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_108 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_109 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_110 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_111, Add_112) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_113 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_114 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_115 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_116, Add_117) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_118 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: Slice_74 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_119 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_121 Weights: 0 HostPersistent: 2176 DevicePersistent: 141312 [TensorRT] VERBOSE: Layer: LeakyRelu_122 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_123 Weights: 0 HostPersistent: 1664 DevicePersistent: 2371072 [TensorRT] VERBOSE: Layer: LeakyRelu_124 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_125 Weights: 0 HostPersistent: 1664 DevicePersistent: 536064 [TensorRT] VERBOSE: Layer: LeakyRelu_126 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_126 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_139 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_140 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_141 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_142 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_143, Add_144) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_145 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_146 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_147 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_148, Add_149) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_150 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_151 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_152 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_153, Add_154) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_155 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_156 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_157 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_158, Add_159) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_160 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_161 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_162 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_163, Add_164) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_165 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_166 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_167 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_168, Add_169) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_170 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_171 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_172 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_173, Add_174) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_175 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_176 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_177 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_178, Add_179) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_180 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: Slice_136 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_181 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_183 Weights: 0 HostPersistent: 1664 DevicePersistent: 536064 [TensorRT] VERBOSE: Layer: LeakyRelu_184 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_185 Weights: 0 HostPersistent: 1664 DevicePersistent: 9458176 [TensorRT] VERBOSE: Layer: LeakyRelu_186 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_187 Weights: 0 HostPersistent: 1664 DevicePersistent: 2118144 [TensorRT] VERBOSE: Layer: LeakyRelu_188 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_188 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_201 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_202 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_203 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_204 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_205, Add_206) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_207 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_208 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_209 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_210, Add_211) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_212 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_213 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_214 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_215, Add_216) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_217 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_218 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_219 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_220, Add_221) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_222 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_198 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_223 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_225 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_225 Weights: 0 HostPersistent: 1664 DevicePersistent: 2118144 [TensorRT] VERBOSE: Layer: LeakyRelu_226 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: GlobalAveragePool_227 Weights: 0 HostPersistent: 16 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Flatten_228 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: head.fc.weight Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Gemm_229 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: (Unnamed Layer* 463) [Constant] + (Unnamed Layer* 464) [Shuffle] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: (Unnamed Layer* 465) [ElementWise] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Total Host Persistent Memory: 140916 [TensorRT] VERBOSE: Total Device Persistent Memory: 32944128 [TensorRT] VERBOSE: Total Weight Memory: 10747904 [TensorRT] VERBOSE: Builder timing cache: created 382 entries, 3841 hit(s) [TensorRT] VERBOSE: Engine generation completed in 123.428 seconds. [TensorRT] VERBOSE: Engine Layer Information: [TensorRT] VERBOSE: Layer(Reformat): Conv_0 input reformatter 0, Tactic: 0, input[Float(3,224,224)] -> Conv_0 reformatted input 0[Int8(3,224,224)] [TensorRT] VERBOSE: Layer(icudnn): Conv_0, Tactic: 8047041638267142825, Conv_0 reformatted input 0[Int8(3,224,224)] -> 742[Int8(32,224,224)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_1, Tactic: 22, 742[Int8(32,224,224)] -> 407[Int8(32,224,224)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_2, Tactic: -2102888629196925141, 407[Int8(32,224,224)] -> 745[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_3, Tactic: 16, 745[Int8(64,112,112)] -> 410[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(Reformat): Conv_4 input reformatter 0, Tactic: 0, 410[Int8(64,112,112)] -> Conv_4 reformatted input 0[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(icudnn): Conv_4, Tactic: 3145259992339075399, Conv_4 reformatted input 0[Int8(64,112,112)] -> 748[Int8(128,112,112)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_5 input reformatter 0, Tactic: 0, 748[Int8(128,112,112)] -> LeakyRelu_5 reformatted input 0[Float(128,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_5, Tactic: 4, LeakyRelu_5 reformatted input 0[Float(128,112,112)] -> 413[Float(128,112,112)] [TensorRT] VERBOSE: Layer(Reformat): Slice_18, Tactic: 0, 413[Float(64,112,112)] -> 434[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(icudnn): Conv_19, Tactic: 8047041638267142825, 434[Int8(64,112,112)] -> 751[Int8(32,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_20, Tactic: 10, 751[Int8(32,112,112)] -> 437[Int8(32,112,112)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_21, Tactic: -2102888629196925141, 437[Int8(32,112,112)] -> 754[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(Reformat): PWN(LeakyRelu_22, Add_23) input reformatter 0, Tactic: 0, 754[Int8(64,112,112)] -> PWN(LeakyRelu_22, Add_23) reformatted input 0[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_22, Add_23), Tactic: 3, PWN(LeakyRelu_22, Add_23) reformatted input 0[Int8(64,112,112)], 434[Int8(64,112,112)] -> 441[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(icudnn): Conv_24, Tactic: 3145259992339075399, 441[Int8(64,112,112)] -> 757[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(Reformat): Slice_15, Tactic: 0, 413[Float(64,112,112)] -> 445[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_25, Tactic: 3, 757[Int8(64,112,112)] -> 445[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(icudnn): Conv_27, Tactic: 2339361327868109050, 445[Int8(128,112,112)] -> 760[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_28, Tactic: 21, 760[Int8(64,112,112)] -> 448[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_29, Tactic: -182858804213663094, 448[Int8(64,112,112)] -> 763[Int8(128,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_30, Tactic: 10, 763[Int8(128,56,56)] -> 451[Int8(128,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_31, Tactic: 66319348402778770, 451[Int8(128,56,56)] -> 766[Int8(128,56,56)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_32 input reformatter 0, Tactic: 0, 766[Int8(128,56,56)] -> LeakyRelu_32 reformatted input 0[Float(128,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_32, Tactic: 2, LeakyRelu_32 reformatted input 0[Float(128,56,56)] -> 454[Float(128,56,56)] [TensorRT] VERBOSE: Layer(Reformat): Slice_45, Tactic: 0, 454[Float(64,56,56)] -> 475[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(icudnn): Conv_46, Tactic: 2339361327868109050, 475[Int8(64,56,56)] -> 769[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_47, Tactic: 27, 769[Int8(64,56,56)] -> 478[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_48, Tactic: -2102888629196925141, 478[Int8(64,56,56)] -> 772[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(Reformat): PWN(LeakyRelu_49, Add_50) input reformatter 1, Tactic: 0, 475[Int8(64,56,56)] -> PWN(LeakyRelu_49, Add_50) reformatted input 1[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_49, Add_50), Tactic: 21, 772[Int8(64,56,56)], PWN(LeakyRelu_49, Add_50) reformatted input 1[Int8(64,56,56)] -> 482[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_51, Tactic: 7039764449991095921, 482[Int8(64,56,56)] -> 775[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_52, Tactic: 27, 775[Int8(64,56,56)] -> 485[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_53, Tactic: -2102888629196925141, 485[Int8(64,56,56)] -> 778[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_54, Add_55), Tactic: 22, 778[Int8(64,56,56)], 482[Int8(64,56,56)] -> 489[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_56, Tactic: 7039764449991095921, 489[Int8(64,56,56)] -> 781[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(Reformat): Slice_42, Tactic: 1002, 454[Float(64,56,56)] -> 493[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_57, Tactic: 22, 781[Int8(64,56,56)] -> 493[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_59, Tactic: 66319348402778770, 493[Int8(128,56,56)] -> 784[Int8(128,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_60, Tactic: 10, 784[Int8(128,56,56)] -> 496[Int8(128,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_61, Tactic: -182858804213663094, 496[Int8(128,56,56)] -> 787[Int8(256,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_62, Tactic: 22, 787[Int8(256,28,28)] -> 499[Int8(256,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_63, Tactic: 2271687430539765460, 499[Int8(256,28,28)] -> 790[Int8(256,28,28)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_64 input reformatter 0, Tactic: 0, 790[Int8(256,28,28)] -> LeakyRelu_64 reformatted input 0[Float(256,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_64, Tactic: 5, LeakyRelu_64 reformatted input 0[Float(256,28,28)] -> 502[Float(256,28,28)] [TensorRT] VERBOSE: Layer(Reformat): Slice_77, Tactic: 1002, 502[Float(128,28,28)] -> 523[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_78, Tactic: 5754467717466343388, 523[Int8(128,28,28)] -> 793[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_79, Tactic: 26, 793[Int8(128,28,28)] -> 526[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_80, Tactic: -2102888629196925141, 526[Int8(128,28,28)] -> 796[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_81, Add_82), Tactic: 26, 796[Int8(128,28,28)], 523[Int8(128,28,28)] -> 530[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_83, Tactic: 5754467717466343388, 530[Int8(128,28,28)] -> 799[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_84, Tactic: 22, 799[Int8(128,28,28)] -> 533[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_85, Tactic: -2102888629196925141, 533[Int8(128,28,28)] -> 802[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_86, Add_87), Tactic: 26, 802[Int8(128,28,28)], 530[Int8(128,28,28)] -> 537[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_88, Tactic: 5754467717466343388, 537[Int8(128,28,28)] -> 805[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_89, Tactic: 21, 805[Int8(128,28,28)] -> 540[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_90, Tactic: -2102888629196925141, 540[Int8(128,28,28)] -> 808[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_91, Add_92), Tactic: 26, 808[Int8(128,28,28)], 537[Int8(128,28,28)] -> 544[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_93, Tactic: 5754467717466343388, 544[Int8(128,28,28)] -> 811[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_94, Tactic: 11, 811[Int8(128,28,28)] -> 547[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_95, Tactic: -2102888629196925141, 547[Int8(128,28,28)] -> 814[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_96, Add_97), Tactic: 26, 814[Int8(128,28,28)], 544[Int8(128,28,28)] -> 551[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_98, Tactic: 5754467717466343388, 551[Int8(128,28,28)] -> 817[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_99, Tactic: 21, 817[Int8(128,28,28)] -> 554[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_100, Tactic: -2102888629196925141, 554[Int8(128,28,28)] -> 820[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_101, Add_102), Tactic: 26, 820[Int8(128,28,28)], 551[Int8(128,28,28)] -> 558[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_103, Tactic: 5754467717466343388, 558[Int8(128,28,28)] -> 823[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_104, Tactic: 11, 823[Int8(128,28,28)] -> 561[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_105, Tactic: -2102888629196925141, 561[Int8(128,28,28)] -> 826[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_106, Add_107), Tactic: 26, 826[Int8(128,28,28)], 558[Int8(128,28,28)] -> 565[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_108, Tactic: 5754467717466343388, 565[Int8(128,28,28)] -> 829[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_109, Tactic: 11, 829[Int8(128,28,28)] -> 568[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_110, Tactic: -2102888629196925141, 568[Int8(128,28,28)] -> 832[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_111, Add_112), Tactic: 26, 832[Int8(128,28,28)], 565[Int8(128,28,28)] -> 572[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_113, Tactic: 5754467717466343388, 572[Int8(128,28,28)] -> 835[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_114, Tactic: 22, 835[Int8(128,28,28)] -> 575[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_115, Tactic: -2102888629196925141, 575[Int8(128,28,28)] -> 838[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_116, Add_117), Tactic: 21, 838[Int8(128,28,28)], 572[Int8(128,28,28)] -> 579[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_118, Tactic: 5754467717466343388, 579[Int8(128,28,28)] -> 841[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(Reformat): Slice_74, Tactic: 1002, 502[Float(128,28,28)] -> 583[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_119, Tactic: 10, 841[Int8(128,28,28)] -> 583[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_121, Tactic: 2271687430539765460, 583[Int8(256,28,28)] -> 844[Int8(256,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_122, Tactic: 27, 844[Int8(256,28,28)] -> 586[Int8(256,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_123, Tactic: -182858804213663094, 586[Int8(256,28,28)] -> 847[Int8(512,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_124, Tactic: 26, 847[Int8(512,14,14)] -> 589[Int8(512,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_125, Tactic: -182858804213663094, 589[Int8(512,14,14)] -> 850[Int8(512,14,14)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_126 input reformatter 0, Tactic: 0, 850[Int8(512,14,14)] -> LeakyRelu_126 reformatted input 0[Float(512,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_126, Tactic: 5, LeakyRelu_126 reformatted input 0[Float(512,14,14)] -> 592[Float(512,14,14)] [TensorRT] VERBOSE: Layer(Reformat): Slice_139, Tactic: 1002, 592[Float(256,14,14)] -> 613[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_140, Tactic: 7039764449991095921, 613[Int8(256,14,14)] -> 853[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_141, Tactic: 25, 853[Int8(256,14,14)] -> 616[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_142, Tactic: -2102888629196925141, 616[Int8(256,14,14)] -> 856[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_143, Add_144), Tactic: 25, 856[Int8(256,14,14)], 613[Int8(256,14,14)] -> 620[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_145, Tactic: 7039764449991095921, 620[Int8(256,14,14)] -> 859[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_146, Tactic: 24, 859[Int8(256,14,14)] -> 623[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_147, Tactic: -2102888629196925141, 623[Int8(256,14,14)] -> 862[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_148, Add_149), Tactic: 21, 862[Int8(256,14,14)], 620[Int8(256,14,14)] -> 627[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_150, Tactic: 7039764449991095921, 627[Int8(256,14,14)] -> 865[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_151, Tactic: 24, 865[Int8(256,14,14)] -> 630[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_152, Tactic: -2102888629196925141, 630[Int8(256,14,14)] -> 868[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_153, Add_154), Tactic: 25, 868[Int8(256,14,14)], 627[Int8(256,14,14)] -> 634[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_155, Tactic: 7039764449991095921, 634[Int8(256,14,14)] -> 871[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_156, Tactic: 10, 871[Int8(256,14,14)] -> 637[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_157, Tactic: -2102888629196925141, 637[Int8(256,14,14)] -> 874[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_158, Add_159), Tactic: 10, 874[Int8(256,14,14)], 634[Int8(256,14,14)] -> 641[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_160, Tactic: 7039764449991095921, 641[Int8(256,14,14)] -> 877[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_161, Tactic: 21, 877[Int8(256,14,14)] -> 644[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_162, Tactic: -2102888629196925141, 644[Int8(256,14,14)] -> 880[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_163, Add_164), Tactic: 25, 880[Int8(256,14,14)], 641[Int8(256,14,14)] -> 648[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_165, Tactic: 7039764449991095921, 648[Int8(256,14,14)] -> 883[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_166, Tactic: 21, 883[Int8(256,14,14)] -> 651[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_167, Tactic: -2102888629196925141, 651[Int8(256,14,14)] -> 886[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_168, Add_169), Tactic: 25, 886[Int8(256,14,14)], 648[Int8(256,14,14)] -> 655[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_170, Tactic: 7039764449991095921, 655[Int8(256,14,14)] -> 889[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_171, Tactic: 24, 889[Int8(256,14,14)] -> 658[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_172, Tactic: -2102888629196925141, 658[Int8(256,14,14)] -> 892[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_173, Add_174), Tactic: 21, 892[Int8(256,14,14)], 655[Int8(256,14,14)] -> 662[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_175, Tactic: 7039764449991095921, 662[Int8(256,14,14)] -> 895[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_176, Tactic: 20, 895[Int8(256,14,14)] -> 665[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_177, Tactic: -2102888629196925141, 665[Int8(256,14,14)] -> 898[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_178, Add_179), Tactic: 21, 898[Int8(256,14,14)], 662[Int8(256,14,14)] -> 669[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_180, Tactic: 7039764449991095921, 669[Int8(256,14,14)] -> 901[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(Reformat): Slice_136, Tactic: 1002, 592[Float(256,14,14)] -> 673[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_181, Tactic: 20, 901[Int8(256,14,14)] -> 673[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_183, Tactic: -182858804213663094, 673[Int8(512,14,14)] -> 904[Int8(512,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_184, Tactic: 20, 904[Int8(512,14,14)] -> 676[Int8(512,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_185, Tactic: -182858804213663094, 676[Int8(512,14,14)] -> 907[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_186, Tactic: 25, 907[Int8(1024,7,7)] -> 679[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_187, Tactic: -182858804213663094, 679[Int8(1024,7,7)] -> 910[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_188 input reformatter 0, Tactic: 0, 910[Int8(1024,7,7)] -> LeakyRelu_188 reformatted input 0[Float(1024,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_188, Tactic: 28, LeakyRelu_188 reformatted input 0[Float(1024,7,7)] -> 682[Float(1024,7,7)] [TensorRT] VERBOSE: Layer(Reformat): Slice_201, Tactic: 0, 682[Float(512,7,7)] -> 703[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_202, Tactic: 9568255, 703[Int8(512,7,7)] -> 913[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_203, Tactic: 5, 913[Int8(512,7,7)] -> 706[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_204, Tactic: 8847359, 706[Int8(512,7,7)] -> 916[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_205, Add_206), Tactic: 1, 916[Int8(512,7,7)], 703[Int8(512,7,7)] -> 710[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_207, Tactic: 9568255, 710[Int8(512,7,7)] -> 919[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_208, Tactic: 4, 919[Int8(512,7,7)] -> 713[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_209, Tactic: 8847359, 713[Int8(512,7,7)] -> 922[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_210, Add_211), Tactic: 9, 922[Int8(512,7,7)], 710[Int8(512,7,7)] -> 717[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_212, Tactic: 9568255, 717[Int8(512,7,7)] -> 925[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_213, Tactic: 28, 925[Int8(512,7,7)] -> 720[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_214, Tactic: 8847359, 720[Int8(512,7,7)] -> 928[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_215, Add_216), Tactic: 5, 928[Int8(512,7,7)], 717[Int8(512,7,7)] -> 724[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_217, Tactic: 9568255, 724[Int8(512,7,7)] -> 931[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_218, Tactic: 2, 931[Int8(512,7,7)] -> 727[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_219, Tactic: 8847359, 727[Int8(512,7,7)] -> 934[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_220, Add_221), Tactic: 2, 934[Int8(512,7,7)], 724[Int8(512,7,7)] -> 731[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_222, Tactic: 9568255, 731[Int8(512,7,7)] -> 937[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(Reformat): Slice_198, Tactic: 0, 682[Float(512,7,7)] -> 735[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_223, Tactic: 15, 937[Int8(512,7,7)] -> 735[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(Reformat): Conv_225 input reformatter 0, Tactic: 0, 735[Int8(1024,7,7)] -> Conv_225 reformatted input 0[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_225, Tactic: -182858804213663094, Conv_225 reformatted input 0[Int8(1024,7,7)] -> 940[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_226, Tactic: 25, 940[Int8(1024,7,7)] -> 738[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(Pooling): GlobalAveragePool_227, Tactic: -4, 738[Int8(1024,7,7)] -> 739[Int8(1024,1,1)] [TensorRT] VERBOSE: Layer(Reformat): Flatten_228 input reformatter 0, Tactic: 0, 739[Int8(1024,1,1)] -> Flatten_228 reformatted input 0[Float(1024,1,1)] [TensorRT] VERBOSE: Layer(Constant): head.fc.weight, Tactic: 0, -> (Unnamed Layer* 461) [Constant]_output[Float(3)] [TensorRT] VERBOSE: Layer(MatrixMultiply): Gemm_229, Tactic: 0, 740[Float(1024)], (Unnamed Layer* 461) [Constant]_output[Float(3)] -> (Unnamed Layer* 462) [Matrix Multiply]_output[Float(3)] [TensorRT] VERBOSE: Layer(Constant): (Unnamed Layer* 463) [Constant] + (Unnamed Layer* 464) [Shuffle], Tactic: 0, -> (Unnamed Layer* 464) [Shuffle]_output[Float(3)] [TensorRT] VERBOSE: Layer(ElementWise): (Unnamed Layer* 465) [ElementWise], Tactic: 1, (Unnamed Layer* 462) [Matrix Multiply]_output[Float(3)], (Unnamed Layer* 464) [Shuffle]_output[Float(3)] -> output[Float(3)] -1.8096583469986394 -0.16610018306308336 IMG (1, 3, 224, 224) -2.0494049107533874 1.9079738998413085 IMG (1, 3, 224, 224) -1.125350127794913 0.9816765889330202 IMG (1, 3, 224, 224) -1.672660324511049 1.1015498586096617 IMG (1, 3, 224, 224) -2.083654420442196 0.6879303995768228 IMG (1, 3, 224, 224) -2.1179039301310043 2.6399999999999997 IMG (1, 3, 224, 224) -1.7411593357548443 2.6399999999999997 IMG (1, 3, 224, 224) -2.0151554051314897 1.402527306874593 IMG (1, 3, 224, 224) -1.665010885000229 2.6225708071390788 IMG (1, 3, 224, 224) -1.7925335941876905 0.9667974853515624 IMG (1, 3, 224, 224) -1.6998692790004943 2.5179956499735514 IMG (1, 3, 224, 224) -2.0665296676312472 2.3235294180256982 IMG (1, 3, 224, 224) -1.1953781348254 0.9816765889330202 IMG (1, 3, 224, 224) -1.125350127794913 1.0330508473658666 IMG (1, 3, 224, 224) -2.1007791752866 2.3060224162680765 IMG (1, 3, 224, 224) -2.1007791752866 2.3060224162680765 IMG (1, 3, 224, 224) -2.083654420442196 0.7227887852986652 IMG (1, 3, 224, 224) -2.1179039301310043 -0.061525025897556 IMG (1, 3, 224, 224) -2.0322801579424388 2.1694117927551266 IMG (1, 3, 224, 224) -2.083654420442196 2.6051416142781574 IMG (1, 3, 224, 224) -2.0665296676312472 2.3235294180256982 IMG (1, 3, 224, 224) -2.1179039301310043 2.6225708071390788 IMG (1, 3, 224, 224) -2.0151554051314897 2.4482788785298664 IMG (1, 3, 224, 224) -2.1007791752866 2.50056645711263 IMG (1, 3, 224, 224) -2.0151554051314897 0.9667974853515624 IMG (1, 3, 224, 224) -1.9980306523205411 2.1519825998942057 IMG (1, 3, 224, 224) -1.2303921383406435 0.9816765889330202 IMG (1, 3, 224, 224) -2.0322801579424388 2.343703721364339 IMG (1, 3, 224, 224) -2.083654420442196 1.6988235855102538 IMG (1, 3, 224, 224) -2.1179039301310043 1.255672633908201 IMG (1, 3, 224, 224) -1.2303921383406435 0.9816765889330202 IMG (1, 3, 224, 224) -2.0665296676312472 2.587712421417236 IMG (1, 3, 224, 224) -2.0665296676312472 2.271008412752833 IMG (1, 3, 224, 224) -2.0494049107533874 2.34103641978332 IMG (1, 3, 224, 224) -2.0151554051314897 2.2391285641988117 IMG (1, 3, 224, 224) -2.0665296676312472 2.3235294180256982 IMG (1, 3, 224, 224) -2.1179039301310043 2.6225708071390788 IMG (1, 3, 224, 224) -2.083654420442196 2.3060224162680765 IMG (1, 3, 224, 224) -2.1007791752866 0.8622223281860351 IMG (1, 3, 224, 224) -1.2303921383406435 0.9816765889330202 IMG (1, 3, 224, 224) -2.0494049107533874 2.2885154145104547 IMG (1, 3, 224, 224) -2.0494049107533874 2.3060224162680765 IMG (1, 3, 224, 224) -2.0322801579424388 2.186840985616048 IMG (1, 3, 224, 224) -2.1179039301310043 2.570283228556315 IMG (1, 3, 224, 224) -2.0494049107533874 2.099695021311442 NO EXISTING CALIBRATION CACHE. PERFORM CALIBRATION