[TensorRT] VERBOSE: Registered plugin creator - ::GridAnchor_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::NMS_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Reorg_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Region_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Clip_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::LReLU_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::PriorBox_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Normalize_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::RPROI_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::BatchedNMS_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::FlattenConcat_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::CropAndResize version 1 [TensorRT] VERBOSE: Registered plugin creator - ::DetectionLayer_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Proposal version 1 [TensorRT] VERBOSE: Registered plugin creator - ::ProposalLayer_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::PyramidROIAlign_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::ResizeNearest_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Split version 1 [TensorRT] VERBOSE: Registered plugin creator - ::SpecialSlice_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::InstanceNormalization_TRT version 1 [TensorRT] VERBOSE: ModelImporter.cpp:202: Adding network input: input with dtype: float32, dimensions: (1, 3, 224, 224) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: input for ONNX tensor: input [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: head.fc.weight [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: head.fc.bias [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 743 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 744 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 746 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 747 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 749 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 750 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 752 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 753 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 755 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 756 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 758 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 759 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 761 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 762 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 764 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 765 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 767 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 768 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 770 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 771 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 773 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 774 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 776 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 777 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 779 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 780 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 782 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 783 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 785 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 786 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 788 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 789 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 791 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 792 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 794 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 795 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 797 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 798 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 800 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 801 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 803 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 804 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 806 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 807 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 809 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 810 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 812 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 813 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 815 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 816 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 818 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 819 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 821 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 822 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 824 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 825 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 827 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 828 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 830 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 831 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 833 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 834 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 836 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 837 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 839 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 840 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 842 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 843 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 845 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 846 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 848 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 849 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 851 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 852 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 854 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 855 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 857 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 858 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 860 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 861 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 863 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 864 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 866 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 867 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 869 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 870 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 872 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 873 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 875 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 876 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 878 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 879 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 881 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 882 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 884 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 885 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 887 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 888 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 890 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 891 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 893 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 894 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 896 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 897 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 899 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 900 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 902 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 903 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 905 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 906 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 908 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 909 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 911 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 912 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 914 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 915 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 917 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 918 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 920 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 921 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 923 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 924 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 926 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 927 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 929 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 930 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 932 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 933 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 935 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 936 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 938 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 939 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 941 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 942 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 943 [TensorRT] WARNING: onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 944 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 945 [TensorRT] VERBOSE: onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [TensorRT] WARNING: onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 946 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 947 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 948 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 949 [TensorRT] VERBOSE: onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [TensorRT] WARNING: onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 950 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 951 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 952 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 953 [TensorRT] VERBOSE: onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [TensorRT] WARNING: onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 954 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 955 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 956 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 957 [TensorRT] VERBOSE: onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [TensorRT] WARNING: onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 958 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 959 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 960 [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 961 [TensorRT] VERBOSE: onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [TensorRT] WARNING: onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped [TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: 962 [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_0 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: input [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 743 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 744 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_0 [Conv] inputs: [input -> (1, 3, 224, 224)], [743 -> (32, 3, 3, 3)], [744 -> (32)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (1, 3, 224, 224) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_0 for ONNX node: Conv_0 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (1, 32, 224, 224) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 742 for ONNX tensor: 742 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_0 [Conv] outputs: [742 -> (1, 32, 224, 224)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_1 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 742 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_1 [LeakyRelu] inputs: [742 -> (1, 32, 224, 224)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_1 for ONNX node: LeakyRelu_1 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 407 for ONNX tensor: 407 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_1 [LeakyRelu] outputs: [407 -> (1, 32, 224, 224)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_2 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 407 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 746 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 747 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_2 [Conv] inputs: [407 -> (1, 32, 224, 224)], [746 -> (64, 32, 3, 3)], [747 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (1, 32, 224, 224) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_2 for ONNX node: Conv_2 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 112, 112) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 745 for ONNX tensor: 745 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_2 [Conv] outputs: [745 -> (1, 64, 112, 112)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_3 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 745 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_3 [LeakyRelu] inputs: [745 -> (1, 64, 112, 112)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_3 for ONNX node: LeakyRelu_3 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 410 for ONNX tensor: 410 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_3 [LeakyRelu] outputs: [410 -> (1, 64, 112, 112)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_4 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 410 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 749 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 750 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_4 [Conv] inputs: [410 -> (1, 64, 112, 112)], [749 -> (128, 64, 1, 1)], [750 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 112, 112) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_4 for ONNX node: Conv_4 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 112, 112) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 748 for ONNX tensor: 748 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_4 [Conv] outputs: [748 -> (1, 128, 112, 112)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_5 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 748 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_5 [LeakyRelu] inputs: [748 -> (1, 128, 112, 112)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_5 for ONNX node: LeakyRelu_5 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 413 for ONNX tensor: 413 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_5 [LeakyRelu] outputs: [413 -> (1, 128, 112, 112)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Shape_6 [Shape] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 413 [TensorRT] VERBOSE: ModelImporter.cpp:125: Shape_6 [Shape] inputs: [413 -> (1, 128, 112, 112)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Shape_6 for ONNX node: Shape_6 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 414 for ONNX tensor: 414 [TensorRT] VERBOSE: ModelImporter.cpp:179: Shape_6 [Shape] outputs: [414 -> (4)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_7 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_7 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_7 [Constant] outputs: [415 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gather_8 [Gather] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 414 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 415 [TensorRT] VERBOSE: ModelImporter.cpp:125: Gather_8 [Gather] inputs: [414 -> (4)], [415 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:986: Using Gather axis: 0 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gather_8 for ONNX node: Gather_8 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 416 for ONNX tensor: 416 [TensorRT] VERBOSE: ModelImporter.cpp:179: Gather_8 [Gather] outputs: [416 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_9 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_9 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_9 [Constant] outputs: [417 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Div_10 [Div] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 416 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 417 [TensorRT] VERBOSE: ModelImporter.cpp:125: Div_10 [Div] inputs: [416 -> ()], [417 -> ()], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Div_10 for ONNX node: Div_10 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 418 for ONNX tensor: 418 [TensorRT] VERBOSE: ModelImporter.cpp:179: Div_10 [Div] outputs: [418 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_11 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 418 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_11 [Cast] inputs: [418 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_11 for ONNX node: Cast_11 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 419 for ONNX tensor: 419 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_11 [Cast] outputs: [419 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_12 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 419 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_12 [Cast] inputs: [419 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_12 for ONNX node: Cast_12 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 420 for ONNX tensor: 420 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_12 [Cast] outputs: [420 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_13 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 420 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_13 [Unsqueeze] inputs: [420 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_13 for ONNX node: Unsqueeze_13 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 424 for ONNX tensor: 424 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_13 [Unsqueeze] outputs: [424 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_14 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_14 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_14 [Constant] outputs: [426 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_15 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 413 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 943 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 424 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 944 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 426 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_15 [Slice] inputs: [413 -> (1, 128, 112, 112)], [943 -> (1)], [424 -> (1)], [944 -> (1)], [426 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_15 for ONNX node: Slice_15 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 427 for ONNX tensor: 427 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_15 [Slice] outputs: [427 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_16 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 420 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_16 [Unsqueeze] inputs: [420 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_16 for ONNX node: Unsqueeze_16 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 430 for ONNX tensor: 430 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_16 [Unsqueeze] outputs: [430 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_17 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_17 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_17 [Constant] outputs: [433 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_18 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 413 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 430 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 945 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 946 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 433 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_18 [Slice] inputs: [413 -> (1, 128, 112, 112)], [430 -> (1)], [945 -> (1)], [946 -> (1)], [433 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_18 for ONNX node: Slice_18 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 434 for ONNX tensor: 434 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_18 [Slice] outputs: [434 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_19 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 434 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 752 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 753 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_19 [Conv] inputs: [434 -> (-1, -1, -1, -1)], [752 -> (32, 64, 1, 1)], [753 -> (32)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_19 for ONNX node: Conv_19 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 32, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 751 for ONNX tensor: 751 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_19 [Conv] outputs: [751 -> (-1, 32, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_20 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 751 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_20 [LeakyRelu] inputs: [751 -> (-1, 32, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_20 for ONNX node: LeakyRelu_20 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 437 for ONNX tensor: 437 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_20 [LeakyRelu] outputs: [437 -> (-1, 32, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_21 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 437 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 755 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 756 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_21 [Conv] inputs: [437 -> (-1, 32, -1, -1)], [755 -> (64, 32, 3, 3)], [756 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 32, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_21 for ONNX node: Conv_21 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 754 for ONNX tensor: 754 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_21 [Conv] outputs: [754 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_22 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 754 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_22 [LeakyRelu] inputs: [754 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_22 for ONNX node: LeakyRelu_22 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 440 for ONNX tensor: 440 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_22 [LeakyRelu] outputs: [440 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_23 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 440 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 434 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_23 [Add] inputs: [440 -> (-1, 64, -1, -1)], [434 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_23 for ONNX node: Add_23 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 441 for ONNX tensor: 441 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_23 [Add] outputs: [441 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_24 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 441 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 758 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 759 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_24 [Conv] inputs: [441 -> (-1, 64, -1, -1)], [758 -> (64, 64, 1, 1)], [759 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_24 for ONNX node: Conv_24 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 757 for ONNX tensor: 757 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_24 [Conv] outputs: [757 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_25 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 757 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_25 [LeakyRelu] inputs: [757 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_25 for ONNX node: LeakyRelu_25 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 444 for ONNX tensor: 444 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_25 [LeakyRelu] outputs: [444 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Concat_26 [Concat] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 427 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 444 [TensorRT] VERBOSE: ModelImporter.cpp:125: Concat_26 [Concat] inputs: [427 -> (-1, -1, -1, -1)], [444 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Concat_26 for ONNX node: Concat_26 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 445 for ONNX tensor: 445 [TensorRT] VERBOSE: ModelImporter.cpp:179: Concat_26 [Concat] outputs: [445 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_27 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 445 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 761 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 762 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_27 [Conv] inputs: [445 -> (-1, -1, -1, -1)], [761 -> (64, 128, 1, 1)], [762 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_27 for ONNX node: Conv_27 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 760 for ONNX tensor: 760 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_27 [Conv] outputs: [760 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_28 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 760 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_28 [LeakyRelu] inputs: [760 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_28 for ONNX node: LeakyRelu_28 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 448 for ONNX tensor: 448 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_28 [LeakyRelu] outputs: [448 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_29 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 448 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 764 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 765 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_29 [Conv] inputs: [448 -> (-1, 64, -1, -1)], [764 -> (128, 64, 3, 3)], [765 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_29 for ONNX node: Conv_29 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 763 for ONNX tensor: 763 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_29 [Conv] outputs: [763 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_30 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 763 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_30 [LeakyRelu] inputs: [763 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_30 for ONNX node: LeakyRelu_30 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 451 for ONNX tensor: 451 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_30 [LeakyRelu] outputs: [451 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_31 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 451 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 767 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 768 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_31 [Conv] inputs: [451 -> (-1, 128, -1, -1)], [767 -> (128, 128, 1, 1)], [768 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_31 for ONNX node: Conv_31 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 766 for ONNX tensor: 766 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_31 [Conv] outputs: [766 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_32 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 766 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_32 [LeakyRelu] inputs: [766 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_32 for ONNX node: LeakyRelu_32 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 454 for ONNX tensor: 454 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_32 [LeakyRelu] outputs: [454 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Shape_33 [Shape] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 454 [TensorRT] VERBOSE: ModelImporter.cpp:125: Shape_33 [Shape] inputs: [454 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Shape_33 for ONNX node: Shape_33 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 455 for ONNX tensor: 455 [TensorRT] VERBOSE: ModelImporter.cpp:179: Shape_33 [Shape] outputs: [455 -> (4)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_34 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_34 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_34 [Constant] outputs: [456 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gather_35 [Gather] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 455 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 456 [TensorRT] VERBOSE: ModelImporter.cpp:125: Gather_35 [Gather] inputs: [455 -> (4)], [456 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:986: Using Gather axis: 0 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gather_35 for ONNX node: Gather_35 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 457 for ONNX tensor: 457 [TensorRT] VERBOSE: ModelImporter.cpp:179: Gather_35 [Gather] outputs: [457 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_36 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_36 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_36 [Constant] outputs: [458 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Div_37 [Div] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 457 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 458 [TensorRT] VERBOSE: ModelImporter.cpp:125: Div_37 [Div] inputs: [457 -> ()], [458 -> ()], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Div_37 for ONNX node: Div_37 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 459 for ONNX tensor: 459 [TensorRT] VERBOSE: ModelImporter.cpp:179: Div_37 [Div] outputs: [459 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_38 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 459 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_38 [Cast] inputs: [459 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_38 for ONNX node: Cast_38 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 460 for ONNX tensor: 460 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_38 [Cast] outputs: [460 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_39 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 460 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_39 [Cast] inputs: [460 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_39 for ONNX node: Cast_39 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 461 for ONNX tensor: 461 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_39 [Cast] outputs: [461 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_40 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 461 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_40 [Unsqueeze] inputs: [461 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_40 for ONNX node: Unsqueeze_40 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 465 for ONNX tensor: 465 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_40 [Unsqueeze] outputs: [465 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_41 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_41 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_41 [Constant] outputs: [467 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_42 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 454 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 947 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 465 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 948 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 467 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_42 [Slice] inputs: [454 -> (-1, 128, -1, -1)], [947 -> (1)], [465 -> (1)], [948 -> (1)], [467 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_42 for ONNX node: Slice_42 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 468 for ONNX tensor: 468 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_42 [Slice] outputs: [468 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_43 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 461 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_43 [Unsqueeze] inputs: [461 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_43 for ONNX node: Unsqueeze_43 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 471 for ONNX tensor: 471 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_43 [Unsqueeze] outputs: [471 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_44 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_44 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_44 [Constant] outputs: [474 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_45 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 454 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 471 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 949 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 950 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 474 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_45 [Slice] inputs: [454 -> (-1, 128, -1, -1)], [471 -> (1)], [949 -> (1)], [950 -> (1)], [474 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_45 for ONNX node: Slice_45 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 475 for ONNX tensor: 475 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_45 [Slice] outputs: [475 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_46 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 475 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 770 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 771 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_46 [Conv] inputs: [475 -> (-1, -1, -1, -1)], [770 -> (64, 64, 1, 1)], [771 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_46 for ONNX node: Conv_46 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 769 for ONNX tensor: 769 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_46 [Conv] outputs: [769 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_47 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 769 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_47 [LeakyRelu] inputs: [769 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_47 for ONNX node: LeakyRelu_47 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 478 for ONNX tensor: 478 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_47 [LeakyRelu] outputs: [478 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_48 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 478 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 773 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 774 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_48 [Conv] inputs: [478 -> (-1, 64, -1, -1)], [773 -> (64, 64, 3, 3)], [774 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_48 for ONNX node: Conv_48 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 772 for ONNX tensor: 772 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_48 [Conv] outputs: [772 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_49 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 772 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_49 [LeakyRelu] inputs: [772 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_49 for ONNX node: LeakyRelu_49 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 481 for ONNX tensor: 481 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_49 [LeakyRelu] outputs: [481 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_50 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 481 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 475 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_50 [Add] inputs: [481 -> (-1, 64, -1, -1)], [475 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_50 for ONNX node: Add_50 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 482 for ONNX tensor: 482 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_50 [Add] outputs: [482 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_51 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 482 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 776 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 777 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_51 [Conv] inputs: [482 -> (-1, 64, -1, -1)], [776 -> (64, 64, 1, 1)], [777 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_51 for ONNX node: Conv_51 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 775 for ONNX tensor: 775 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_51 [Conv] outputs: [775 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_52 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 775 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_52 [LeakyRelu] inputs: [775 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_52 for ONNX node: LeakyRelu_52 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 485 for ONNX tensor: 485 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_52 [LeakyRelu] outputs: [485 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_53 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 485 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 779 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 780 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_53 [Conv] inputs: [485 -> (-1, 64, -1, -1)], [779 -> (64, 64, 3, 3)], [780 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_53 for ONNX node: Conv_53 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 778 for ONNX tensor: 778 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_53 [Conv] outputs: [778 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_54 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 778 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_54 [LeakyRelu] inputs: [778 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_54 for ONNX node: LeakyRelu_54 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 488 for ONNX tensor: 488 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_54 [LeakyRelu] outputs: [488 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_55 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 488 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 482 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_55 [Add] inputs: [488 -> (-1, 64, -1, -1)], [482 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_55 for ONNX node: Add_55 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 489 for ONNX tensor: 489 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_55 [Add] outputs: [489 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_56 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 489 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 782 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 783 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_56 [Conv] inputs: [489 -> (-1, 64, -1, -1)], [782 -> (64, 64, 1, 1)], [783 -> (64)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_56 for ONNX node: Conv_56 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 64, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 781 for ONNX tensor: 781 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_56 [Conv] outputs: [781 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_57 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 781 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_57 [LeakyRelu] inputs: [781 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_57 for ONNX node: LeakyRelu_57 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 492 for ONNX tensor: 492 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_57 [LeakyRelu] outputs: [492 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Concat_58 [Concat] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 468 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 492 [TensorRT] VERBOSE: ModelImporter.cpp:125: Concat_58 [Concat] inputs: [468 -> (-1, -1, -1, -1)], [492 -> (-1, 64, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Concat_58 for ONNX node: Concat_58 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 493 for ONNX tensor: 493 [TensorRT] VERBOSE: ModelImporter.cpp:179: Concat_58 [Concat] outputs: [493 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_59 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 493 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 785 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 786 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_59 [Conv] inputs: [493 -> (-1, -1, -1, -1)], [785 -> (128, 128, 1, 1)], [786 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_59 for ONNX node: Conv_59 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 784 for ONNX tensor: 784 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_59 [Conv] outputs: [784 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_60 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 784 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_60 [LeakyRelu] inputs: [784 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_60 for ONNX node: LeakyRelu_60 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 496 for ONNX tensor: 496 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_60 [LeakyRelu] outputs: [496 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_61 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 496 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 788 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 789 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_61 [Conv] inputs: [496 -> (-1, 128, -1, -1)], [788 -> (256, 128, 3, 3)], [789 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_61 for ONNX node: Conv_61 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 787 for ONNX tensor: 787 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_61 [Conv] outputs: [787 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_62 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 787 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_62 [LeakyRelu] inputs: [787 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_62 for ONNX node: LeakyRelu_62 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 499 for ONNX tensor: 499 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_62 [LeakyRelu] outputs: [499 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_63 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 499 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 791 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 792 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_63 [Conv] inputs: [499 -> (-1, 256, -1, -1)], [791 -> (256, 256, 1, 1)], [792 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_63 for ONNX node: Conv_63 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 790 for ONNX tensor: 790 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_63 [Conv] outputs: [790 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_64 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 790 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_64 [LeakyRelu] inputs: [790 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_64 for ONNX node: LeakyRelu_64 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 502 for ONNX tensor: 502 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_64 [LeakyRelu] outputs: [502 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Shape_65 [Shape] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 502 [TensorRT] VERBOSE: ModelImporter.cpp:125: Shape_65 [Shape] inputs: [502 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Shape_65 for ONNX node: Shape_65 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 503 for ONNX tensor: 503 [TensorRT] VERBOSE: ModelImporter.cpp:179: Shape_65 [Shape] outputs: [503 -> (4)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_66 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_66 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_66 [Constant] outputs: [504 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gather_67 [Gather] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 503 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 504 [TensorRT] VERBOSE: ModelImporter.cpp:125: Gather_67 [Gather] inputs: [503 -> (4)], [504 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:986: Using Gather axis: 0 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gather_67 for ONNX node: Gather_67 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 505 for ONNX tensor: 505 [TensorRT] VERBOSE: ModelImporter.cpp:179: Gather_67 [Gather] outputs: [505 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_68 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_68 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_68 [Constant] outputs: [506 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Div_69 [Div] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 505 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 506 [TensorRT] VERBOSE: ModelImporter.cpp:125: Div_69 [Div] inputs: [505 -> ()], [506 -> ()], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Div_69 for ONNX node: Div_69 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 507 for ONNX tensor: 507 [TensorRT] VERBOSE: ModelImporter.cpp:179: Div_69 [Div] outputs: [507 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_70 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 507 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_70 [Cast] inputs: [507 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_70 for ONNX node: Cast_70 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 508 for ONNX tensor: 508 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_70 [Cast] outputs: [508 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_71 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 508 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_71 [Cast] inputs: [508 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_71 for ONNX node: Cast_71 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 509 for ONNX tensor: 509 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_71 [Cast] outputs: [509 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_72 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 509 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_72 [Unsqueeze] inputs: [509 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_72 for ONNX node: Unsqueeze_72 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 513 for ONNX tensor: 513 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_72 [Unsqueeze] outputs: [513 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_73 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_73 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_73 [Constant] outputs: [515 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_74 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 502 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 951 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 513 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 952 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 515 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_74 [Slice] inputs: [502 -> (-1, 256, -1, -1)], [951 -> (1)], [513 -> (1)], [952 -> (1)], [515 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_74 for ONNX node: Slice_74 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 516 for ONNX tensor: 516 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_74 [Slice] outputs: [516 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_75 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 509 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_75 [Unsqueeze] inputs: [509 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_75 for ONNX node: Unsqueeze_75 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 519 for ONNX tensor: 519 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_75 [Unsqueeze] outputs: [519 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_76 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_76 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_76 [Constant] outputs: [522 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_77 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 502 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 519 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 953 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 954 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 522 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_77 [Slice] inputs: [502 -> (-1, 256, -1, -1)], [519 -> (1)], [953 -> (1)], [954 -> (1)], [522 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_77 for ONNX node: Slice_77 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 523 for ONNX tensor: 523 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_77 [Slice] outputs: [523 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_78 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 523 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 794 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 795 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_78 [Conv] inputs: [523 -> (-1, -1, -1, -1)], [794 -> (128, 128, 1, 1)], [795 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_78 for ONNX node: Conv_78 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 793 for ONNX tensor: 793 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_78 [Conv] outputs: [793 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_79 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 793 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_79 [LeakyRelu] inputs: [793 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_79 for ONNX node: LeakyRelu_79 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 526 for ONNX tensor: 526 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_79 [LeakyRelu] outputs: [526 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_80 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 526 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 797 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 798 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_80 [Conv] inputs: [526 -> (-1, 128, -1, -1)], [797 -> (128, 128, 3, 3)], [798 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_80 for ONNX node: Conv_80 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 796 for ONNX tensor: 796 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_80 [Conv] outputs: [796 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_81 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 796 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_81 [LeakyRelu] inputs: [796 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_81 for ONNX node: LeakyRelu_81 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 529 for ONNX tensor: 529 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_81 [LeakyRelu] outputs: [529 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_82 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 529 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 523 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_82 [Add] inputs: [529 -> (-1, 128, -1, -1)], [523 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_82 for ONNX node: Add_82 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 530 for ONNX tensor: 530 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_82 [Add] outputs: [530 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_83 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 530 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 800 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 801 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_83 [Conv] inputs: [530 -> (-1, 128, -1, -1)], [800 -> (128, 128, 1, 1)], [801 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_83 for ONNX node: Conv_83 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 799 for ONNX tensor: 799 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_83 [Conv] outputs: [799 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_84 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 799 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_84 [LeakyRelu] inputs: [799 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_84 for ONNX node: LeakyRelu_84 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 533 for ONNX tensor: 533 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_84 [LeakyRelu] outputs: [533 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_85 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 533 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 803 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 804 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_85 [Conv] inputs: [533 -> (-1, 128, -1, -1)], [803 -> (128, 128, 3, 3)], [804 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_85 for ONNX node: Conv_85 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 802 for ONNX tensor: 802 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_85 [Conv] outputs: [802 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_86 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 802 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_86 [LeakyRelu] inputs: [802 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_86 for ONNX node: LeakyRelu_86 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 536 for ONNX tensor: 536 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_86 [LeakyRelu] outputs: [536 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_87 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 536 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 530 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_87 [Add] inputs: [536 -> (-1, 128, -1, -1)], [530 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_87 for ONNX node: Add_87 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 537 for ONNX tensor: 537 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_87 [Add] outputs: [537 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_88 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 537 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 806 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 807 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_88 [Conv] inputs: [537 -> (-1, 128, -1, -1)], [806 -> (128, 128, 1, 1)], [807 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_88 for ONNX node: Conv_88 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 805 for ONNX tensor: 805 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_88 [Conv] outputs: [805 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_89 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 805 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_89 [LeakyRelu] inputs: [805 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_89 for ONNX node: LeakyRelu_89 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 540 for ONNX tensor: 540 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_89 [LeakyRelu] outputs: [540 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_90 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 540 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 809 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 810 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_90 [Conv] inputs: [540 -> (-1, 128, -1, -1)], [809 -> (128, 128, 3, 3)], [810 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_90 for ONNX node: Conv_90 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 808 for ONNX tensor: 808 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_90 [Conv] outputs: [808 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_91 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 808 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_91 [LeakyRelu] inputs: [808 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_91 for ONNX node: LeakyRelu_91 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 543 for ONNX tensor: 543 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_91 [LeakyRelu] outputs: [543 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_92 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 543 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 537 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_92 [Add] inputs: [543 -> (-1, 128, -1, -1)], [537 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_92 for ONNX node: Add_92 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 544 for ONNX tensor: 544 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_92 [Add] outputs: [544 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_93 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 544 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 812 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 813 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_93 [Conv] inputs: [544 -> (-1, 128, -1, -1)], [812 -> (128, 128, 1, 1)], [813 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_93 for ONNX node: Conv_93 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 811 for ONNX tensor: 811 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_93 [Conv] outputs: [811 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_94 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 811 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_94 [LeakyRelu] inputs: [811 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_94 for ONNX node: LeakyRelu_94 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 547 for ONNX tensor: 547 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_94 [LeakyRelu] outputs: [547 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_95 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 547 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 815 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 816 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_95 [Conv] inputs: [547 -> (-1, 128, -1, -1)], [815 -> (128, 128, 3, 3)], [816 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_95 for ONNX node: Conv_95 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 814 for ONNX tensor: 814 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_95 [Conv] outputs: [814 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_96 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 814 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_96 [LeakyRelu] inputs: [814 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_96 for ONNX node: LeakyRelu_96 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 550 for ONNX tensor: 550 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_96 [LeakyRelu] outputs: [550 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_97 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 550 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 544 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_97 [Add] inputs: [550 -> (-1, 128, -1, -1)], [544 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_97 for ONNX node: Add_97 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 551 for ONNX tensor: 551 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_97 [Add] outputs: [551 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_98 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 551 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 818 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 819 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_98 [Conv] inputs: [551 -> (-1, 128, -1, -1)], [818 -> (128, 128, 1, 1)], [819 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_98 for ONNX node: Conv_98 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 817 for ONNX tensor: 817 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_98 [Conv] outputs: [817 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_99 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 817 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_99 [LeakyRelu] inputs: [817 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_99 for ONNX node: LeakyRelu_99 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 554 for ONNX tensor: 554 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_99 [LeakyRelu] outputs: [554 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_100 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 554 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 821 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 822 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_100 [Conv] inputs: [554 -> (-1, 128, -1, -1)], [821 -> (128, 128, 3, 3)], [822 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_100 for ONNX node: Conv_100 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 820 for ONNX tensor: 820 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_100 [Conv] outputs: [820 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_101 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 820 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_101 [LeakyRelu] inputs: [820 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_101 for ONNX node: LeakyRelu_101 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 557 for ONNX tensor: 557 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_101 [LeakyRelu] outputs: [557 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_102 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 557 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 551 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_102 [Add] inputs: [557 -> (-1, 128, -1, -1)], [551 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_102 for ONNX node: Add_102 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 558 for ONNX tensor: 558 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_102 [Add] outputs: [558 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_103 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 558 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 824 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 825 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_103 [Conv] inputs: [558 -> (-1, 128, -1, -1)], [824 -> (128, 128, 1, 1)], [825 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_103 for ONNX node: Conv_103 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 823 for ONNX tensor: 823 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_103 [Conv] outputs: [823 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_104 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 823 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_104 [LeakyRelu] inputs: [823 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_104 for ONNX node: LeakyRelu_104 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 561 for ONNX tensor: 561 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_104 [LeakyRelu] outputs: [561 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_105 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 561 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 827 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 828 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_105 [Conv] inputs: [561 -> (-1, 128, -1, -1)], [827 -> (128, 128, 3, 3)], [828 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_105 for ONNX node: Conv_105 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 826 for ONNX tensor: 826 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_105 [Conv] outputs: [826 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_106 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 826 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_106 [LeakyRelu] inputs: [826 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_106 for ONNX node: LeakyRelu_106 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 564 for ONNX tensor: 564 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_106 [LeakyRelu] outputs: [564 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_107 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 564 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 558 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_107 [Add] inputs: [564 -> (-1, 128, -1, -1)], [558 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_107 for ONNX node: Add_107 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 565 for ONNX tensor: 565 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_107 [Add] outputs: [565 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_108 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 565 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 830 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 831 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_108 [Conv] inputs: [565 -> (-1, 128, -1, -1)], [830 -> (128, 128, 1, 1)], [831 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_108 for ONNX node: Conv_108 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 829 for ONNX tensor: 829 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_108 [Conv] outputs: [829 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_109 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 829 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_109 [LeakyRelu] inputs: [829 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_109 for ONNX node: LeakyRelu_109 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 568 for ONNX tensor: 568 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_109 [LeakyRelu] outputs: [568 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_110 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 568 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 833 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 834 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_110 [Conv] inputs: [568 -> (-1, 128, -1, -1)], [833 -> (128, 128, 3, 3)], [834 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_110 for ONNX node: Conv_110 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 832 for ONNX tensor: 832 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_110 [Conv] outputs: [832 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_111 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 832 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_111 [LeakyRelu] inputs: [832 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_111 for ONNX node: LeakyRelu_111 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 571 for ONNX tensor: 571 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_111 [LeakyRelu] outputs: [571 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_112 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 571 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 565 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_112 [Add] inputs: [571 -> (-1, 128, -1, -1)], [565 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_112 for ONNX node: Add_112 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 572 for ONNX tensor: 572 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_112 [Add] outputs: [572 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_113 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 572 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 836 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 837 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_113 [Conv] inputs: [572 -> (-1, 128, -1, -1)], [836 -> (128, 128, 1, 1)], [837 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_113 for ONNX node: Conv_113 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 835 for ONNX tensor: 835 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_113 [Conv] outputs: [835 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_114 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 835 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_114 [LeakyRelu] inputs: [835 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_114 for ONNX node: LeakyRelu_114 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 575 for ONNX tensor: 575 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_114 [LeakyRelu] outputs: [575 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_115 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 575 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 839 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 840 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_115 [Conv] inputs: [575 -> (-1, 128, -1, -1)], [839 -> (128, 128, 3, 3)], [840 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_115 for ONNX node: Conv_115 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 838 for ONNX tensor: 838 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_115 [Conv] outputs: [838 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_116 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 838 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_116 [LeakyRelu] inputs: [838 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_116 for ONNX node: LeakyRelu_116 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 578 for ONNX tensor: 578 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_116 [LeakyRelu] outputs: [578 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_117 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 578 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 572 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_117 [Add] inputs: [578 -> (-1, 128, -1, -1)], [572 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_117 for ONNX node: Add_117 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 579 for ONNX tensor: 579 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_117 [Add] outputs: [579 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_118 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 579 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 842 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 843 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_118 [Conv] inputs: [579 -> (-1, 128, -1, -1)], [842 -> (128, 128, 1, 1)], [843 -> (128)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_118 for ONNX node: Conv_118 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 128, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 841 for ONNX tensor: 841 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_118 [Conv] outputs: [841 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_119 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 841 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_119 [LeakyRelu] inputs: [841 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_119 for ONNX node: LeakyRelu_119 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 582 for ONNX tensor: 582 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_119 [LeakyRelu] outputs: [582 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Concat_120 [Concat] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 516 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 582 [TensorRT] VERBOSE: ModelImporter.cpp:125: Concat_120 [Concat] inputs: [516 -> (-1, -1, -1, -1)], [582 -> (-1, 128, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Concat_120 for ONNX node: Concat_120 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 583 for ONNX tensor: 583 [TensorRT] VERBOSE: ModelImporter.cpp:179: Concat_120 [Concat] outputs: [583 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_121 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 583 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 845 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 846 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_121 [Conv] inputs: [583 -> (-1, -1, -1, -1)], [845 -> (256, 256, 1, 1)], [846 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_121 for ONNX node: Conv_121 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 844 for ONNX tensor: 844 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_121 [Conv] outputs: [844 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_122 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 844 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_122 [LeakyRelu] inputs: [844 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_122 for ONNX node: LeakyRelu_122 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 586 for ONNX tensor: 586 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_122 [LeakyRelu] outputs: [586 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_123 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 586 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 848 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 849 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_123 [Conv] inputs: [586 -> (-1, 256, -1, -1)], [848 -> (512, 256, 3, 3)], [849 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_123 for ONNX node: Conv_123 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 847 for ONNX tensor: 847 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_123 [Conv] outputs: [847 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_124 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 847 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_124 [LeakyRelu] inputs: [847 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_124 for ONNX node: LeakyRelu_124 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 589 for ONNX tensor: 589 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_124 [LeakyRelu] outputs: [589 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_125 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 589 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 851 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 852 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_125 [Conv] inputs: [589 -> (-1, 512, -1, -1)], [851 -> (512, 512, 1, 1)], [852 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_125 for ONNX node: Conv_125 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 850 for ONNX tensor: 850 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_125 [Conv] outputs: [850 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_126 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 850 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_126 [LeakyRelu] inputs: [850 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_126 for ONNX node: LeakyRelu_126 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 592 for ONNX tensor: 592 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_126 [LeakyRelu] outputs: [592 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Shape_127 [Shape] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 592 [TensorRT] VERBOSE: ModelImporter.cpp:125: Shape_127 [Shape] inputs: [592 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Shape_127 for ONNX node: Shape_127 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 593 for ONNX tensor: 593 [TensorRT] VERBOSE: ModelImporter.cpp:179: Shape_127 [Shape] outputs: [593 -> (4)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_128 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_128 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_128 [Constant] outputs: [594 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gather_129 [Gather] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 593 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 594 [TensorRT] VERBOSE: ModelImporter.cpp:125: Gather_129 [Gather] inputs: [593 -> (4)], [594 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:986: Using Gather axis: 0 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gather_129 for ONNX node: Gather_129 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 595 for ONNX tensor: 595 [TensorRT] VERBOSE: ModelImporter.cpp:179: Gather_129 [Gather] outputs: [595 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_130 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_130 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_130 [Constant] outputs: [596 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Div_131 [Div] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 595 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 596 [TensorRT] VERBOSE: ModelImporter.cpp:125: Div_131 [Div] inputs: [595 -> ()], [596 -> ()], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Div_131 for ONNX node: Div_131 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 597 for ONNX tensor: 597 [TensorRT] VERBOSE: ModelImporter.cpp:179: Div_131 [Div] outputs: [597 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_132 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 597 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_132 [Cast] inputs: [597 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_132 for ONNX node: Cast_132 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 598 for ONNX tensor: 598 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_132 [Cast] outputs: [598 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_133 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 598 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_133 [Cast] inputs: [598 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_133 for ONNX node: Cast_133 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 599 for ONNX tensor: 599 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_133 [Cast] outputs: [599 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_134 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 599 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_134 [Unsqueeze] inputs: [599 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_134 for ONNX node: Unsqueeze_134 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 603 for ONNX tensor: 603 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_134 [Unsqueeze] outputs: [603 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_135 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_135 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_135 [Constant] outputs: [605 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_136 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 592 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 955 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 603 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 956 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 605 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_136 [Slice] inputs: [592 -> (-1, 512, -1, -1)], [955 -> (1)], [603 -> (1)], [956 -> (1)], [605 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_136 for ONNX node: Slice_136 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 606 for ONNX tensor: 606 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_136 [Slice] outputs: [606 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_137 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 599 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_137 [Unsqueeze] inputs: [599 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_137 for ONNX node: Unsqueeze_137 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 609 for ONNX tensor: 609 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_137 [Unsqueeze] outputs: [609 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_138 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_138 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_138 [Constant] outputs: [612 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_139 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 592 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 609 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 957 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 958 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 612 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_139 [Slice] inputs: [592 -> (-1, 512, -1, -1)], [609 -> (1)], [957 -> (1)], [958 -> (1)], [612 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_139 for ONNX node: Slice_139 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 613 for ONNX tensor: 613 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_139 [Slice] outputs: [613 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_140 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 613 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 854 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 855 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_140 [Conv] inputs: [613 -> (-1, -1, -1, -1)], [854 -> (256, 256, 1, 1)], [855 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_140 for ONNX node: Conv_140 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 853 for ONNX tensor: 853 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_140 [Conv] outputs: [853 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_141 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 853 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_141 [LeakyRelu] inputs: [853 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_141 for ONNX node: LeakyRelu_141 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 616 for ONNX tensor: 616 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_141 [LeakyRelu] outputs: [616 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_142 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 616 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 857 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 858 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_142 [Conv] inputs: [616 -> (-1, 256, -1, -1)], [857 -> (256, 256, 3, 3)], [858 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_142 for ONNX node: Conv_142 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 856 for ONNX tensor: 856 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_142 [Conv] outputs: [856 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_143 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 856 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_143 [LeakyRelu] inputs: [856 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_143 for ONNX node: LeakyRelu_143 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 619 for ONNX tensor: 619 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_143 [LeakyRelu] outputs: [619 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_144 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 619 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 613 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_144 [Add] inputs: [619 -> (-1, 256, -1, -1)], [613 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_144 for ONNX node: Add_144 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 620 for ONNX tensor: 620 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_144 [Add] outputs: [620 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_145 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 620 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 860 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 861 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_145 [Conv] inputs: [620 -> (-1, 256, -1, -1)], [860 -> (256, 256, 1, 1)], [861 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_145 for ONNX node: Conv_145 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 859 for ONNX tensor: 859 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_145 [Conv] outputs: [859 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_146 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 859 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_146 [LeakyRelu] inputs: [859 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_146 for ONNX node: LeakyRelu_146 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 623 for ONNX tensor: 623 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_146 [LeakyRelu] outputs: [623 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_147 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 623 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 863 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 864 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_147 [Conv] inputs: [623 -> (-1, 256, -1, -1)], [863 -> (256, 256, 3, 3)], [864 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_147 for ONNX node: Conv_147 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 862 for ONNX tensor: 862 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_147 [Conv] outputs: [862 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_148 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 862 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_148 [LeakyRelu] inputs: [862 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_148 for ONNX node: LeakyRelu_148 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 626 for ONNX tensor: 626 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_148 [LeakyRelu] outputs: [626 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_149 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 626 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 620 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_149 [Add] inputs: [626 -> (-1, 256, -1, -1)], [620 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_149 for ONNX node: Add_149 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 627 for ONNX tensor: 627 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_149 [Add] outputs: [627 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_150 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 627 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 866 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 867 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_150 [Conv] inputs: [627 -> (-1, 256, -1, -1)], [866 -> (256, 256, 1, 1)], [867 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_150 for ONNX node: Conv_150 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 865 for ONNX tensor: 865 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_150 [Conv] outputs: [865 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_151 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 865 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_151 [LeakyRelu] inputs: [865 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_151 for ONNX node: LeakyRelu_151 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 630 for ONNX tensor: 630 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_151 [LeakyRelu] outputs: [630 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_152 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 630 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 869 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 870 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_152 [Conv] inputs: [630 -> (-1, 256, -1, -1)], [869 -> (256, 256, 3, 3)], [870 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_152 for ONNX node: Conv_152 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 868 for ONNX tensor: 868 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_152 [Conv] outputs: [868 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_153 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 868 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_153 [LeakyRelu] inputs: [868 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_153 for ONNX node: LeakyRelu_153 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 633 for ONNX tensor: 633 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_153 [LeakyRelu] outputs: [633 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_154 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 633 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 627 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_154 [Add] inputs: [633 -> (-1, 256, -1, -1)], [627 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_154 for ONNX node: Add_154 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 634 for ONNX tensor: 634 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_154 [Add] outputs: [634 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_155 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 634 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 872 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 873 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_155 [Conv] inputs: [634 -> (-1, 256, -1, -1)], [872 -> (256, 256, 1, 1)], [873 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_155 for ONNX node: Conv_155 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 871 for ONNX tensor: 871 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_155 [Conv] outputs: [871 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_156 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 871 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_156 [LeakyRelu] inputs: [871 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_156 for ONNX node: LeakyRelu_156 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 637 for ONNX tensor: 637 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_156 [LeakyRelu] outputs: [637 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_157 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 637 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 875 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 876 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_157 [Conv] inputs: [637 -> (-1, 256, -1, -1)], [875 -> (256, 256, 3, 3)], [876 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_157 for ONNX node: Conv_157 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 874 for ONNX tensor: 874 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_157 [Conv] outputs: [874 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_158 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 874 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_158 [LeakyRelu] inputs: [874 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_158 for ONNX node: LeakyRelu_158 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 640 for ONNX tensor: 640 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_158 [LeakyRelu] outputs: [640 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_159 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 640 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 634 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_159 [Add] inputs: [640 -> (-1, 256, -1, -1)], [634 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_159 for ONNX node: Add_159 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 641 for ONNX tensor: 641 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_159 [Add] outputs: [641 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_160 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 641 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 878 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 879 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_160 [Conv] inputs: [641 -> (-1, 256, -1, -1)], [878 -> (256, 256, 1, 1)], [879 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_160 for ONNX node: Conv_160 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 877 for ONNX tensor: 877 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_160 [Conv] outputs: [877 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_161 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 877 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_161 [LeakyRelu] inputs: [877 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_161 for ONNX node: LeakyRelu_161 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 644 for ONNX tensor: 644 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_161 [LeakyRelu] outputs: [644 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_162 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 644 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 881 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 882 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_162 [Conv] inputs: [644 -> (-1, 256, -1, -1)], [881 -> (256, 256, 3, 3)], [882 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_162 for ONNX node: Conv_162 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 880 for ONNX tensor: 880 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_162 [Conv] outputs: [880 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_163 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 880 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_163 [LeakyRelu] inputs: [880 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_163 for ONNX node: LeakyRelu_163 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 647 for ONNX tensor: 647 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_163 [LeakyRelu] outputs: [647 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_164 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 647 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 641 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_164 [Add] inputs: [647 -> (-1, 256, -1, -1)], [641 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_164 for ONNX node: Add_164 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 648 for ONNX tensor: 648 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_164 [Add] outputs: [648 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_165 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 648 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 884 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 885 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_165 [Conv] inputs: [648 -> (-1, 256, -1, -1)], [884 -> (256, 256, 1, 1)], [885 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_165 for ONNX node: Conv_165 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 883 for ONNX tensor: 883 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_165 [Conv] outputs: [883 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_166 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 883 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_166 [LeakyRelu] inputs: [883 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_166 for ONNX node: LeakyRelu_166 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 651 for ONNX tensor: 651 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_166 [LeakyRelu] outputs: [651 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_167 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 651 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 887 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 888 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_167 [Conv] inputs: [651 -> (-1, 256, -1, -1)], [887 -> (256, 256, 3, 3)], [888 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_167 for ONNX node: Conv_167 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 886 for ONNX tensor: 886 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_167 [Conv] outputs: [886 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_168 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 886 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_168 [LeakyRelu] inputs: [886 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_168 for ONNX node: LeakyRelu_168 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 654 for ONNX tensor: 654 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_168 [LeakyRelu] outputs: [654 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_169 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 654 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 648 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_169 [Add] inputs: [654 -> (-1, 256, -1, -1)], [648 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_169 for ONNX node: Add_169 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 655 for ONNX tensor: 655 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_169 [Add] outputs: [655 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_170 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 655 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 890 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 891 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_170 [Conv] inputs: [655 -> (-1, 256, -1, -1)], [890 -> (256, 256, 1, 1)], [891 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_170 for ONNX node: Conv_170 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 889 for ONNX tensor: 889 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_170 [Conv] outputs: [889 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_171 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 889 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_171 [LeakyRelu] inputs: [889 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_171 for ONNX node: LeakyRelu_171 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 658 for ONNX tensor: 658 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_171 [LeakyRelu] outputs: [658 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_172 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 658 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 893 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 894 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_172 [Conv] inputs: [658 -> (-1, 256, -1, -1)], [893 -> (256, 256, 3, 3)], [894 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_172 for ONNX node: Conv_172 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 892 for ONNX tensor: 892 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_172 [Conv] outputs: [892 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_173 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 892 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_173 [LeakyRelu] inputs: [892 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_173 for ONNX node: LeakyRelu_173 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 661 for ONNX tensor: 661 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_173 [LeakyRelu] outputs: [661 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_174 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 661 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 655 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_174 [Add] inputs: [661 -> (-1, 256, -1, -1)], [655 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_174 for ONNX node: Add_174 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 662 for ONNX tensor: 662 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_174 [Add] outputs: [662 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_175 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 662 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 896 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 897 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_175 [Conv] inputs: [662 -> (-1, 256, -1, -1)], [896 -> (256, 256, 1, 1)], [897 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_175 for ONNX node: Conv_175 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 895 for ONNX tensor: 895 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_175 [Conv] outputs: [895 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_176 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 895 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_176 [LeakyRelu] inputs: [895 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_176 for ONNX node: LeakyRelu_176 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 665 for ONNX tensor: 665 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_176 [LeakyRelu] outputs: [665 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_177 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 665 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 899 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 900 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_177 [Conv] inputs: [665 -> (-1, 256, -1, -1)], [899 -> (256, 256, 3, 3)], [900 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_177 for ONNX node: Conv_177 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 898 for ONNX tensor: 898 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_177 [Conv] outputs: [898 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_178 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 898 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_178 [LeakyRelu] inputs: [898 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_178 for ONNX node: LeakyRelu_178 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 668 for ONNX tensor: 668 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_178 [LeakyRelu] outputs: [668 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_179 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 668 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 662 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_179 [Add] inputs: [668 -> (-1, 256, -1, -1)], [662 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_179 for ONNX node: Add_179 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 669 for ONNX tensor: 669 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_179 [Add] outputs: [669 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_180 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 669 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 902 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 903 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_180 [Conv] inputs: [669 -> (-1, 256, -1, -1)], [902 -> (256, 256, 1, 1)], [903 -> (256)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_180 for ONNX node: Conv_180 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 901 for ONNX tensor: 901 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_180 [Conv] outputs: [901 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_181 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 901 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_181 [LeakyRelu] inputs: [901 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_181 for ONNX node: LeakyRelu_181 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 672 for ONNX tensor: 672 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_181 [LeakyRelu] outputs: [672 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Concat_182 [Concat] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 606 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 672 [TensorRT] VERBOSE: ModelImporter.cpp:125: Concat_182 [Concat] inputs: [606 -> (-1, -1, -1, -1)], [672 -> (-1, 256, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Concat_182 for ONNX node: Concat_182 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 673 for ONNX tensor: 673 [TensorRT] VERBOSE: ModelImporter.cpp:179: Concat_182 [Concat] outputs: [673 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_183 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 673 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 905 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 906 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_183 [Conv] inputs: [673 -> (-1, -1, -1, -1)], [905 -> (512, 512, 1, 1)], [906 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_183 for ONNX node: Conv_183 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 904 for ONNX tensor: 904 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_183 [Conv] outputs: [904 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_184 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 904 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_184 [LeakyRelu] inputs: [904 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_184 for ONNX node: LeakyRelu_184 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 676 for ONNX tensor: 676 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_184 [LeakyRelu] outputs: [676 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_185 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 676 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 908 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 909 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_185 [Conv] inputs: [676 -> (-1, 512, -1, -1)], [908 -> (1024, 512, 3, 3)], [909 -> (1024)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_185 for ONNX node: Conv_185 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1024 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 1024, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 907 for ONNX tensor: 907 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_185 [Conv] outputs: [907 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_186 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 907 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_186 [LeakyRelu] inputs: [907 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_186 for ONNX node: LeakyRelu_186 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 679 for ONNX tensor: 679 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_186 [LeakyRelu] outputs: [679 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_187 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 679 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 911 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 912 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_187 [Conv] inputs: [679 -> (-1, 1024, -1, -1)], [911 -> (1024, 1024, 1, 1)], [912 -> (1024)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 1024, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_187 for ONNX node: Conv_187 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 1024, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 910 for ONNX tensor: 910 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_187 [Conv] outputs: [910 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_188 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 910 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_188 [LeakyRelu] inputs: [910 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_188 for ONNX node: LeakyRelu_188 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 682 for ONNX tensor: 682 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_188 [LeakyRelu] outputs: [682 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Shape_189 [Shape] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 682 [TensorRT] VERBOSE: ModelImporter.cpp:125: Shape_189 [Shape] inputs: [682 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Shape_189 for ONNX node: Shape_189 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 683 for ONNX tensor: 683 [TensorRT] VERBOSE: ModelImporter.cpp:179: Shape_189 [Shape] outputs: [683 -> (4)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_190 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_190 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_190 [Constant] outputs: [684 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gather_191 [Gather] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 683 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 684 [TensorRT] VERBOSE: ModelImporter.cpp:125: Gather_191 [Gather] inputs: [683 -> (4)], [684 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:986: Using Gather axis: 0 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gather_191 for ONNX node: Gather_191 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 685 for ONNX tensor: 685 [TensorRT] VERBOSE: ModelImporter.cpp:179: Gather_191 [Gather] outputs: [685 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_192 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_192 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_192 [Constant] outputs: [686 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Div_193 [Div] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 685 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 686 [TensorRT] VERBOSE: ModelImporter.cpp:125: Div_193 [Div] inputs: [685 -> ()], [686 -> ()], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Div_193 for ONNX node: Div_193 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 687 for ONNX tensor: 687 [TensorRT] VERBOSE: ModelImporter.cpp:179: Div_193 [Div] outputs: [687 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_194 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 687 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_194 [Cast] inputs: [687 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_194 for ONNX node: Cast_194 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 688 for ONNX tensor: 688 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_194 [Cast] outputs: [688 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Cast_195 [Cast] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 688 [TensorRT] VERBOSE: ModelImporter.cpp:125: Cast_195 [Cast] inputs: [688 -> ()], [TensorRT] VERBOSE: builtin_op_importers.cpp:320: Casting to type: int32 [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Cast_195 for ONNX node: Cast_195 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 689 for ONNX tensor: 689 [TensorRT] VERBOSE: ModelImporter.cpp:179: Cast_195 [Cast] outputs: [689 -> ()], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_196 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 689 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_196 [Unsqueeze] inputs: [689 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_196 for ONNX node: Unsqueeze_196 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 693 for ONNX tensor: 693 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_196 [Unsqueeze] outputs: [693 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_197 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_197 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_197 [Constant] outputs: [695 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_198 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 682 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 959 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 693 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 960 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 695 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_198 [Slice] inputs: [682 -> (-1, 1024, -1, -1)], [959 -> (1)], [693 -> (1)], [960 -> (1)], [695 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_198 for ONNX node: Slice_198 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 696 for ONNX tensor: 696 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_198 [Slice] outputs: [696 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Unsqueeze_199 [Unsqueeze] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 689 [TensorRT] VERBOSE: ModelImporter.cpp:125: Unsqueeze_199 [Unsqueeze] inputs: [689 -> ()], [TensorRT] VERBOSE: onnx2trt_utils.cpp:1793: Original shape: (), unsqueezing to: (1,) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Unsqueeze_199 for ONNX node: Unsqueeze_199 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 699 for ONNX tensor: 699 [TensorRT] VERBOSE: ModelImporter.cpp:179: Unsqueeze_199 [Unsqueeze] outputs: [699 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Constant_200 [Constant] [TensorRT] VERBOSE: ModelImporter.cpp:125: Constant_200 [Constant] inputs: [TensorRT] VERBOSE: ModelImporter.cpp:179: Constant_200 [Constant] outputs: [702 -> (1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Slice_201 [Slice] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 682 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 699 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 961 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 962 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 702 [TensorRT] VERBOSE: ModelImporter.cpp:125: Slice_201 [Slice] inputs: [682 -> (-1, 1024, -1, -1)], [699 -> (1)], [961 -> (1)], [962 -> (1)], [702 -> (1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Slice_201 for ONNX node: Slice_201 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 703 for ONNX tensor: 703 [TensorRT] VERBOSE: ModelImporter.cpp:179: Slice_201 [Slice] outputs: [703 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_202 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 703 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 914 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 915 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_202 [Conv] inputs: [703 -> (-1, -1, -1, -1)], [914 -> (512, 512, 1, 1)], [915 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_202 for ONNX node: Conv_202 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 913 for ONNX tensor: 913 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_202 [Conv] outputs: [913 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_203 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 913 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_203 [LeakyRelu] inputs: [913 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_203 for ONNX node: LeakyRelu_203 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 706 for ONNX tensor: 706 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_203 [LeakyRelu] outputs: [706 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_204 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 706 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 917 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 918 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_204 [Conv] inputs: [706 -> (-1, 512, -1, -1)], [917 -> (512, 512, 3, 3)], [918 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_204 for ONNX node: Conv_204 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 916 for ONNX tensor: 916 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_204 [Conv] outputs: [916 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_205 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 916 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_205 [LeakyRelu] inputs: [916 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_205 for ONNX node: LeakyRelu_205 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 709 for ONNX tensor: 709 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_205 [LeakyRelu] outputs: [709 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_206 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 709 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 703 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_206 [Add] inputs: [709 -> (-1, 512, -1, -1)], [703 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_206 for ONNX node: Add_206 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 710 for ONNX tensor: 710 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_206 [Add] outputs: [710 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_207 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 710 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 920 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 921 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_207 [Conv] inputs: [710 -> (-1, 512, -1, -1)], [920 -> (512, 512, 1, 1)], [921 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_207 for ONNX node: Conv_207 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 919 for ONNX tensor: 919 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_207 [Conv] outputs: [919 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_208 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 919 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_208 [LeakyRelu] inputs: [919 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_208 for ONNX node: LeakyRelu_208 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 713 for ONNX tensor: 713 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_208 [LeakyRelu] outputs: [713 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_209 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 713 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 923 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 924 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_209 [Conv] inputs: [713 -> (-1, 512, -1, -1)], [923 -> (512, 512, 3, 3)], [924 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_209 for ONNX node: Conv_209 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 922 for ONNX tensor: 922 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_209 [Conv] outputs: [922 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_210 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 922 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_210 [LeakyRelu] inputs: [922 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_210 for ONNX node: LeakyRelu_210 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 716 for ONNX tensor: 716 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_210 [LeakyRelu] outputs: [716 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_211 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 716 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 710 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_211 [Add] inputs: [716 -> (-1, 512, -1, -1)], [710 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_211 for ONNX node: Add_211 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 717 for ONNX tensor: 717 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_211 [Add] outputs: [717 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_212 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 717 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 926 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 927 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_212 [Conv] inputs: [717 -> (-1, 512, -1, -1)], [926 -> (512, 512, 1, 1)], [927 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_212 for ONNX node: Conv_212 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 925 for ONNX tensor: 925 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_212 [Conv] outputs: [925 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_213 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 925 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_213 [LeakyRelu] inputs: [925 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_213 for ONNX node: LeakyRelu_213 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 720 for ONNX tensor: 720 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_213 [LeakyRelu] outputs: [720 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_214 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 720 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 929 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 930 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_214 [Conv] inputs: [720 -> (-1, 512, -1, -1)], [929 -> (512, 512, 3, 3)], [930 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_214 for ONNX node: Conv_214 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 928 for ONNX tensor: 928 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_214 [Conv] outputs: [928 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_215 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 928 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_215 [LeakyRelu] inputs: [928 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_215 for ONNX node: LeakyRelu_215 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 723 for ONNX tensor: 723 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_215 [LeakyRelu] outputs: [723 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_216 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 723 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 717 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_216 [Add] inputs: [723 -> (-1, 512, -1, -1)], [717 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_216 for ONNX node: Add_216 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 724 for ONNX tensor: 724 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_216 [Add] outputs: [724 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_217 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 724 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 932 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 933 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_217 [Conv] inputs: [724 -> (-1, 512, -1, -1)], [932 -> (512, 512, 1, 1)], [933 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_217 for ONNX node: Conv_217 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 931 for ONNX tensor: 931 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_217 [Conv] outputs: [931 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_218 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 931 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_218 [LeakyRelu] inputs: [931 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_218 for ONNX node: LeakyRelu_218 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 727 for ONNX tensor: 727 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_218 [LeakyRelu] outputs: [727 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_219 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 727 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 935 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 936 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_219 [Conv] inputs: [727 -> (-1, 512, -1, -1)], [935 -> (512, 512, 3, 3)], [936 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_219 for ONNX node: Conv_219 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 934 for ONNX tensor: 934 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_219 [Conv] outputs: [934 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_220 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 934 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_220 [LeakyRelu] inputs: [934 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_220 for ONNX node: LeakyRelu_220 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 730 for ONNX tensor: 730 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_220 [LeakyRelu] outputs: [730 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Add_221 [Add] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 730 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 724 [TensorRT] VERBOSE: ModelImporter.cpp:125: Add_221 [Add] inputs: [730 -> (-1, 512, -1, -1)], [724 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Add_221 for ONNX node: Add_221 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 731 for ONNX tensor: 731 [TensorRT] VERBOSE: ModelImporter.cpp:179: Add_221 [Add] outputs: [731 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_222 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 731 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 938 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 939 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_222 [Conv] inputs: [731 -> (-1, 512, -1, -1)], [938 -> (512, 512, 1, 1)], [939 -> (512)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_222 for ONNX node: Conv_222 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 512, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 937 for ONNX tensor: 937 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_222 [Conv] outputs: [937 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_223 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 937 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_223 [LeakyRelu] inputs: [937 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_223 for ONNX node: LeakyRelu_223 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 734 for ONNX tensor: 734 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_223 [LeakyRelu] outputs: [734 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Concat_224 [Concat] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 696 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 734 [TensorRT] VERBOSE: ModelImporter.cpp:125: Concat_224 [Concat] inputs: [696 -> (-1, -1, -1, -1)], [734 -> (-1, 512, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Concat_224 for ONNX node: Concat_224 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 735 for ONNX tensor: 735 [TensorRT] VERBOSE: ModelImporter.cpp:179: Concat_224 [Concat] outputs: [735 -> (-1, -1, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Conv_225 [Conv] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 735 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 941 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 942 [TensorRT] VERBOSE: ModelImporter.cpp:125: Conv_225 [Conv] inputs: [735 -> (-1, -1, -1, -1)], [941 -> (1024, 1024, 1, 1)], [942 -> (1024)], [TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (-1, -1, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Conv_225 for ONNX node: Conv_225 [TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 1024, -1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 940 for ONNX tensor: 940 [TensorRT] VERBOSE: ModelImporter.cpp:179: Conv_225 [Conv] outputs: [940 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: LeakyRelu_226 [LeakyRelu] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 940 [TensorRT] VERBOSE: ModelImporter.cpp:125: LeakyRelu_226 [LeakyRelu] inputs: [940 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: LeakyRelu_226 for ONNX node: LeakyRelu_226 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 738 for ONNX tensor: 738 [TensorRT] VERBOSE: ModelImporter.cpp:179: LeakyRelu_226 [LeakyRelu] outputs: [738 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: GlobalAveragePool_227 [GlobalAveragePool] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 738 [TensorRT] VERBOSE: ModelImporter.cpp:125: GlobalAveragePool_227 [GlobalAveragePool] inputs: [738 -> (-1, 1024, -1, -1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: GlobalAveragePool_227 for ONNX node: GlobalAveragePool_227 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 739 for ONNX tensor: 739 [TensorRT] VERBOSE: ModelImporter.cpp:179: GlobalAveragePool_227 [GlobalAveragePool] outputs: [739 -> (-1, 1024, 1, 1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Flatten_228 [Flatten] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 739 [TensorRT] VERBOSE: ModelImporter.cpp:125: Flatten_228 [Flatten] inputs: [739 -> (-1, 1024, 1, 1)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Flatten_228 for ONNX node: Flatten_228 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 740 for ONNX tensor: 740 [TensorRT] VERBOSE: ModelImporter.cpp:179: Flatten_228 [Flatten] outputs: [740 -> (-1, -1)], [TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: Gemm_229 [Gemm] [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 740 [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: head.fc.weight [TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: head.fc.bias [TensorRT] VERBOSE: ModelImporter.cpp:125: Gemm_229 [Gemm] inputs: [740 -> (-1, -1)], [head.fc.weight -> (3, 1024)], [head.fc.bias -> (3)], [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: head.fc.weight for ONNX node: head.fc.weight [TensorRT] VERBOSE: builtin_op_importers.cpp:1083: Using opA: 0 opB: 0 [TensorRT] VERBOSE: builtin_op_importers.cpp:1084: GEMM: A, after squeezing: (-1, -1) [TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: Gemm_229 for ONNX node: Gemm_229 [TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: output_1 for ONNX tensor: output [TensorRT] VERBOSE: ModelImporter.cpp:179: Gemm_229 [Gemm] outputs: [output -> (-1, 3)], [TensorRT] VERBOSE: ModelImporter.cpp:507: Marking output_1 as output: output [TensorRT] VERBOSE: Original: 179 layers [TensorRT] VERBOSE: After dead-layer removal: 179 layers [TensorRT] VERBOSE: After scale fusion: 179 layers [TensorRT] VERBOSE: After vertical fusions: 179 layers [TensorRT] VERBOSE: After final dead-layer removal: 179 layers [TensorRT] VERBOSE: Eliminating concatenation Concat_26 [TensorRT] VERBOSE: Generating copy for 427 to 445 [TensorRT] VERBOSE: Generating copy for 444 to 445 [TensorRT] VERBOSE: Eliminating concatenation Concat_58 [TensorRT] VERBOSE: Generating copy for 468 to 493 [TensorRT] VERBOSE: Generating copy for 492 to 493 [TensorRT] VERBOSE: Eliminating concatenation Concat_120 [TensorRT] VERBOSE: Generating copy for 516 to 583 [TensorRT] VERBOSE: Generating copy for 582 to 583 [TensorRT] VERBOSE: Eliminating concatenation Concat_182 [TensorRT] VERBOSE: Generating copy for 606 to 673 [TensorRT] VERBOSE: Generating copy for 672 to 673 [TensorRT] VERBOSE: Eliminating concatenation Concat_224 [TensorRT] VERBOSE: Generating copy for 696 to 735 [TensorRT] VERBOSE: Generating copy for 734 to 735 [TensorRT] VERBOSE: After concat removal: 184 layers [TensorRT] VERBOSE: After tensor merging: 184 layers [TensorRT] VERBOSE: Constructing optimization profile number 0 [1/1]. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,150528) -> Float(1,224,50176,1605632) *************** [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.428448 [TensorRT] VERBOSE: Tactic: 1825138533642645384 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1825138533642645384 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.273632 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.276992 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.694144 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,1605632) -> Float(1,224,50176,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.22944 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176:32,50176) -> Float(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.247808 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.748544 [TensorRT] VERBOSE: Tactic: 458751 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.149504 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.149088 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.320512 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.128608 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.127584 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.22016 [TensorRT] VERBOSE: Tactic: 1754569683116234317 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.287744 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.287264 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.616448 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.247808 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,50176) -> Float(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.247808 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.617472 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.330752 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.07408 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.079136 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.167296 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.068608 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,12544) -> Float(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061856 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.700416 [TensorRT] VERBOSE: Tactic: 524287 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_22 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.128 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_22 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.12816 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816), Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_23 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.08928 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088), Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_23 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.104448 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.659456 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.128192 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.130048 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: 427 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.128544 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 444 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.131072 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 444 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.321632 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.84016 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.128608 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.117536 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.550912 [TensorRT] VERBOSE: Tactic: 458751 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.078848 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.077824 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.132256 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.062944 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.069632 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.332288 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.068864 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.069632 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.1376 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.046112 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.074272 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.143712 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04144 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.039936 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.03344 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.264736 [TensorRT] VERBOSE: Tactic: 524287 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_49 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.04096 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_49 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.039936 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704), Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_50 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.03072 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272), Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_50 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.02576 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0752 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.041408 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.04096 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_54 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.039936 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_54 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.040544 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704), Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_55 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.030144 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272), Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_55 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.03072 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.040256 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.039936 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: 468 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.041408 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 492 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.041984 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 492 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.075776 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.062912 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.068608 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.573568 [TensorRT] VERBOSE: Tactic: 458751 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.045056 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.046592 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.080896 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.03552 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.04 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.252928 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.03408 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.040096 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.080896 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.03104 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047584 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.125952 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.029056 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023968 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.020352 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.25712 [TensorRT] VERBOSE: Tactic: 524287 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_81 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024736 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_81 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024064 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_82 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.018432 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_82 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01536 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047584 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0248 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024576 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_86 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02048 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_86 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02464 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_87 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01952 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_87 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01536 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024576 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_91 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023808 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_91 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023584 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_92 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01536 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_92 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.018016 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024608 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.025024 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_96 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_96 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019872 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_97 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01792 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_97 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.018016 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023712 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024608 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_101 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019872 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_101 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_102 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01488 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_102 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.015744 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.018944 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019584 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_106 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_106 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0192 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_107 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.0152 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_107 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.015136 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02032 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_111 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.020032 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_111 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019648 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_112 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.015296 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_112 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.015392 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019808 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_116 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019776 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_116 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01872 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_117 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.014816 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_117 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01472 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019296 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019136 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: 516 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.019168 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 582 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.020544 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 582 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039776 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033184 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032704 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.517632 [TensorRT] VERBOSE: Tactic: 458751 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02384 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02448 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.042656 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.342272 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019744 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019776 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04432 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.013408 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022016 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.170688 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.013952 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010944 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.285984 [TensorRT] VERBOSE: Tactic: 524287 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_143 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_143 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011392 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_144 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010176 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_144 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.008864 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.021568 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011296 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_148 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010688 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_148 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_149 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010016 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_149 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.01008 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_153 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011616 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_153 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011872 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_154 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009888 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_154 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.0088 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011296 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_158 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_158 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011744 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_159 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010432 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_159 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.00864 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011392 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_163 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_163 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_164 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010144 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_164 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009216 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011168 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_168 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_168 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011136 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_169 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.010144 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_169 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009216 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011392 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_173 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0112 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_173 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010592 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_174 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009568 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_174 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009024 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.012096 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_178 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_178 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011392 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_179 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009888 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_179 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.009344 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010784 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011296 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: 606 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.008 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 672 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.008064 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 672 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022272 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.020256 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019872 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.73008 [TensorRT] VERBOSE: Tactic: 458751 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01632 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016256 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0512 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0112 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.607904 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050432 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Slice) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011008 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028128 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.301024 [TensorRT] VERBOSE: Tactic: 589823 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 589823 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010592 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00784 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00752 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.524544 [TensorRT] VERBOSE: Tactic: 524287 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_205 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007712 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_205 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00784 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_206 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.00608 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_206 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027136 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007904 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007552 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_210 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00768 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_210 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007552 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_211 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.005984 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_211 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.008 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007392 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_215 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00768 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_215 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007744 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_216 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006016 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_216 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.004544 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007424 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007616 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_220 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007456 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_220 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007872 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_221 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.004768 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Add_221 (ElementWise) [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007616 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007552 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: 696 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006112 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 734 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006048 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: --------------- Timing Runner: 734 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027616 [TensorRT] VERBOSE: Tactic: 1002 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011008 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 128 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,1,1,1024) *************** [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (Reduce) [TensorRT] VERBOSE: Tactic: 1 time 0.147712 [TensorRT] VERBOSE: Tactic: 1 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,1,1,1024) -> Float(1,1024) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Flatten_228 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 time 0.004224 [TensorRT] VERBOSE: Tactic: 0 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: -> Float(1,3) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,1024), Float(1,3) -> Float(1,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Gemm_229 (MatrixMultiply) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: -> Float(1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1) -> Float(1,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: (Unnamed Layer* 464) [Shuffle] (Shuffle) [TensorRT] VERBOSE: Tactic: 0 time 0.00288 [TensorRT] VERBOSE: Tactic: 0 A valid calibration tactic is found. Rest of the timing is skipped. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,3), Float(1,3) -> Float(1,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: (Unnamed Layer* 465) [ElementWise] (ElementWise) [TensorRT] VERBOSE: Tactic: 1 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0 [TensorRT] VERBOSE: Formats and tactics selection completed in 12.4396 seconds. [TensorRT] VERBOSE: After reformat layers: 184 layers [TensorRT] VERBOSE: Block size 6422528 [TensorRT] VERBOSE: Block size 6422528 [TensorRT] VERBOSE: Block size 3211264 [TensorRT] VERBOSE: Block size 3211264 [TensorRT] VERBOSE: Block size 802816 [TensorRT] VERBOSE: Block size 401408 [TensorRT] VERBOSE: Block size 1 [TensorRT] VERBOSE: Total Activation Memory: 20471809 [TensorRT] INFO: Detected 1 inputs and 1 output network tensors. [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Layer: Conv_0 Weights: 0 HostPersistent: 2176 DevicePersistent: 305152 [TensorRT] VERBOSE: Layer: LeakyRelu_1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_2 Weights: 73728 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_3 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_4 Weights: 0 HostPersistent: 3200 DevicePersistent: 109056 [TensorRT] VERBOSE: Layer: LeakyRelu_5 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_15 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_18 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_19 Weights: 8192 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_20 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_21 Weights: 73728 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_22 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_23 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_24 Weights: 16384 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_25 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 427 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 444 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_27 Weights: 32768 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_28 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_29 Weights: 294912 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_30 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_31 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_32 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_42 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_45 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_46 Weights: 16384 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_47 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_48 Weights: 147456 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_49 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_50 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_51 Weights: 16384 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_52 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_53 Weights: 147456 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_54 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_55 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_56 Weights: 16384 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_57 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 468 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 492 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_59 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_60 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_61 Weights: 1179648 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_62 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_63 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_64 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_74 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_77 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_78 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_79 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_80 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_81 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_82 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_83 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_84 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_85 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_86 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_87 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_88 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_89 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_90 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_91 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_92 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_93 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_94 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_95 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_96 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_97 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_98 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_99 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_100 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_101 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_102 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_103 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_104 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_105 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_106 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_107 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_108 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_109 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_110 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_111 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_112 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_113 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_114 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_115 Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_116 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_117 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_118 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_119 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 516 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 582 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_121 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_122 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_123 Weights: 4718592 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_124 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_125 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_126 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_136 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_139 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_140 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_141 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_142 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_143 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_144 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_145 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_146 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_147 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_148 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_149 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_150 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_151 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_152 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_153 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_154 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_155 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_156 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_157 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_158 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_159 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_160 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_161 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_162 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_163 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_164 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_165 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_166 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_167 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_168 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_169 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_170 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_171 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_172 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_173 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_174 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_175 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_176 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_177 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_178 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_179 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_180 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_181 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 606 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 672 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_183 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_184 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_185 Weights: 18874368 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_186 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_187 Weights: 4194304 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_188 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_198 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_201 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_202 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_203 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_204 Weights: 9437184 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_205 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_206 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_207 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_208 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_209 Weights: 9437184 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_210 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_211 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_212 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_213 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_214 Weights: 9437184 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_215 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_216 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_217 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_218 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_219 Weights: 9437184 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_220 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Add_221 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_222 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_223 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 696 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: 734 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_225 Weights: 4194304 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_226 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: GlobalAveragePool_227 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Flatten_228 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: head.fc.weight Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Gemm_229 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: (Unnamed Layer* 463) [Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: (Unnamed Layer* 464) [Shuffle] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: (Unnamed Layer* 465) [ElementWise] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Total Host Persistent Memory: 5376 [TensorRT] VERBOSE: Total Device Persistent Memory: 414208 [TensorRT] VERBOSE: Total Weight Memory: 106291200 [TensorRT] VERBOSE: Builder timing cache: created 68 entries, 415 hit(s) [TensorRT] VERBOSE: Engine generation completed in 14.1021 seconds. [TensorRT] VERBOSE: Calculating Maxima [TensorRT] INFO: Starting Calibration. [TensorRT] INFO: Calibrated batch 0 in 0.178292 seconds. [TensorRT] INFO: Calibrated batch 1 in 0.140371 seconds. [TensorRT] INFO: Calibrated batch 2 in 0.125779 seconds. [TensorRT] INFO: Calibrated batch 3 in 0.129192 seconds. [TensorRT] INFO: Calibrated batch 4 in 0.127911 seconds. [TensorRT] INFO: Calibrated batch 5 in 0.132319 seconds. [TensorRT] INFO: Calibrated batch 6 in 0.12953 seconds. [TensorRT] INFO: Calibrated batch 7 in 0.130603 seconds. [TensorRT] INFO: Calibrated batch 8 in 0.126652 seconds. [TensorRT] INFO: Calibrated batch 9 in 0.12772 seconds. [TensorRT] INFO: Calibrated batch 10 in 0.124804 seconds. [TensorRT] INFO: Calibrated batch 11 in 0.129201 seconds. [TensorRT] INFO: Calibrated batch 12 in 0.127387 seconds. [TensorRT] INFO: Calibrated batch 13 in 0.128035 seconds. [TensorRT] INFO: Calibrated batch 14 in 0.126473 seconds. [TensorRT] INFO: Calibrated batch 15 in 0.129952 seconds. [TensorRT] INFO: Calibrated batch 16 in 0.126283 seconds. [TensorRT] INFO: Calibrated batch 17 in 0.126552 seconds. [TensorRT] INFO: Calibrated batch 18 in 0.131954 seconds. [TensorRT] INFO: Calibrated batch 19 in 0.126335 seconds. [TensorRT] INFO: Calibrated batch 20 in 0.125936 seconds. [TensorRT] INFO: Calibrated batch 21 in 0.127897 seconds. [TensorRT] INFO: Calibrated batch 22 in 0.128218 seconds. [TensorRT] INFO: Calibrated batch 23 in 0.128127 seconds. [TensorRT] INFO: Calibrated batch 24 in 0.126418 seconds. [TensorRT] INFO: Calibrated batch 25 in 0.124423 seconds. [TensorRT] INFO: Calibrated batch 26 in 0.124238 seconds. [TensorRT] INFO: Calibrated batch 27 in 0.127773 seconds. [TensorRT] INFO: Calibrated batch 28 in 0.128273 seconds. [TensorRT] INFO: Calibrated batch 29 in 0.12672 seconds. [TensorRT] INFO: Calibrated batch 30 in 0.128395 seconds. [TensorRT] INFO: Calibrated batch 31 in 0.126671 seconds. [TensorRT] INFO: Calibrated batch 32 in 0.126394 seconds. [TensorRT] INFO: Calibrated batch 33 in 0.127327 seconds. [TensorRT] INFO: Calibrated batch 34 in 0.127881 seconds. [TensorRT] INFO: Calibrated batch 35 in 0.129368 seconds. [TensorRT] INFO: Calibrated batch 36 in 0.13092 seconds. [TensorRT] INFO: Calibrated batch 37 in 0.126366 seconds. [TensorRT] INFO: Calibrated batch 38 in 0.129485 seconds. [TensorRT] INFO: Calibrated batch 39 in 0.129912 seconds. [TensorRT] INFO: Calibrated batch 40 in 0.126077 seconds. [TensorRT] INFO: Calibrated batch 41 in 0.130921 seconds. [TensorRT] INFO: Calibrated batch 42 in 0.129136 seconds. [TensorRT] INFO: Calibrated batch 43 in 0.12996 seconds. [TensorRT] INFO: Calibrated batch 44 in 0.139037 seconds. [TensorRT] INFO: Calibrated batch 45 in 0.132717 seconds. [TensorRT] INFO: Calibrated batch 46 in 0.127128 seconds. [TensorRT] INFO: Calibrated batch 47 in 0.12726 seconds. [TensorRT] INFO: Calibrated batch 48 in 0.127476 seconds. [TensorRT] INFO: Calibrated batch 49 in 0.126401 seconds. [TensorRT] INFO: Calibrated batch 50 in 0.127237 seconds. [TensorRT] INFO: Calibrated batch 51 in 0.127388 seconds. [TensorRT] INFO: Calibrated batch 52 in 0.127702 seconds. [TensorRT] INFO: Calibrated batch 53 in 0.127182 seconds. [TensorRT] INFO: Calibrated batch 54 in 0.124769 seconds. [TensorRT] INFO: Calibrated batch 55 in 0.128944 seconds. [TensorRT] INFO: Calibrated batch 56 in 0.126816 seconds. [TensorRT] INFO: Calibrated batch 57 in 0.123842 seconds. [TensorRT] INFO: Calibrated batch 58 in 0.125378 seconds. [TensorRT] INFO: Calibrated batch 59 in 0.124647 seconds. [TensorRT] INFO: Calibrated batch 60 in 0.125826 seconds. [TensorRT] INFO: Calibrated batch 61 in 0.125478 seconds. [TensorRT] INFO: Calibrated batch 62 in 0.1252 seconds. [TensorRT] INFO: Calibrated batch 63 in 0.12539 seconds. [TensorRT] INFO: Calibrated batch 64 in 0.126606 seconds. [TensorRT] INFO: Calibrated batch 65 in 0.124155 seconds. [TensorRT] INFO: Calibrated batch 66 in 0.126352 seconds. [TensorRT] INFO: Calibrated batch 67 in 0.127051 seconds. [TensorRT] INFO: Calibrated batch 68 in 0.125552 seconds. [TensorRT] INFO: Calibrated batch 69 in 0.132218 seconds. [TensorRT] INFO: Calibrated batch 70 in 0.131698 seconds. [TensorRT] INFO: Calibrated batch 71 in 0.123767 seconds. [TensorRT] INFO: Calibrated batch 72 in 0.126974 seconds. [TensorRT] INFO: Calibrated batch 73 in 0.124415 seconds. [TensorRT] INFO: Calibrated batch 74 in 0.126424 seconds. [TensorRT] INFO: Calibrated batch 75 in 0.124703 seconds. [TensorRT] INFO: Calibrated batch 76 in 0.129671 seconds. [TensorRT] INFO: Calibrated batch 77 in 0.123854 seconds. [TensorRT] INFO: Calibrated batch 78 in 0.126464 seconds. [TensorRT] INFO: Calibrated batch 79 in 0.129174 seconds. [TensorRT] INFO: Calibrated batch 80 in 0.125334 seconds. [TensorRT] INFO: Calibrated batch 81 in 0.128791 seconds. [TensorRT] INFO: Calibrated batch 82 in 0.125995 seconds. [TensorRT] INFO: Calibrated batch 83 in 0.129103 seconds. [TensorRT] INFO: Calibrated batch 84 in 0.13183 seconds. [TensorRT] INFO: Calibrated batch 85 in 0.127183 seconds. [TensorRT] INFO: Calibrated batch 86 in 0.127809 seconds. [TensorRT] INFO: Calibrated batch 87 in 0.124398 seconds. [TensorRT] INFO: Calibrated batch 88 in 0.128892 seconds. [TensorRT] INFO: Calibrated batch 89 in 0.12977 seconds. [TensorRT] INFO: Calibrated batch 90 in 0.128903 seconds. [TensorRT] INFO: Calibrated batch 91 in 0.129153 seconds. [TensorRT] INFO: Calibrated batch 92 in 0.126444 seconds. [TensorRT] INFO: Calibrated batch 93 in 0.129015 seconds. [TensorRT] INFO: Calibrated batch 94 in 0.125834 seconds. [TensorRT] INFO: Calibrated batch 95 in 0.126183 seconds. [TensorRT] INFO: Calibrated batch 96 in 0.128064 seconds. [TensorRT] INFO: Calibrated batch 97 in 0.129638 seconds. [TensorRT] INFO: Calibrated batch 98 in 0.125529 seconds. [TensorRT] INFO: Calibrated batch 99 in 0.127992 seconds. [TensorRT] INFO: Calibrated batch 100 in 0.128108 seconds. [TensorRT] INFO: Calibrated batch 101 in 0.127723 seconds. [TensorRT] INFO: Calibrated batch 102 in 0.129027 seconds. [TensorRT] INFO: Calibrated batch 103 in 0.1293 seconds. [TensorRT] INFO: Calibrated batch 104 in 0.130421 seconds. [TensorRT] INFO: Calibrated batch 105 in 0.129098 seconds. [TensorRT] INFO: Calibrated batch 106 in 0.127027 seconds. [TensorRT] INFO: Calibrated batch 107 in 0.126805 seconds. [TensorRT] INFO: Calibrated batch 108 in 0.125032 seconds. [TensorRT] INFO: Calibrated batch 109 in 0.130828 seconds. [TensorRT] INFO: Calibrated batch 110 in 0.137671 seconds. [TensorRT] INFO: Calibrated batch 111 in 0.136181 seconds. [TensorRT] INFO: Calibrated batch 112 in 0.129106 seconds. [TensorRT] INFO: Calibrated batch 113 in 0.131127 seconds. [TensorRT] INFO: Calibrated batch 114 in 0.130391 seconds. [TensorRT] INFO: Calibrated batch 115 in 0.138752 seconds. [TensorRT] INFO: Calibrated batch 116 in 0.130775 seconds. [TensorRT] INFO: Calibrated batch 117 in 0.126377 seconds. [TensorRT] INFO: Calibrated batch 118 in 0.127157 seconds. [TensorRT] INFO: Calibrated batch 119 in 0.126083 seconds. [TensorRT] INFO: Calibrated batch 120 in 0.125219 seconds. [TensorRT] INFO: Calibrated batch 121 in 0.133059 seconds. [TensorRT] INFO: Calibrated batch 122 in 0.12667 seconds. [TensorRT] INFO: Calibrated batch 123 in 0.12665 seconds. [TensorRT] INFO: Calibrated batch 124 in 0.127649 seconds. [TensorRT] INFO: Calibrated batch 125 in 0.124996 seconds. [TensorRT] INFO: Calibrated batch 126 in 0.127378 seconds. [TensorRT] INFO: Calibrated batch 127 in 0.126019 seconds. [TensorRT] INFO: Calibrated batch 128 in 0.126802 seconds. [TensorRT] INFO: Calibrated batch 129 in 0.124939 seconds. [TensorRT] INFO: Calibrated batch 130 in 0.128375 seconds. [TensorRT] INFO: Calibrated batch 131 in 0.127539 seconds. [TensorRT] INFO: Calibrated batch 132 in 0.129161 seconds. [TensorRT] INFO: Calibrated batch 133 in 0.127609 seconds. [TensorRT] INFO: Calibrated batch 134 in 0.127419 seconds. [TensorRT] INFO: Calibrated batch 135 in 0.126471 seconds. [TensorRT] INFO: Calibrated batch 136 in 0.128429 seconds. [TensorRT] INFO: Calibrated batch 137 in 0.130442 seconds. [TensorRT] INFO: Calibrated batch 138 in 0.12855 seconds. [TensorRT] INFO: Calibrated batch 139 in 0.128341 seconds. [TensorRT] INFO: Calibrated batch 140 in 0.126385 seconds. [TensorRT] INFO: Calibrated batch 141 in 0.124166 seconds. [TensorRT] INFO: Calibrated batch 142 in 0.124231 seconds. [TensorRT] INFO: Calibrated batch 143 in 0.126845 seconds. [TensorRT] INFO: Calibrated batch 144 in 0.126618 seconds. [TensorRT] INFO: Calibrated batch 145 in 0.124569 seconds. [TensorRT] INFO: Calibrated batch 146 in 0.122801 seconds. [TensorRT] INFO: Calibrated batch 147 in 0.124396 seconds. [TensorRT] INFO: Calibrated batch 148 in 0.126572 seconds. [TensorRT] INFO: Calibrated batch 149 in 0.125064 seconds. [TensorRT] INFO: Calibrated batch 150 in 0.125792 seconds. [TensorRT] INFO: Calibrated batch 151 in 0.140287 seconds. [TensorRT] INFO: Calibrated batch 152 in 0.126288 seconds. [TensorRT] INFO: Calibrated batch 153 in 0.125965 seconds. [TensorRT] INFO: Calibrated batch 154 in 0.126437 seconds. [TensorRT] INFO: Calibrated batch 155 in 0.126837 seconds. [TensorRT] INFO: Calibrated batch 156 in 0.127302 seconds. [TensorRT] INFO: Calibrated batch 157 in 0.127911 seconds. [TensorRT] INFO: Calibrated batch 158 in 0.1269 seconds. [TensorRT] INFO: Calibrated batch 159 in 0.125565 seconds. [TensorRT] INFO: Calibrated batch 160 in 0.126036 seconds. [TensorRT] INFO: Calibrated batch 161 in 0.12773 seconds. [TensorRT] INFO: Calibrated batch 162 in 0.128089 seconds. [TensorRT] INFO: Calibrated batch 163 in 0.126574 seconds. [TensorRT] INFO: Calibrated batch 164 in 0.127239 seconds. [TensorRT] INFO: Calibrated batch 165 in 0.125748 seconds. [TensorRT] INFO: Calibrated batch 166 in 0.125887 seconds. [TensorRT] INFO: Calibrated batch 167 in 0.124598 seconds. [TensorRT] INFO: Calibrated batch 168 in 0.127358 seconds. [TensorRT] INFO: Calibrated batch 169 in 0.126803 seconds. [TensorRT] INFO: Calibrated batch 170 in 0.123421 seconds. [TensorRT] INFO: Calibrated batch 171 in 0.126388 seconds. [TensorRT] INFO: Calibrated batch 172 in 0.134539 seconds. [TensorRT] INFO: Calibrated batch 173 in 0.134124 seconds. [TensorRT] INFO: Calibrated batch 174 in 0.133906 seconds. [TensorRT] INFO: Calibrated batch 175 in 0.125819 seconds. [TensorRT] INFO: Calibrated batch 176 in 0.127929 seconds. [TensorRT] INFO: Calibrated batch 177 in 0.126047 seconds. [TensorRT] INFO: Calibrated batch 178 in 0.127205 seconds. [TensorRT] INFO: Calibrated batch 179 in 0.126357 seconds. [TensorRT] INFO: Calibrated batch 180 in 0.12822 seconds. [TensorRT] INFO: Calibrated batch 181 in 0.127104 seconds. [TensorRT] INFO: Calibrated batch 182 in 0.125951 seconds. [TensorRT] INFO: Calibrated batch 183 in 0.125948 seconds. [TensorRT] INFO: Calibrated batch 184 in 0.126944 seconds. [TensorRT] INFO: Calibrated batch 185 in 0.126418 seconds. [TensorRT] INFO: Calibrated batch 186 in 0.126553 seconds. [TensorRT] INFO: Calibrated batch 187 in 0.126713 seconds. [TensorRT] INFO: Calibrated batch 188 in 0.125891 seconds. [TensorRT] INFO: Calibrated batch 189 in 0.128571 seconds. [TensorRT] INFO: Calibrated batch 190 in 0.125956 seconds. [TensorRT] INFO: Calibrated batch 191 in 0.124986 seconds. [TensorRT] INFO: Calibrated batch 192 in 0.127128 seconds. [TensorRT] INFO: Calibrated batch 193 in 0.125981 seconds. [TensorRT] INFO: Calibrated batch 194 in 0.125588 seconds. [TensorRT] INFO: Calibrated batch 195 in 0.126964 seconds. [TensorRT] INFO: Calibrated batch 196 in 0.129341 seconds. [TensorRT] INFO: Calibrated batch 197 in 0.126179 seconds. [TensorRT] INFO: Calibrated batch 198 in 0.128217 seconds. [TensorRT] INFO: Calibrated batch 199 in 0.129386 seconds. [TensorRT] INFO: Calibrated batch 200 in 0.13635 seconds. [TensorRT] INFO: Calibrated batch 201 in 0.132244 seconds. [TensorRT] INFO: Calibrated batch 202 in 0.130201 seconds. [TensorRT] INFO: Calibrated batch 203 in 0.126592 seconds. [TensorRT] INFO: Calibrated batch 204 in 0.126523 seconds. [TensorRT] INFO: Calibrated batch 205 in 0.136827 seconds. [TensorRT] INFO: Calibrated batch 206 in 0.125799 seconds. [TensorRT] INFO: Calibrated batch 207 in 0.136038 seconds. [TensorRT] INFO: Calibrated batch 208 in 0.134256 seconds. [TensorRT] INFO: Calibrated batch 209 in 0.127287 seconds. [TensorRT] INFO: Calibrated batch 210 in 0.125153 seconds. [TensorRT] INFO: Calibrated batch 211 in 0.125482 seconds. [TensorRT] INFO: Calibrated batch 212 in 0.127486 seconds. [TensorRT] INFO: Calibrated batch 213 in 0.126203 seconds. [TensorRT] INFO: Calibrated batch 214 in 0.129494 seconds. [TensorRT] INFO: Calibrated batch 215 in 0.126091 seconds. [TensorRT] INFO: Calibrated batch 216 in 0.124797 seconds. [TensorRT] INFO: Calibrated batch 217 in 0.126059 seconds. [TensorRT] INFO: Calibrated batch 218 in 0.124313 seconds. Namespace(calibration_cache='', calibration_data='data/classifier_dataset/', engine_path='test-engines/classifier_int8_noqat_unnorm.engine', fp16=False, int8=True, model_path='test-onnx/classifier_fp32.onnx', model_qdq_path='', norm=False) INT8 MODE ENABLED True FP16 MODE ENABLED False NO EXISTING CALIBRATION CACHE. PERFORM CALIBRATION IMG (1, 3, 224, 224) 0.105882354 0.7490196 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.043137256 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.07450981 0.99215686 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.039215688 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.047058824 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.043137256 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.07450981 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.039215688 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.043137256 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.047058824 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.08627451 0.76862746 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.05490196 1.0 IMG (1, 3, 224, 224) 0.007843138 0.7490196 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.007843138 0.70980394 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.047058824 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.11372549 0.7411765 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.03529412 0.99607843 IMG (1, 3, 224, 224) 0.023529412 0.99607843 IMG (1, 3, 224, 224) 0.003921569 0.972549 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.011764706 0.9843137 IMG (1, 3, 224, 224) 0.0 0.99215686 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.039215688 1.0 IMG (1, 3, 224, 224) 0.03529412 0.99607843 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.019607844 0.95686275 IMG (1, 3, 224, 224) 0.02745098 0.9843137 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.007843138 0.99215686 IMG (1, 3, 224, 224) 0.02745098 0.9764706 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.047058824 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.03137255 0.99215686 IMG (1, 3, 224, 224) 0.007843138 0.99215686 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.011764706 0.96862745 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.003921569 0.98039216 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.06666667 0.9882353 IMG (1, 3, 224, 224) 0.02745098 0.94509804 IMG (1, 3, 224, 224) 0.003921569 0.9882353 IMG (1, 3, 224, 224) 0.03137255 0.99215686 IMG (1, 3, 224, 224) 0.047058824 0.92941177 IMG (1, 3, 224, 224) 0.007843138 0.99607843 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.0 0.9764706 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.047058824 1.0 IMG (1, 3, 224, 224) 0.007843138 0.99607843 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.03529412 0.99215686 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.011764706 0.9254902 IMG (1, 3, 224, 224) 0.03529412 0.9647059 IMG (1, 3, 224, 224) 0.0 0.972549 IMG (1, 3, 224, 224) 0.023529412 0.9411765 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.043137256 0.85882354 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.019607844 0.99215686 IMG (1, 3, 224, 224) 0.003921569 0.972549 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.011764706 0.9843137 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.047058824 0.9411765 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.03529412 0.972549 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.03529412 0.9490196 IMG (1, 3, 224, 224) 0.003921569 0.9372549 IMG (1, 3, 224, 224) 0.039215688 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.050980393 1.0 IMG (1, 3, 224, 224) 0.015686275 0.99607843 IMG (1, 3, 224, 224) 0.043137256 0.9529412 IMG (1, 3, 224, 224) 0.03529412 0.9254902 IMG (1, 3, 224, 224) 0.015686275 0.9882353 IMG (1, 3, 224, 224) 0.015686275 0.99215686 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.019607844 0.99215686 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.019607844 0.96862745 IMG (1, 3, 224, 224) 0.023529412 0.99607843 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.003921569 0.98039216 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.043137256 0.9607843 IMG (1, 3, 224, 224) 0.03529412 0.9372549 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.011764706 0.9529412 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.011764706 0.9607843 IMG (1, 3, 224, 224) 0.02745098 0.94509804 IMG (1, 3, 224, 224) 0.019607844 0.9882353 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.019607844 0.99607843 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.019607844 0.9490196 IMG (1, 3, 224, 224) 0.0 0.9411765 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.015686275 0.99607843 IMG (1, 3, 224, 224) 0.0 0.94509804 IMG (1, 3, 224, 224) 0.007843138 0.9882353 IMG (1, 3, 224, 224) 0.039215688 1.0 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.003921569 0.99215686[TensorRT] INFO: Calibrated batch 219 in 0.127561 seconds. [TensorRT] INFO: Calibrated batch 220 in 0.125707 seconds. [TensorRT] INFO: Calibrated batch 221 in 0.126184 seconds. [TensorRT] INFO: Calibrated batch 222 in 0.128785 seconds. [TensorRT] INFO: Calibrated batch 223 in 0.125861 seconds. [TensorRT] INFO: Calibrated batch 224 in 0.124571 seconds. [TensorRT] INFO: Calibrated batch 225 in 0.126168 seconds. [TensorRT] INFO: Calibrated batch 226 in 0.123828 seconds. [TensorRT] INFO: Calibrated batch 227 in 0.130453 seconds. [TensorRT] INFO: Calibrated batch 228 in 0.127206 seconds. [TensorRT] INFO: Calibrated batch 229 in 0.122898 seconds. [TensorRT] INFO: Calibrated batch 230 in 0.126421 seconds. [TensorRT] INFO: Calibrated batch 231 in 0.125732 seconds. [TensorRT] INFO: Calibrated batch 232 in 0.122821 seconds. [TensorRT] INFO: Calibrated batch 233 in 0.126814 seconds. [TensorRT] INFO: Calibrated batch 234 in 0.125586 seconds. [TensorRT] INFO: Calibrated batch 235 in 0.123381 seconds. [TensorRT] INFO: Calibrated batch 236 in 0.124721 seconds. [TensorRT] INFO: Calibrated batch 237 in 0.123046 seconds. [TensorRT] INFO: Calibrated batch 238 in 0.126168 seconds. [TensorRT] INFO: Calibrated batch 239 in 0.131129 seconds. [TensorRT] INFO: Calibrated batch 240 in 0.12976 seconds. [TensorRT] INFO: Calibrated batch 241 in 0.125735 seconds. [TensorRT] INFO: Calibrated batch 242 in 0.132287 seconds. [TensorRT] INFO: Calibrated batch 243 in 0.129193 seconds. [TensorRT] INFO: Calibrated batch 244 in 0.128126 seconds. [TensorRT] INFO: Calibrated batch 245 in 0.126594 seconds. [TensorRT] INFO: Calibrated batch 246 in 0.126698 seconds. [TensorRT] INFO: Calibrated batch 247 in 0.127598 seconds. [TensorRT] INFO: Calibrated batch 248 in 0.126358 seconds. [TensorRT] INFO: Calibrated batch 249 in 0.126855 seconds. [TensorRT] INFO: Calibrated batch 250 in 0.12337 seconds. [TensorRT] INFO: Calibrated batch 251 in 0.12681 seconds. [TensorRT] INFO: Calibrated batch 252 in 0.132411 seconds. [TensorRT] INFO: Calibrated batch 253 in 0.12623 seconds. [TensorRT] INFO: Calibrated batch 254 in 0.126233 seconds. [TensorRT] INFO: Calibrated batch 255 in 0.126888 seconds. [TensorRT] INFO: Calibrated batch 256 in 0.125903 seconds. [TensorRT] INFO: Calibrated batch 257 in 0.127971 seconds. [TensorRT] INFO: Calibrated batch 258 in 0.129623 seconds. [TensorRT] INFO: Calibrated batch 259 in 0.125447 seconds. [TensorRT] INFO: Calibrated batch 260 in 0.126963 seconds. [TensorRT] INFO: Calibrated batch 261 in 0.126875 seconds. [TensorRT] INFO: Calibrated batch 262 in 0.126118 seconds. [TensorRT] INFO: Calibrated batch 263 in 0.12827 seconds. [TensorRT] INFO: Calibrated batch 264 in 0.130504 seconds. [TensorRT] INFO: Calibrated batch 265 in 0.128949 seconds. [TensorRT] INFO: Calibrated batch 266 in 0.124846 seconds. [TensorRT] INFO: Calibrated batch 267 in 0.128176 seconds. [TensorRT] INFO: Calibrated batch 268 in 0.128097 seconds. [TensorRT] INFO: Calibrated batch 269 in 0.126886 seconds. [TensorRT] INFO: Calibrated batch 270 in 0.126189 seconds. [TensorRT] INFO: Calibrated batch 271 in 0.127545 seconds. [TensorRT] INFO: Calibrated batch 272 in 0.126464 seconds. [TensorRT] INFO: Calibrated batch 273 in 0.126755 seconds. [TensorRT] INFO: Calibrated batch 274 in 0.124027 seconds. [TensorRT] INFO: Calibrated batch 275 in 0.125423 seconds. [TensorRT] INFO: Calibrated batch 276 in 0.129912 seconds. [TensorRT] INFO: Calibrated batch 277 in 0.128732 seconds. [TensorRT] INFO: Calibrated batch 278 in 0.131208 seconds. [TensorRT] INFO: Calibrated batch 279 in 0.127782 seconds. [TensorRT] INFO: Calibrated batch 280 in 0.126076 seconds. [TensorRT] INFO: Calibrated batch 281 in 0.125858 seconds. [TensorRT] INFO: Calibrated batch 282 in 0.132054 seconds. [TensorRT] INFO: Calibrated batch 283 in 0.130852 seconds. [TensorRT] INFO: Calibrated batch 284 in 0.12627 seconds. [TensorRT] INFO: Calibrated batch 285 in 0.123985 seconds. [TensorRT] INFO: Calibrated batch 286 in 0.126497 seconds. [TensorRT] INFO: Calibrated batch 287 in 0.123736 seconds. [TensorRT] INFO: Calibrated batch 288 in 0.124377 seconds. [TensorRT] INFO: Calibrated batch 289 in 0.125941 seconds. [TensorRT] INFO: Calibrated batch 290 in 0.123356 seconds. [TensorRT] INFO: Calibrated batch 291 in 0.124233 seconds. [TensorRT] INFO: Calibrated batch 292 in 0.123114 seconds. [TensorRT] INFO: Calibrated batch 293 in 0.126749 seconds. [TensorRT] INFO: Calibrated batch 294 in 0.126882 seconds. [TensorRT] INFO: Calibrated batch 295 in 0.126654 seconds. [TensorRT] INFO: Calibrated batch 296 in 0.123957 seconds. [TensorRT] INFO: Calibrated batch 297 in 0.12719 seconds. [TensorRT] INFO: Calibrated batch 298 in 0.124691 seconds. [TensorRT] INFO: Calibrated batch 299 in 0.125515 seconds. [TensorRT] INFO: Calibrated batch 300 in 0.127176 seconds. [TensorRT] INFO: Calibrated batch 301 in 0.127858 seconds. [TensorRT] INFO: Calibrated batch 302 in 0.125613 seconds. [TensorRT] INFO: Calibrated batch 303 in 0.126857 seconds. [TensorRT] INFO: Calibrated batch 304 in 0.125696 seconds. [TensorRT] INFO: Calibrated batch 305 in 0.124436 seconds. [TensorRT] INFO: Calibrated batch 306 in 0.126294 seconds. [TensorRT] INFO: Calibrated batch 307 in 0.126419 seconds. [TensorRT] INFO: Calibrated batch 308 in 0.125739 seconds. [TensorRT] INFO: Calibrated batch 309 in 0.123164 seconds. [TensorRT] INFO: Calibrated batch 310 in 0.125371 seconds. [TensorRT] INFO: Calibrated batch 311 in 0.12624 seconds. [TensorRT] INFO: Calibrated batch 312 in 0.137814 seconds. [TensorRT] INFO: Calibrated batch 313 in 0.128917 seconds. [TensorRT] INFO: Calibrated batch 314 in 0.12647 seconds. [TensorRT] INFO: Calibrated batch 315 in 0.131953 seconds. [TensorRT] INFO: Calibrated batch 316 in 0.128241 seconds. [TensorRT] INFO: Calibrated batch 317 in 0.130755 seconds. [TensorRT] INFO: Calibrated batch 318 in 0.127702 seconds. [TensorRT] INFO: Calibrated batch 319 in 0.126966 seconds. [TensorRT] INFO: Calibrated batch 320 in 0.12458 seconds. [TensorRT] INFO: Calibrated batch 321 in 0.126246 seconds. [TensorRT] INFO: Calibrated batch 322 in 0.128059 seconds. [TensorRT] INFO: Calibrated batch 323 in 0.124877 seconds. [TensorRT] INFO: Calibrated batch 324 in 0.126518 seconds. [TensorRT] INFO: Calibrated batch 325 in 0.128075 seconds. [TensorRT] INFO: Calibrated batch 326 in 0.12734 seconds. [TensorRT] INFO: Calibrated batch 327 in 0.127326 seconds. [TensorRT] INFO: Calibrated batch 328 in 0.126232 seconds. [TensorRT] INFO: Calibrated batch 329 in 0.127421 seconds. [TensorRT] INFO: Calibrated batch 330 in 0.127178 seconds. [TensorRT] INFO: Calibrated batch 331 in 0.126318 seconds. [TensorRT] INFO: Calibrated batch 332 in 0.123147 seconds. [TensorRT] INFO: Calibrated batch 333 in 0.126434 seconds. [TensorRT] INFO: Calibrated batch 334 in 0.123629 seconds. [TensorRT] INFO: Calibrated batch 335 in 0.134156 seconds. [TensorRT] INFO: Calibrated batch 336 in 0.133927 seconds. [TensorRT] INFO: Calibrated batch 337 in 0.128279 seconds. [TensorRT] INFO: Calibrated batch 338 in 0.123457 seconds. [TensorRT] INFO: Calibrated batch 339 in 0.124571 seconds. [TensorRT] INFO: Calibrated batch 340 in 0.126892 seconds. [TensorRT] INFO: Calibrated batch 341 in 0.12437 seconds. [TensorRT] INFO: Calibrated batch 342 in 0.126429 seconds. [TensorRT] INFO: Calibrated batch 343 in 0.126839 seconds. [TensorRT] INFO: Calibrated batch 344 in 0.128186 seconds. [TensorRT] INFO: Calibrated batch 345 in 0.125364 seconds. [TensorRT] INFO: Calibrated batch 346 in 0.129836 seconds. [TensorRT] INFO: Calibrated batch 347 in 0.130062 seconds. [TensorRT] INFO: Calibrated batch 348 in 0.128987 seconds. [TensorRT] INFO: Calibrated batch 349 in 0.126398 seconds. [TensorRT] INFO: Calibrated batch 350 in 0.123256 seconds. [TensorRT] INFO: Calibrated batch 351 in 0.123678 seconds. [TensorRT] INFO: Calibrated batch 352 in 0.126759 seconds. [TensorRT] INFO: Calibrated batch 353 in 0.130658 seconds. [TensorRT] INFO: Calibrated batch 354 in 0.126298 seconds. [TensorRT] INFO: Calibrated batch 355 in 0.125724 seconds. [TensorRT] INFO: Calibrated batch 356 in 0.13436 seconds. [TensorRT] INFO: Calibrated batch 357 in 0.128994 seconds. [TensorRT] INFO: Calibrated batch 358 in 0.13253 seconds. [TensorRT] INFO: Calibrated batch 359 in 0.130058 seconds. [TensorRT] INFO: Calibrated batch 360 in 0.135799 seconds. [TensorRT] INFO: Calibrated batch 361 in 0.133442 seconds. [TensorRT] INFO: Calibrated batch 362 in 0.128069 seconds. [TensorRT] INFO: Calibrated batch 363 in 0.131504 seconds. [TensorRT] INFO: Calibrated batch 364 in 0.128382 seconds. [TensorRT] INFO: Calibrated batch 365 in 0.126124 seconds. [TensorRT] INFO: Calibrated batch 366 in 0.129316 seconds. [TensorRT] INFO: Calibrated batch 367 in 0.125376 seconds. [TensorRT] INFO: Calibrated batch 368 in 0.128968 seconds. [TensorRT] INFO: Calibrated batch 369 in 0.127492 seconds. [TensorRT] INFO: Calibrated batch 370 in 0.128805 seconds. [TensorRT] INFO: Calibrated batch 371 in 0.128387 seconds. [TensorRT] INFO: Calibrated batch 372 in 0.127375 seconds. [TensorRT] INFO: Calibrated batch 373 in 0.129333 seconds. [TensorRT] INFO: Calibrated batch 374 in 0.126125 seconds. [TensorRT] INFO: Calibrated batch 375 in 0.129601 seconds. [TensorRT] INFO: Calibrated batch 376 in 0.128111 seconds. [TensorRT] INFO: Calibrated batch 377 in 0.13539 seconds. [TensorRT] INFO: Calibrated batch 378 in 0.130108 seconds. [TensorRT] INFO: Calibrated batch 379 in 0.127454 seconds. [TensorRT] INFO: Calibrated batch 380 in 0.130517 seconds. [TensorRT] INFO: Calibrated batch 381 in 0.132668 seconds. [TensorRT] INFO: Calibrated batch 382 in 0.129688 seconds. [TensorRT] INFO: Calibrated batch 383 in 0.126192 seconds. [TensorRT] INFO: Calibrated batch 384 in 0.124365 seconds. [TensorRT] INFO: Calibrated batch 385 in 0.125276 seconds. [TensorRT] INFO: Calibrated batch 386 in 0.123798 seconds. [TensorRT] INFO: Calibrated batch 387 in 0.125505 seconds. [TensorRT] INFO: Calibrated batch 388 in 0.126291 seconds. [TensorRT] INFO: Calibrated batch 389 in 0.124743 seconds. [TensorRT] INFO: Calibrated batch 390 in 0.124379 seconds. [TensorRT] INFO: Calibrated batch 391 in 0.126526 seconds. [TensorRT] INFO: Calibrated batch 392 in 0.12603 seconds. [TensorRT] INFO: Calibrated batch 393 in 0.127474 seconds. [TensorRT] INFO: Calibrated batch 394 in 0.12729 seconds. [TensorRT] INFO: Calibrated batch 395 in 0.130453 seconds. [TensorRT] INFO: Calibrated batch 396 in 0.130935 seconds. [TensorRT] INFO: Calibrated batch 397 in 0.125806 seconds. [TensorRT] INFO: Calibrated batch 398 in 0.12745 seconds. [TensorRT] INFO: Calibrated batch 399 in 0.126204 seconds. [TensorRT] INFO: Calibrated batch 400 in 0.12714 seconds. [TensorRT] INFO: Calibrated batch 401 in 0.126632 seconds. [TensorRT] INFO: Calibrated batch 402 in 0.124334 seconds. [TensorRT] INFO: Calibrated batch 403 in 0.127929 seconds. [TensorRT] INFO: Calibrated batch 404 in 0.126728 seconds. [TensorRT] INFO: Calibrated batch 405 in 0.126617 seconds. [TensorRT] INFO: Calibrated batch 406 in 0.123531 seconds. [TensorRT] INFO: Calibrated batch 407 in 0.127067 seconds. [TensorRT] INFO: Calibrated batch 408 in 0.124028 seconds. [TensorRT] INFO: Calibrated batch 409 in 0.127502 seconds. [TensorRT] INFO: Calibrated batch 410 in 0.127023 seconds. [TensorRT] INFO: Calibrated batch 411 in 0.12719 seconds. [TensorRT] INFO: Calibrated batch 412 in 0.124918 seconds. [TensorRT] INFO: Calibrated batch 413 in 0.131529 seconds. [TensorRT] INFO: Calibrated batch 414 in 0.126947 seconds. [TensorRT] INFO: Calibrated batch 415 in 0.12888 seconds. [TensorRT] INFO: Calibrated batch 416 in 0.131224 seconds. [TensorRT] INFO: Calibrated batch 417 in 0.129287 seconds. [TensorRT] INFO: Calibrated batch 418 in 0.125476 seconds. [TensorRT] INFO: Calibrated batch 419 in 0.127206 seconds. [TensorRT] INFO: Calibrated batch 420 in 0.126726 seconds. [TensorRT] INFO: Calibrated batch 421 in 0.127135 seconds. [TensorRT] INFO: Calibrated batch 422 in 0.128183 seconds. [TensorRT] INFO: Calibrated batch 423 in 0.126246 seconds. [TensorRT] INFO: Calibrated batch 424 in 0.129372 seconds. [TensorRT] INFO: Calibrated batch 425 in 0.126322 seconds. [TensorRT] INFO: Calibrated batch 426 in 0.127167 seconds. [TensorRT] INFO: Calibrated batch 427 in 0.126472 seconds. [TensorRT] INFO: Calibrated batch 428 in 0.127151 seconds. IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.011764706 0.9882353 IMG (1, 3, 224, 224) 0.011764706 0.9764706 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.043137256 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.015686275 0.9529412 IMG (1, 3, 224, 224) 0.039215688 1.0 IMG (1, 3, 224, 224) 0.007843138 0.99215686 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.02745098 0.99215686 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.043137256 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.05882353 0.99215686 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.015686275 0.98039216 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.039215688 0.972549 IMG (1, 3, 224, 224) 0.011764706 0.9254902 IMG (1, 3, 224, 224) 0.043137256 0.99215686 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.015686275 0.96862745 IMG (1, 3, 224, 224) 0.019607844 0.9490196 IMG (1, 3, 224, 224) 0.03137255 0.99607843 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.011764706 0.96862745 IMG (1, 3, 224, 224) 0.03137255 0.93333334 IMG (1, 3, 224, 224) 0.05882353 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.02745098 0.9882353 IMG (1, 3, 224, 224) 0.023529412 0.99215686 IMG (1, 3, 224, 224) 0.003921569 0.98039216 IMG (1, 3, 224, 224) 0.011764706 0.99215686 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.019607844 0.9529412 IMG (1, 3, 224, 224) 0.0627451 1.0 IMG (1, 3, 224, 224) 0.019607844 0.99215686 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.007843138 0.95686275 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.019607844 0.99607843 IMG (1, 3, 224, 224) 0.019607844 0.98039216 IMG (1, 3, 224, 224) 0.023529412 0.93333334 IMG (1, 3, 224, 224) 0.011764706 0.96862745 IMG (1, 3, 224, 224) 0.003921569 0.99215686 IMG (1, 3, 224, 224) 0.03529412 0.99607843 IMG (1, 3, 224, 224) 0.023529412 0.9411765 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.019607844 0.98039216 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.011764706 0.9764706 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.015686275 0.95686275 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.003921569 0.972549 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.015686275 0.9843137 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.019607844 0.9882353 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.019607844 0.99607843 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.023529412 0.972549 IMG (1, 3, 224, 224) 0.003921569 0.9607843 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.043137256 0.99215686 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.007843138 0.9882353 IMG (1, 3, 224, 224) 0.03529412 0.9607843 IMG (1, 3, 224, 224) 0.09411765 0.99215686 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.015686275 0.9843137 IMG (1, 3, 224, 224) 0.007843138 0.99607843 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.007843138 0.9882353 IMG (1, 3, 224, 224) 0.003921569 0.9372549 IMG (1, 3, 224, 224) 0.05490196 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.007843138 0.9529412 IMG (1, 3, 224, 224) 0.03137255 0.9882353 IMG (1, 3, 224, 224) 0.007843138 0.96862745 IMG (1, 3, 224, 224) 0.019607844 0.9137255 IMG (1, 3, 224, 224) 0.023529412 0.94509804 IMG (1, 3, 224, 224) 0.011764706 0.9843137 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.015686275 0.92941177 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.19215687 0.8039216 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.02745098 0.99215686 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.015686275 0.94509804 IMG (1, 3, 224, 224) 0.07058824 0.8039216 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.023529412 0.9490196 IMG (1, 3, 224, 224) 0.023529412 0.972549 IMG (1, 3, 224, 224) 0.003921569 0.9490196 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.011764706 0.95686275 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.039215688 1.0 IMG (1, 3, 224, 224) 0.003921569 0.99607843 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.03137255 0.9882353 IMG (1, 3, 224, 224) 0.02745098 0.9882353 IMG (1, 3, 224, 224) 0.043137256 1.0 IMG (1, 3, 224, 224) 0.007843138 0.972549 IMG (1, 3, 224, 224) 0.043137256 1.0 IMG (1, 3, 224, 224) 0.003921569 0.9843137 IMG (1, 3, 224, 224) 0.02745098 0.92941177 IMG (1, 3, 224, 224) 0.003921569 0.9764706 IMG (1, 3, 224, 224) 0.015686275 0.99215686 IMG (1, 3, 224, 224) 0.047058824 0.98039216 IMG (1, 3, 224, 224) 0.011764706 0.9882353 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.007843138 0.8509804 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.023529412 0.99215686 IMG (1, 3, 224, 224) 0.043137256 0.9882353 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.015686275 0.9411765 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.015686275 0.9843137 IMG (1, 3, 224, 224) 0.050980393 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.03137255 0.99607843 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.03529412 0.9882353 IMG (1, 3, 224, 224) 0.019607844 0.99607843 IMG (1, 3, 224, 224) 0.03529412 0.9843137 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.043137256 0.9882353 IMG (1, 3, 224, 224) 0.015686275 0.99607843 IMG (1, 3, 224, 224) 0.015686275 0.99607843 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.047058824 1.0 IMG (1, 3, 224, 224) 0.011764706 0.93333334 IMG (1, 3, 224, 224) 0.03137255 0.99215686 IMG (1, 3, 224, 224) 0.019607844 0.9882353 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.03137255 0.9843137 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.023529412 0.99215686 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.007843138 0.99215686 IMG (1, 3, 224, 224) 0.015686275 0.9607843 IMG (1, 3, 224, 224) 0.023529412 0.99215686 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.039215688 0.98039216 IMG (1, 3, 224, 224) 0.003921569 0.99607843 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.003921569 0.9882353 IMG (1, 3, 224, 224) 0.015686275 0.99215686 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.003921569 1.0 IMG (1, 3, 224, 224) 0.02745098 0.9607843 IMG[TensorRT] INFO: Calibrated batch 429 in 0.123508 seconds. [TensorRT] INFO: Calibrated batch 430 in 0.123718 seconds. [TensorRT] INFO: Calibrated batch 431 in 0.126317 seconds. [TensorRT] INFO: Calibrated batch 432 in 0.125545 seconds. [TensorRT] INFO: Calibrated batch 433 in 0.127471 seconds. [TensorRT] INFO: Calibrated batch 434 in 0.133588 seconds. [TensorRT] INFO: Calibrated batch 435 in 0.130854 seconds. [TensorRT] INFO: Calibrated batch 436 in 0.126862 seconds. [TensorRT] INFO: Calibrated batch 437 in 0.127971 seconds. [TensorRT] INFO: Calibrated batch 438 in 0.126788 seconds. [TensorRT] INFO: Calibrated batch 439 in 0.126582 seconds. [TensorRT] INFO: Calibrated batch 440 in 0.127669 seconds. [TensorRT] INFO: Calibrated batch 441 in 0.125266 seconds. [TensorRT] INFO: Calibrated batch 442 in 0.127901 seconds. [TensorRT] INFO: Calibrated batch 443 in 0.126473 seconds. [TensorRT] INFO: Calibrated batch 444 in 0.12712 seconds. [TensorRT] INFO: Calibrated batch 445 in 0.127487 seconds. [TensorRT] INFO: Calibrated batch 446 in 0.126484 seconds. [TensorRT] INFO: Calibrated batch 447 in 0.126105 seconds. [TensorRT] INFO: Calibrated batch 448 in 0.125786 seconds. [TensorRT] INFO: Calibrated batch 449 in 0.125115 seconds. [TensorRT] INFO: Calibrated batch 450 in 0.126227 seconds. [TensorRT] INFO: Calibrated batch 451 in 0.132369 seconds. [TensorRT] INFO: Calibrated batch 452 in 0.130297 seconds. [TensorRT] INFO: Calibrated batch 453 in 0.127285 seconds. [TensorRT] INFO: Calibrated batch 454 in 0.127492 seconds. [TensorRT] INFO: Calibrated batch 455 in 0.126922 seconds. [TensorRT] INFO: Calibrated batch 456 in 0.125649 seconds. [TensorRT] INFO: Calibrated batch 457 in 0.125095 seconds. [TensorRT] INFO: Calibrated batch 458 in 0.126465 seconds. [TensorRT] INFO: Calibrated batch 459 in 0.127399 seconds. [TensorRT] INFO: Calibrated batch 460 in 0.128772 seconds. [TensorRT] INFO: Calibrated batch 461 in 0.123679 seconds. [TensorRT] INFO: Calibrated batch 462 in 0.126831 seconds. [TensorRT] INFO: Calibrated batch 463 in 0.12641 seconds. [TensorRT] INFO: Calibrated batch 464 in 0.124948 seconds. [TensorRT] INFO: Calibrated batch 465 in 0.124239 seconds. [TensorRT] INFO: Calibrated batch 466 in 0.128172 seconds. [TensorRT] INFO: Calibrated batch 467 in 0.124969 seconds. [TensorRT] INFO: Calibrated batch 468 in 0.126699 seconds. [TensorRT] INFO: Calibrated batch 469 in 0.128871 seconds. [TensorRT] INFO: Calibrated batch 470 in 0.12643 seconds. [TensorRT] INFO: Calibrated batch 471 in 0.125956 seconds. [TensorRT] INFO: Calibrated batch 472 in 0.123966 seconds. [TensorRT] INFO: Calibrated batch 473 in 0.129913 seconds. [TensorRT] INFO: Calibrated batch 474 in 0.128808 seconds. [TensorRT] INFO: Calibrated batch 475 in 0.126789 seconds. [TensorRT] INFO: Calibrated batch 476 in 0.126437 seconds. [TensorRT] INFO: Calibrated batch 477 in 0.126275 seconds. [TensorRT] INFO: Calibrated batch 478 in 0.12665 seconds. [TensorRT] INFO: Calibrated batch 479 in 0.124176 seconds. [TensorRT] INFO: Calibrated batch 480 in 0.126291 seconds. [TensorRT] INFO: Calibrated batch 481 in 0.133053 seconds. [TensorRT] INFO: Calibrated batch 482 in 0.132482 seconds. [TensorRT] INFO: Calibrated batch 483 in 0.126012 seconds. [TensorRT] INFO: Calibrated batch 484 in 0.126536 seconds. [TensorRT] INFO: Calibrated batch 485 in 0.133978 seconds. [TensorRT] INFO: Calibrated batch 486 in 0.134408 seconds. [TensorRT] INFO: Calibrated batch 487 in 0.129727 seconds. [TensorRT] INFO: Calibrated batch 488 in 0.125369 seconds. [TensorRT] INFO: Calibrated batch 489 in 0.129321 seconds. [TensorRT] INFO: Calibrated batch 490 in 0.129893 seconds. [TensorRT] INFO: Calibrated batch 491 in 0.132691 seconds. [TensorRT] INFO: Calibrated batch 492 in 0.126197 seconds. [TensorRT] INFO: Calibrated batch 493 in 0.129902 seconds. [TensorRT] INFO: Calibrated batch 494 in 0.125262 seconds. [TensorRT] INFO: Calibrated batch 495 in 0.126024 seconds. [TensorRT] INFO: Calibrated batch 496 in 0.126535 seconds. [TensorRT] INFO: Calibrated batch 497 in 0.129948 seconds. [TensorRT] INFO: Calibrated batch 498 in 0.131413 seconds. [TensorRT] INFO: Calibrated batch 499 in 0.127153 seconds. [TensorRT] INFO: Calibrated batch 500 in 0.12532 seconds. [TensorRT] INFO: Calibrated batch 501 in 0.126837 seconds. [TensorRT] INFO: Calibrated batch 502 in 0.12444 seconds. [TensorRT] INFO: Calibrated batch 503 in 0.12861 seconds. [TensorRT] INFO: Calibrated batch 504 in 0.127216 seconds. [TensorRT] INFO: Calibrated batch 505 in 0.132131 seconds. [TensorRT] INFO: Calibrated batch 506 in 0.129299 seconds. [TensorRT] INFO: Calibrated batch 507 in 0.12664 seconds. [TensorRT] INFO: Calibrated batch 508 in 0.12914 seconds. [TensorRT] INFO: Calibrated batch 509 in 0.12834 seconds. [TensorRT] INFO: Calibrated batch 510 in 0.132043 seconds. [TensorRT] INFO: Calibrated batch 511 in 0.127309 seconds. [TensorRT] INFO: Calibrated batch 512 in 0.129911 seconds. [TensorRT] INFO: Calibrated batch 513 in 0.129701 seconds. [TensorRT] INFO: Calibrated batch 514 in 0.130719 seconds. [TensorRT] INFO: Calibrated batch 515 in 0.126512 seconds. [TensorRT] INFO: Calibrated batch 516 in 0.142216 seconds. [TensorRT] INFO: Calibrated batch 517 in 0.138524 seconds. [TensorRT] INFO: Calibrated batch 518 in 0.137078 seconds. [TensorRT] INFO: Calibrated batch 519 in 0.128573 seconds. [TensorRT] INFO: Calibrated batch 520 in 0.131769 seconds. [TensorRT] INFO: Calibrated batch 521 in 0.128366 seconds. [TensorRT] INFO: Calibrated batch 522 in 0.132607 seconds. [TensorRT] INFO: Calibrated batch 523 in 0.127549 seconds. [TensorRT] INFO: Calibrated batch 524 in 0.128815 seconds. [TensorRT] INFO: Calibrated batch 525 in 0.126368 seconds. [TensorRT] INFO: Calibrated batch 526 in 0.128474 seconds. [TensorRT] INFO: Calibrated batch 527 in 0.125447 seconds. [TensorRT] INFO: Calibrated batch 528 in 0.128594 seconds. [TensorRT] INFO: Calibrated batch 529 in 0.126255 seconds. [TensorRT] INFO: Calibrated batch 530 in 0.126902 seconds. [TensorRT] INFO: Calibrated batch 531 in 0.124704 seconds. [TensorRT] INFO: Calibrated batch 532 in 0.126041 seconds. [TensorRT] INFO: Calibrated batch 533 in 0.126859 seconds. [TensorRT] INFO: Calibrated batch 534 in 0.125688 seconds. [TensorRT] INFO: Calibrated batch 535 in 0.126421 seconds. [TensorRT] INFO: Calibrated batch 536 in 0.130761 seconds. [TensorRT] INFO: Calibrated batch 537 in 0.126254 seconds. [TensorRT] INFO: Calibrated batch 538 in 0.129049 seconds. [TensorRT] INFO: Calibrated batch 539 in 0.130114 seconds. [TensorRT] INFO: Calibrated batch 540 in 0.126166 seconds. [TensorRT] INFO: Calibrated batch 541 in 0.131005 seconds. [TensorRT] INFO: Calibrated batch 542 in 0.126008 seconds. [TensorRT] INFO: Calibrated batch 543 in 0.126208 seconds. [TensorRT] INFO: Calibrated batch 544 in 0.13378 seconds. [TensorRT] INFO: Calibrated batch 545 in 0.131311 seconds. [TensorRT] INFO: Calibrated batch 546 in 0.130414 seconds. [TensorRT] INFO: Calibrated batch 547 in 0.127426 seconds. [TensorRT] INFO: Calibrated batch 548 in 0.13055 seconds. [TensorRT] INFO: Calibrated batch 549 in 0.12612 seconds. [TensorRT] INFO: Calibrated batch 550 in 0.132196 seconds. [TensorRT] INFO: Calibrated batch 551 in 0.12808 seconds. [TensorRT] INFO: Calibrated batch 552 in 0.131388 seconds. [TensorRT] INFO: Calibrated batch 553 in 0.132674 seconds. [TensorRT] INFO: Calibrated batch 554 in 0.132684 seconds. [TensorRT] INFO: Calibrated batch 555 in 0.129901 seconds. [TensorRT] INFO: Calibrated batch 556 in 0.132066 seconds. [TensorRT] INFO: Calibrated batch 557 in 0.131879 seconds. [TensorRT] INFO: Calibrated batch 558 in 0.128323 seconds. [TensorRT] INFO: Calibrated batch 559 in 0.126308 seconds. [TensorRT] INFO: Calibrated batch 560 in 0.130689 seconds. [TensorRT] INFO: Calibrated batch 561 in 0.131903 seconds. [TensorRT] INFO: Calibrated batch 562 in 0.127826 seconds. [TensorRT] INFO: Calibrated batch 563 in 0.127034 seconds. [TensorRT] INFO: Calibrated batch 564 in 0.12674 seconds. [TensorRT] INFO: Calibrated batch 565 in 0.126652 seconds. [TensorRT] INFO: Calibrated batch 566 in 0.130252 seconds. [TensorRT] INFO: Calibrated batch 567 in 0.12941 seconds. [TensorRT] INFO: Calibrated batch 568 in 0.135131 seconds. [TensorRT] INFO: Calibrated batch 569 in 0.128339 seconds. [TensorRT] INFO: Calibrated batch 570 in 0.130212 seconds. [TensorRT] INFO: Calibrated batch 571 in 0.126636 seconds. [TensorRT] INFO: Calibrated batch 572 in 0.130022 seconds. [TensorRT] INFO: Calibrated batch 573 in 0.125816 seconds. [TensorRT] INFO: Calibrated batch 574 in 0.130808 seconds. [TensorRT] INFO: Calibrated batch 575 in 0.125269 seconds. [TensorRT] INFO: Calibrated batch 576 in 0.128191 seconds. [TensorRT] INFO: Calibrated batch 577 in 0.130175 seconds. [TensorRT] INFO: Calibrated batch 578 in 0.130767 seconds. [TensorRT] INFO: Calibrated batch 579 in 0.12601 seconds. [TensorRT] INFO: Calibrated batch 580 in 0.125799 seconds. [TensorRT] INFO: Calibrated batch 581 in 0.126373 seconds. [TensorRT] INFO: Calibrated batch 582 in 0.130841 seconds. [TensorRT] INFO: Calibrated batch 583 in 0.131178 seconds. [TensorRT] INFO: Calibrated batch 584 in 0.128519 seconds. [TensorRT] INFO: Calibrated batch 585 in 0.126285 seconds. [TensorRT] INFO: Calibrated batch 586 in 0.127448 seconds. [TensorRT] INFO: Calibrated batch 587 in 0.127815 seconds. [TensorRT] INFO: Calibrated batch 588 in 0.130448 seconds. [TensorRT] INFO: Post Processing Calibration data in 7.7704 seconds. [TensorRT] VERBOSE: Overriding tensor scales: 445 [0.0678159] using 445 [0.0678159] [TensorRT] VERBOSE: Overriding tensor scales: 493 [0.0921055] using 493 [0.0921055] [TensorRT] VERBOSE: Overriding tensor scales: 583 [0.0971366] using 583 [0.0971366] [TensorRT] VERBOSE: Overriding tensor scales: 673 [0.0606512] using 673 [0.0606512] [TensorRT] VERBOSE: Overriding tensor scales: 735 [0.0431528] using 735 [0.0431528] [TensorRT] VERBOSE: Overriding tensor scales: 427 copy [0.0791039] using 445 [0.0678159] [TensorRT] VERBOSE: Overriding tensor scales: 427 [0.0791039] using 427 copy [0.0678159] [TensorRT] VERBOSE: Overriding tensor scales: 444 copy [0.0738393] using 445 [0.0678159] [TensorRT] VERBOSE: Overriding tensor scales: 444 [0.0738393] using 444 copy [0.0678159] [TensorRT] VERBOSE: Overriding tensor scales: 468 copy [0.113491] using 493 [0.0921055] [TensorRT] VERBOSE: Overriding tensor scales: 468 [0.113491] using 468 copy [0.0921055] [TensorRT] VERBOSE: Overriding tensor scales: 492 copy [0.0736988] using 493 [0.0921055] [TensorRT] VERBOSE: Overriding tensor scales: 492 [0.0736988] using 492 copy [0.0921055] [TensorRT] VERBOSE: Overriding tensor scales: 516 copy [0.0758936] using 583 [0.0971366] [TensorRT] VERBOSE: Overriding tensor scales: 516 [0.0758936] using 516 copy [0.0971366] [TensorRT] VERBOSE: Overriding tensor scales: 582 copy [0.0971366] using 583 [0.0971366] [TensorRT] VERBOSE: Overriding tensor scales: 582 [0.0971366] using 582 copy [0.0971366] [TensorRT] VERBOSE: Overriding tensor scales: 606 copy [0.0814552] using 673 [0.0606512] [TensorRT] VERBOSE: Overriding tensor scales: 606 [0.0814552] using 606 copy [0.0606512] [TensorRT] VERBOSE: Overriding tensor scales: 672 copy [0.0681587] using 673 [0.0606512] [TensorRT] VERBOSE: Overriding tensor scales: 672 [0.0681587] using 672 copy [0.0606512] [TensorRT] VERBOSE: Overriding tensor scales: 696 copy [0.0463332] using 735 [0.0431528] [TensorRT] VERBOSE: Overriding tensor scales: 696 [0.0463332] using 696 copy [0.0431528] [TensorRT] VERBOSE: Overriding tensor scales: 734 copy [0.0379814] using 735 [0.0431528] [TensorRT] VERBOSE: Overriding tensor scales: 734 [0.0379814] using 734 copy [0.0431528] [TensorRT] INFO: Calibration completed in 97.6554 seconds. [TensorRT] VERBOSE: INT8 Inference Tensor Scales: input range [-1.00393,1.00393] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 742 range [-32.5636,32.5636] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 407 range [-20.1225,20.1225] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 745 range [-50.9326,50.9326] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 410 range [-15.9022,15.9022] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 748 range [-25.763,25.763] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 413 range [-10.0462,10.0462] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 427 range [-8.61263,8.61263] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 434 range [-4.64615,4.64615] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 751 range [-15.4789,15.4789] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 437 range [-9.87677,9.87677] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 754 range [-19.4655,19.4655] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 440 range [-9.66985,9.66985] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 441 range [-12.0681,12.0681] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 757 range [-33.3061,33.3061] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 444 range [-8.61263,8.61263] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 445 range [-8.61263,8.61263] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 760 range [-44.7321,44.7321] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 448 range [-11.3289,11.3289] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 763 range [-28.2495,28.2495] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 451 range [-11.3086,11.3086] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 766 range [-21.353,21.353] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 454 range [-19.4196,19.4196] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 468 range [-11.6974,11.6974] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 475 range [-19.1542,19.1542] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 769 range [-22.9439,22.9439] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 478 range [-9.26009,9.26009] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 772 range [-12.3008,12.3008] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 481 range [-12.0409,12.0409] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 482 range [-23.7016,23.7016] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 775 range [-20.1076,20.1076] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 485 range [-7.17082,7.17082] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 778 range [-20.5535,20.5535] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 488 range [-9.02789,9.02789] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 489 range [-28.5835,28.5835] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 781 range [-36.3534,36.3534] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 492 range [-11.6974,11.6974] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 493 range [-11.6974,11.6974] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 784 range [-30.5557,30.5557] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 496 range [-10.2623,10.2623] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 787 range [-29.9668,29.9668] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 499 range [-8.91468,8.91468] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 790 range [-23.1169,23.1169] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 502 range [-10.9953,10.9953] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 516 range [-12.3364,12.3364] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 523 range [-19.2337,19.2337] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 793 range [-18.4741,18.4741] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 526 range [-4.99589,4.99589] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 796 range [-14.2,14.2] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 529 range [-7.62024,7.62024] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 530 range [-20.4936,20.4936] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 799 range [-20.5033,20.5033] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 533 range [-4.418,4.418] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 802 range [-16.8317,16.8317] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 536 range [-6.60051,6.60051] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 537 range [-26.3297,26.3297] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 805 range [-24.4092,24.4092] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 540 range [-6.2596,6.2596] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 808 range [-23.3917,23.3917] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 543 range [-6.05549,6.05549] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 544 range [-26.3044,26.3044] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 811 range [-21.0757,21.0757] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 547 range [-4.21424,4.21424] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 814 range [-15.137,15.137] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 550 range [-6.63438,6.63438] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 551 range [-26.3547,26.3547] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 817 range [-19.2521,19.2521] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 554 range [-4.27214,4.27214] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 820 range [-13.0728,13.0728] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 557 range [-6.60926,6.60926] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 558 range [-33.6504,33.6504] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 823 range [-21.2943,21.2943] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 561 range [-4.29043,4.29043] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 826 range [-29.9767,29.9767] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 564 range [-6.53392,6.53392] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 565 range [-35.7576,35.7576] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 829 range [-25.3592,25.3592] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 568 range [-3.99582,3.99582] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 832 range [-33.3895,33.3895] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 571 range [-7.15196,7.15196] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 572 range [-40.2241,40.2241] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 835 range [-20.9576,20.9576] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 575 range [-4.66707,4.66707] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 838 range [-24.1945,24.1945] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 578 range [-8.67392,8.67392] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 579 range [-42.6658,42.6658] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 841 range [-39.878,39.878] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 582 range [-12.3364,12.3364] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 583 range [-12.3364,12.3364] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 844 range [-29.4597,29.4597] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 586 range [-9.48325,9.48325] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 847 range [-27.2474,27.2474] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 589 range [-7.45693,7.45693] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 850 range [-24.3539,24.3539] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 592 range [-6.90103,6.90103] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 606 range [-7.7027,7.7027] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 613 range [-6.786,6.786] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 853 range [-11.6477,11.6477] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 616 range [-2.98948,2.98948] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 856 range [-13.5593,13.5593] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 619 range [-4.09293,4.09293] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 620 range [-6.90146,6.90146] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 859 range [-14.2495,14.2495] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 623 range [-2.96907,2.96907] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 862 range [-15.6022,15.6022] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 626 range [-4.64739,4.64739] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 627 range [-9.41263,9.41263] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 865 range [-14.6816,14.6816] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 630 range [-3.5394,3.5394] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 868 range [-12.9365,12.9365] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 633 range [-3.74887,3.74887] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 634 range [-9.58003,9.58003] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 871 range [-14.0772,14.0772] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 637 range [-3.73121,3.73121] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 874 range [-15.4864,15.4864] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 640 range [-4.40331,4.40331] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 641 range [-13.1791,13.1791] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 877 range [-16.2579,16.2579] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 644 range [-3.75226,3.75226] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 880 range [-16.1968,16.1968] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 647 range [-5.3256,5.3256] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 648 range [-16.2959,16.2959] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 883 range [-16.2161,16.2161] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 651 range [-3.73207,3.73207] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 886 range [-18.8605,18.8605] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 654 range [-7.34135,7.34135] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 655 range [-22.5485,22.5485] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 889 range [-19.546,19.546] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 658 range [-3.68857,3.68857] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 892 range [-20.627,20.627] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 661 range [-6.58501,6.58501] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 662 range [-26.6876,26.6876] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 895 range [-16.1682,16.1682] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 665 range [-3.17377,3.17377] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 898 range [-24.5131,24.5131] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 668 range [-8.50285,8.50285] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 669 range [-31.2275,31.2275] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 901 range [-24.6115,24.6115] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 672 range [-7.7027,7.7027] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 673 range [-7.7027,7.7027] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 904 range [-32.7021,32.7021] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 676 range [-9.34998,9.34998] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 907 range [-26.6147,26.6147] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 679 range [-6.60015,6.60015] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 910 range [-29.4363,29.4363] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 682 range [-5.54049,5.54049] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 696 range [-5.4804,5.4804] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 703 range [-5.54049,5.54049] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 913 range [-16.3939,16.3939] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 706 range [-3.88894,3.88894] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 916 range [-22.3295,22.3295] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 709 range [-4.14692,4.14692] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 710 range [-9.16698,9.16698] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 919 range [-22.4496,22.4496] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 713 range [-3.26028,3.26028] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 922 range [-25.6605,25.6605] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 716 range [-4.80707,4.80707] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 717 range [-11.148,11.148] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 925 range [-22.9575,22.9575] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 720 range [-2.95282,2.95282] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 928 range [-26.5847,26.5847] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 723 range [-7.16201,7.16201] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 724 range [-14.1612,14.1612] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 931 range [-20.1133,20.1133] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 727 range [-2.50176,2.50176] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 934 range [-27.041,27.041] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 730 range [-8.12325,8.12325] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 731 range [-22.19,22.19] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 937 range [-24.8571,24.8571] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 734 range [-5.4804,5.4804] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 735 range [-5.4804,5.4804] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 940 range [-45.1541,45.1541] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 738 range [-7.09355,7.09355] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 739 range [-1.99337,1.99337] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: 740 range [-1.99337,1.99337] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: (Unnamed Layer* 461) [Constant]_output range [-0.151062,0.151062] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: (Unnamed Layer* 462) [Matrix Multiply]_output range [-3.6364,3.6364] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: (Unnamed Layer* 463) [Constant]_output range [-0.137925,0.137925] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: (Unnamed Layer* 464) [Shuffle]_output range [-0.137925,0.137925] [TensorRT] VERBOSE: INT8 Inference Tensor Scales: output range [-3.3504,3.3504] [TensorRT] VERBOSE: Original: 179 layers [TensorRT] VERBOSE: After dead-layer removal: 179 layers [TensorRT] VERBOSE: Fusing (Unnamed Layer* 463) [Constant] with (Unnamed Layer* 464) [Shuffle] [TensorRT] VERBOSE: After Myelin optimization: 178 layers [TensorRT] VERBOSE: After scale fusion: 178 layers [TensorRT] VERBOSE: Swap the layer type of GlobalAveragePool_227 from REDUCE to POOLING [TensorRT] VERBOSE: Fusing LeakyRelu_22 with Add_23 [TensorRT] VERBOSE: Fusing LeakyRelu_49 with Add_50 [TensorRT] VERBOSE: Fusing LeakyRelu_54 with Add_55 [TensorRT] VERBOSE: Fusing LeakyRelu_81 with Add_82 [TensorRT] VERBOSE: Fusing LeakyRelu_86 with Add_87 [TensorRT] VERBOSE: Fusing LeakyRelu_91 with Add_92 [TensorRT] VERBOSE: Fusing LeakyRelu_96 with Add_97 [TensorRT] VERBOSE: Fusing LeakyRelu_101 with Add_102 [TensorRT] VERBOSE: Fusing LeakyRelu_106 with Add_107 [TensorRT] VERBOSE: Fusing LeakyRelu_111 with Add_112 [TensorRT] VERBOSE: Fusing LeakyRelu_116 with Add_117 [TensorRT] VERBOSE: Fusing LeakyRelu_143 with Add_144 [TensorRT] VERBOSE: Fusing LeakyRelu_148 with Add_149 [TensorRT] VERBOSE: Fusing LeakyRelu_153 with Add_154 [TensorRT] VERBOSE: Fusing LeakyRelu_158 with Add_159 [TensorRT] VERBOSE: Fusing LeakyRelu_163 with Add_164 [TensorRT] VERBOSE: Fusing LeakyRelu_168 with Add_169 [TensorRT] VERBOSE: Fusing LeakyRelu_173 with Add_174 [TensorRT] VERBOSE: Fusing LeakyRelu_178 with Add_179 [TensorRT] VERBOSE: Fusing LeakyRelu_205 with Add_206 [TensorRT] VERBOSE: Fusing LeakyRelu_210 with Add_211 [TensorRT] VERBOSE: Fusing LeakyRelu_215 with Add_216 [TensorRT] VERBOSE: Fusing LeakyRelu_220 with Add_221 [TensorRT] VERBOSE: After vertical fusions: 155 layers [TensorRT] VERBOSE: After final dead-layer removal: 155 layers [TensorRT] VERBOSE: After tensor merging: 155 layers [TensorRT] VERBOSE: Replacing slice Slice_18 with copy from 413 to 434 [TensorRT] VERBOSE: Overriding 434 range [-4.64615,4.64615] using 413 range [-10.0462,10.0462] [TensorRT] VERBOSE: Assigning 413 copy range using 413 range [-10.0462,10.0462] [TensorRT] VERBOSE: Replacing slice Slice_15 with copy from 413 to 427 [TensorRT] VERBOSE: Overriding 427 range [-8.61263,8.61263] using 413 range [-10.0462,10.0462] [TensorRT] VERBOSE: Assigning 413 copy range using 413 range [-10.0462,10.0462] [TensorRT] VERBOSE: Replacing slice Slice_45 with copy from 454 to 475 [TensorRT] VERBOSE: Overriding 475 range [-19.1542,19.1542] using 454 range [-19.4196,19.4196] [TensorRT] VERBOSE: Assigning 454 copy range using 454 range [-19.4196,19.4196] [TensorRT] VERBOSE: Replacing slice Slice_42 with copy from 454 to 468 [TensorRT] VERBOSE: Overriding 468 range [-11.6974,11.6974] using 454 range [-19.4196,19.4196] [TensorRT] VERBOSE: Assigning 454 copy range using 454 range [-19.4196,19.4196] [TensorRT] VERBOSE: Replacing slice Slice_77 with copy from 502 to 523 [TensorRT] VERBOSE: Overriding 523 range [-19.2337,19.2337] using 502 range [-10.9953,10.9953] [TensorRT] VERBOSE: Assigning 502 copy range using 502 range [-10.9953,10.9953] [TensorRT] VERBOSE: Replacing slice Slice_74 with copy from 502 to 516 [TensorRT] VERBOSE: Overriding 516 range [-12.3364,12.3364] using 502 range [-10.9953,10.9953] [TensorRT] VERBOSE: Assigning 502 copy range using 502 range [-10.9953,10.9953] [TensorRT] VERBOSE: Replacing slice Slice_139 with copy from 592 to 613 [TensorRT] VERBOSE: Overriding 613 range [-6.786,6.786] using 592 range [-6.90103,6.90103] [TensorRT] VERBOSE: Assigning 592 copy range using 592 range [-6.90103,6.90103] [TensorRT] VERBOSE: Replacing slice Slice_136 with copy from 592 to 606 [TensorRT] VERBOSE: Overriding 606 range [-7.7027,7.7027] using 592 range [-6.90103,6.90103] [TensorRT] VERBOSE: Assigning 592 copy range using 592 range [-6.90103,6.90103] [TensorRT] VERBOSE: Replacing slice Slice_201 with copy from 682 to 703 [TensorRT] VERBOSE: Overriding 703 range [-5.54049,5.54049] using 682 range [-5.54049,5.54049] [TensorRT] VERBOSE: Assigning 682 copy range using 682 range [-5.54049,5.54049] [TensorRT] VERBOSE: Replacing slice Slice_198 with copy from 682 to 696 [TensorRT] VERBOSE: Overriding 696 range [-5.4804,5.4804] using 682 range [-5.54049,5.54049] [TensorRT] VERBOSE: Assigning 682 copy range using 682 range [-5.54049,5.54049] [TensorRT] VERBOSE: Eliminating concatenation Concat_26 [TensorRT] VERBOSE: Retargeting 427 to 445 [TensorRT] VERBOSE: Overriding 427 range [-10.0462,10.0462] using 445 range [-8.61263,8.61263] [TensorRT] VERBOSE: Retargeting 444 to 445 [TensorRT] VERBOSE: Overriding 444 range [-8.61263,8.61263] using 445 range [-8.61263,8.61263] [TensorRT] VERBOSE: Eliminating concatenation Concat_58 [TensorRT] VERBOSE: Retargeting 468 to 493 [TensorRT] VERBOSE: Overriding 468 range [-19.4196,19.4196] using 493 range [-11.6974,11.6974] [TensorRT] VERBOSE: Retargeting 492 to 493 [TensorRT] VERBOSE: Overriding 492 range [-11.6974,11.6974] using 493 range [-11.6974,11.6974] [TensorRT] VERBOSE: Eliminating concatenation Concat_120 [TensorRT] VERBOSE: Retargeting 516 to 583 [TensorRT] VERBOSE: Overriding 516 range [-10.9953,10.9953] using 583 range [-12.3364,12.3364] [TensorRT] VERBOSE: Retargeting 582 to 583 [TensorRT] VERBOSE: Overriding 582 range [-12.3364,12.3364] using 583 range [-12.3364,12.3364] [TensorRT] VERBOSE: Eliminating concatenation Concat_182 [TensorRT] VERBOSE: Retargeting 606 to 673 [TensorRT] VERBOSE: Overriding 606 range [-6.90103,6.90103] using 673 range [-7.7027,7.7027] [TensorRT] VERBOSE: Retargeting 672 to 673 [TensorRT] VERBOSE: Overriding 672 range [-7.7027,7.7027] using 673 range [-7.7027,7.7027] [TensorRT] VERBOSE: Eliminating concatenation Concat_224 [TensorRT] VERBOSE: Retargeting 696 to 735 [TensorRT] VERBOSE: Overriding 696 range [-5.54049,5.54049] using 735 range [-5.4804,5.4804] [TensorRT] VERBOSE: Retargeting 734 to 735 [TensorRT] VERBOSE: Overriding 734 range [-5.4804,5.4804] using 735 range [-5.4804,5.4804] [TensorRT] VERBOSE: After concat removal: 150 layers [TensorRT] INFO: Writing Calibration Cache for calibrator: TRT-7103-EntropyCalibration2 [TensorRT] VERBOSE: Dynamic range would not be set for tensor 445. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [TensorRT] VERBOSE: Dynamic range would not be set for tensor 493. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [TensorRT] VERBOSE: Dynamic range would not be set for tensor 583. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [TensorRT] VERBOSE: Dynamic range would not be set for tensor 673. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [TensorRT] VERBOSE: Dynamic range would not be set for tensor 735. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [TensorRT] VERBOSE: Configuring builder for Int8 Mode completed in 97.7489 seconds. [TensorRT] VERBOSE: Graph construction and optimization completed in 97.7672 seconds. [TensorRT] INFO: [TensorRT] INFO: --------------- Layers running on DLA: [TensorRT] INFO: [TensorRT] INFO: --------------- Layers running on GPU: [TensorRT] INFO: Conv_0, LeakyRelu_1, Conv_2, LeakyRelu_3, Conv_4, LeakyRelu_5, Slice_18, Conv_19, LeakyRelu_20, Conv_21, PWN(LeakyRelu_22, Add_23), Conv_24, Slice_15, LeakyRelu_25, Conv_27, LeakyRelu_28, Conv_29, LeakyRelu_30, Conv_31, LeakyRelu_32, Slice_45, Conv_46, LeakyRelu_47, Conv_48, PWN(LeakyRelu_49, Add_50), Conv_51, LeakyRelu_52, Conv_53, PWN(LeakyRelu_54, Add_55), Conv_56, Slice_42, LeakyRelu_57, Conv_59, LeakyRelu_60, Conv_61, LeakyRelu_62, Conv_63, LeakyRelu_64, Slice_77, Conv_78, LeakyRelu_79, Conv_80, PWN(LeakyRelu_81, Add_82), Conv_83, LeakyRelu_84, Conv_85, PWN(LeakyRelu_86, Add_87), Conv_88, LeakyRelu_89, Conv_90, PWN(LeakyRelu_91, Add_92), Conv_93, LeakyRelu_94, Conv_95, PWN(LeakyRelu_96, Add_97), Conv_98, LeakyRelu_99, Conv_100, PWN(LeakyRelu_101, Add_102), Conv_103, LeakyRelu_104, Conv_105, PWN(LeakyRelu_106, Add_107), Conv_108, LeakyRelu_109, Conv_110, PWN(LeakyRelu_111, Add_112), Conv_113, LeakyRelu_114, Conv_115, PWN(LeakyRelu_116, Add_117), Conv_118, Slice_74, LeakyRelu_119, Conv_121, LeakyRelu_122, Conv_123, LeakyRelu_124, Conv_125, LeakyRelu_126, Slice_139, Conv_140, LeakyRelu_141, Conv_142, PWN(LeakyRelu_143, Add_144), Conv_145, LeakyRelu_146, Conv_147, PWN(LeakyRelu_148, Add_149), Conv_150, LeakyRelu_151, Conv_152, PWN(LeakyRelu_153, Add_154), Conv_155, LeakyRelu_156, Conv_157, PWN(LeakyRelu_158, Add_159), Conv_160, LeakyRelu_161, Conv_162, PWN(LeakyRelu_163, Add_164), Conv_165, LeakyRelu_166, Conv_167, PWN(LeakyRelu_168, Add_169), Conv_170, LeakyRelu_171, Conv_172, PWN(LeakyRelu_173, Add_174), Conv_175, LeakyRelu_176, Conv_177, PWN(LeakyRelu_178, Add_179), Conv_180, Slice_136, LeakyRelu_181, Conv_183, LeakyRelu_184, Conv_185, LeakyRelu_186, Conv_187, LeakyRelu_188, Slice_201, Conv_202, LeakyRelu_203, Conv_204, PWN(LeakyRelu_205, Add_206), Conv_207, LeakyRelu_208, Conv_209, PWN(LeakyRelu_210, Add_211), Conv_212, LeakyRelu_213, Conv_214, PWN(LeakyRelu_215, Add_216), Conv_217, LeakyRelu_218, Conv_219, PWN(LeakyRelu_220, Add_221), Conv_222, Slice_198, LeakyRelu_223, Conv_225, LeakyRelu_226, GlobalAveragePool_227, Flatten_228, head.fc.weight, Gemm_229, (Unnamed Layer* 463) [Constant] + (Unnamed Layer* 464) [Shuffle], (Unnamed Layer* 465) [ElementWise], [TensorRT] VERBOSE: Constructing optimization profile number 0 [1/1]. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.202752 [TensorRT] VERBOSE: Tactic: 0 time 0.024448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.241664 [TensorRT] VERBOSE: Tactic: 0 time 0.013312 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013312 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.237792 [TensorRT] VERBOSE: Tactic: 0 time 0.091136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.091136 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,150528) -> Float(1,224,50176,1605632) *************** [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.440512 [TensorRT] VERBOSE: Conv_0 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.221184 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.261632 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.440384 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.651264 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.22528 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.228384 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.178528 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.139808 [TensorRT] VERBOSE: Fastest Tactic: -3946921629105938337 Time: 0.139808 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.370976 [TensorRT] VERBOSE: Tactic: 2 time 1.24621 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 722432, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 19968, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.374208 [TensorRT] INFO: Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output. [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.370976 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3946921629105938337 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176,150528) -> Int8(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,50176) -> Float(1,224,50176,1605632) *************** [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.325024 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.128256 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.107296 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.164576 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.140768 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.120032 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.21824 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.15936 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.319808 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.517568 [TensorRT] VERBOSE: Fastest Tactic: 1659301557717208403 Time: 0.107296 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1659301557717208403 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,50176) -> Int8(1,224,50176:4,401408) *************** [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.121696 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.120704 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.087232 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.2424 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.067968 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.243392 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.064544 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.400672 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.084544 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.140896 [TensorRT] VERBOSE: Fastest Tactic: -6282183216199417697 Time: 0.064544 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6282183216199417697 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,50176) -> Int8(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.090112 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.065952 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.137856 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.064768 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.117344 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.088224 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.234816 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.119296 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.236672 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.391328 [TensorRT] VERBOSE: Fastest Tactic: 8047041638267142825 Time: 0.064768 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8047041638267142825 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:32,50176) -> Float(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:32,50176) -> Int8(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CaskConvolution) [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.285312 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.173568 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.349184 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.169216 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.168256 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.295392 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.351552 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.169216 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.172384 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.161568 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.34672 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.277184 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.161568 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_0 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_0 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.27696 [TensorRT] VERBOSE: Tactic: 0 time 0.80624 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.27696 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.339328 [TensorRT] VERBOSE: Tactic: 0 time 0.070656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.070656 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.329728 [TensorRT] VERBOSE: Tactic: 0 time 0.718048 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.329728 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.706688 [TensorRT] VERBOSE: Tactic: 0 time 0.684416 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.684416 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.356608 [TensorRT] VERBOSE: Tactic: 0 time 0.714176 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.356608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.290848 [TensorRT] VERBOSE: Tactic: 0 time 1.42259 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.290848 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.349152 [TensorRT] VERBOSE: Tactic: 0 time 0.106656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.106656 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.335328 [TensorRT] VERBOSE: Tactic: 0 time 0.86528 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.335328 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.335136 [TensorRT] VERBOSE: Tactic: 0 time 0.043232 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.043232 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.342944 [TensorRT] VERBOSE: Tactic: 0 time 0.492768 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.342944 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.264672 [TensorRT] VERBOSE: Tactic: 0 time 1.2424 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.264672 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.32064 [TensorRT] VERBOSE: Tactic: 0 time 0.041472 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.041472 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,1605632) -> Float(1,224,50176,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.230112 [TensorRT] VERBOSE: Tactic: 256 time 0.232864 [TensorRT] VERBOSE: Tactic: 512 time 0.233792 [TensorRT] VERBOSE: Tactic: -32 time 0.311296 [TensorRT] VERBOSE: Tactic: -64 time 0.27184 [TensorRT] VERBOSE: Tactic: -128 time 0.266944 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.230112 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.13824 [TensorRT] VERBOSE: Tactic: 1 time 0.132512 [TensorRT] VERBOSE: Tactic: 2 time 0.115808 [TensorRT] VERBOSE: Tactic: 3 time 0.130528 [TensorRT] VERBOSE: Tactic: 4 time 0.118144 [TensorRT] VERBOSE: Tactic: 5 time 0.114496 [TensorRT] VERBOSE: Tactic: 6 time 0.135616 [TensorRT] VERBOSE: Tactic: 7 time 0.11936 [TensorRT] VERBOSE: Tactic: 8 time 0.118528 [TensorRT] VERBOSE: Tactic: 9 time 0.11776 [TensorRT] VERBOSE: Tactic: 28 time 0.136064 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.114496 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176:32,50176) -> Float(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.2304 [TensorRT] VERBOSE: Tactic: 256 time 0.231232 [TensorRT] VERBOSE: Tactic: 512 time 0.23504 [TensorRT] VERBOSE: Tactic: -32 time 0.319392 [TensorRT] VERBOSE: Tactic: -64 time 0.272896 [TensorRT] VERBOSE: Tactic: -128 time 0.269824 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.2304 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.190464 [TensorRT] VERBOSE: Tactic: 25 time 0.19136 [TensorRT] VERBOSE: Tactic: 26 time 0.192832 [TensorRT] VERBOSE: Tactic: 27 time 0.194048 [TensorRT] VERBOSE: Tactic: 31 time 0.187392 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.187392 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,401408) -> Int8(1,224,50176:4,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.309248 [TensorRT] VERBOSE: Tactic: 256 time 0.259584 [TensorRT] VERBOSE: Tactic: 512 time 0.26144 [TensorRT] VERBOSE: Tactic: -32 time 0.324256 [TensorRT] VERBOSE: Tactic: -64 time 0.347904 [TensorRT] VERBOSE: Tactic: -128 time 0.34816 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.259584 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.076864 [TensorRT] VERBOSE: Tactic: 1 time 0.057504 [TensorRT] VERBOSE: Tactic: 2 time 0.055808 [TensorRT] VERBOSE: Tactic: 3 time 0.051584 [TensorRT] VERBOSE: Tactic: 4 time 0.054272 [TensorRT] VERBOSE: Tactic: 5 time 0.058208 [TensorRT] VERBOSE: Tactic: 6 time 0.050112 [TensorRT] VERBOSE: Tactic: 7 time 0.05664 [TensorRT] VERBOSE: Tactic: 8 time 0.066208 [TensorRT] VERBOSE: Tactic: 9 time 0.07264 [TensorRT] VERBOSE: Tactic: 10 time 0.137152 [TensorRT] VERBOSE: Tactic: 11 time 0.09904 [TensorRT] VERBOSE: Tactic: 12 time 0.08928 [TensorRT] VERBOSE: Tactic: 13 time 0.081024 [TensorRT] VERBOSE: Tactic: 14 time 0.075808 [TensorRT] VERBOSE: Tactic: 15 time 0.0768 [TensorRT] VERBOSE: Tactic: 16 time 0.075808 [TensorRT] VERBOSE: Tactic: 17 time 0.07296 [TensorRT] VERBOSE: Tactic: 18 time 0.075168 [TensorRT] VERBOSE: Tactic: 19 time 0.081792 [TensorRT] VERBOSE: Tactic: 20 time 0.239456 [TensorRT] VERBOSE: Tactic: 21 time 0.165376 [TensorRT] VERBOSE: Tactic: 22 time 0.116832 [TensorRT] VERBOSE: Tactic: 23 time 0.10096 [TensorRT] VERBOSE: Tactic: 28 time 0.11056 [TensorRT] VERBOSE: Tactic: 29 time 0.146208 [TensorRT] VERBOSE: Tactic: 30 time 0.23072 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.050112 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:32,50176) -> Int8(1,224,50176:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.270784 [TensorRT] VERBOSE: Tactic: 256 time 0.233184 [TensorRT] VERBOSE: Tactic: 512 time 0.231552 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.231552 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.050848 [TensorRT] VERBOSE: Tactic: 11 time 0.05232 [TensorRT] VERBOSE: Tactic: 12 time 0.051168 [TensorRT] VERBOSE: Tactic: 13 time 0.053248 [TensorRT] VERBOSE: Tactic: 14 time 0.052864 [TensorRT] VERBOSE: Tactic: 15 time 0.072064 [TensorRT] VERBOSE: Tactic: 16 time 0.058368 [TensorRT] VERBOSE: Tactic: 17 time 0.053984 [TensorRT] VERBOSE: Tactic: 18 time 0.07264 [TensorRT] VERBOSE: Tactic: 19 time 0.104128 [TensorRT] VERBOSE: Tactic: 20 time 0.058144 [TensorRT] VERBOSE: Tactic: 21 time 0.051232 [TensorRT] VERBOSE: Tactic: 22 time 0.048064 [TensorRT] VERBOSE: Tactic: 23 time 0.05056 [TensorRT] VERBOSE: Tactic: 24 time 0.080736 [TensorRT] VERBOSE: Tactic: 25 time 0.062848 [TensorRT] VERBOSE: Tactic: 26 time 0.052128 [TensorRT] VERBOSE: Tactic: 27 time 0.049984 [TensorRT] VERBOSE: Tactic: 29 time 0.322592 [TensorRT] VERBOSE: Tactic: 30 time 0.179776 [TensorRT] VERBOSE: Tactic: 31 time 0.113952 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.048064 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,224,50176,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.73008 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.73008 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.740352 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.390144 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.735968 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.820224 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.386496 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.390144 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.47792 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.424512 [TensorRT] VERBOSE: Fastest Tactic: 6808617066150061604 Time: 0.386496 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.630112 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 14450688, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 9748480, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 149504, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.630112 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,401408) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.207872 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.140864 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.13312 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.11504 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.136064 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.135168 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.120704 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.113472 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.206496 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.28032 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.113472 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,401408) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.178624 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.178624 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.108992 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.106464 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.124704 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.19968 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.122432 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.198464 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.11616 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.248832 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.115104 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.107744 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.106464 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4581732244273465060 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:4,401408) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.119648 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.118784 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.10688 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.114624 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.106784 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.121664 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.196768 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.10784 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.197632 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.246112 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.106784 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:32,50176) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,224,50176:32,50176) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.157824 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.157824 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CaskConvolution) [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.094976 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.068608 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.105824 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.066784 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.064512 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.097856 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.109088 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.065664 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.068864 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.064864 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.104224 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.088544 [TensorRT] VERBOSE: Fastest Tactic: -9114895246540757312 Time: 0.064512 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_2 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9114895246540757312 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.140352 [TensorRT] VERBOSE: Tactic: 0 time 0.409568 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.140352 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.176896 [TensorRT] VERBOSE: Tactic: 0 time 0.03792 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.03792 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.170464 [TensorRT] VERBOSE: Tactic: 0 time 0.2856 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.170464 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.314432 [TensorRT] VERBOSE: Tactic: 0 time 0.336512 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.314432 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.18592 [TensorRT] VERBOSE: Tactic: 0 time 0.351168 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.18592 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.1752 [TensorRT] VERBOSE: Tactic: 0 time 0.61232 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.1752 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.178176 [TensorRT] VERBOSE: Tactic: 0 time 0.052096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.052096 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.177184 [TensorRT] VERBOSE: Tactic: 0 time 0.380256 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.177184 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.173248 [TensorRT] VERBOSE: Tactic: 0 time 0.023424 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023424 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.174368 [TensorRT] VERBOSE: Tactic: 0 time 0.151136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.151136 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.166304 [TensorRT] VERBOSE: Tactic: 0 time 0.528768 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.166304 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.171456 [TensorRT] VERBOSE: Tactic: 0 time 0.038912 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.038912 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.116512 [TensorRT] VERBOSE: Tactic: 256 time 0.115872 [TensorRT] VERBOSE: Tactic: 512 time 0.11776 [TensorRT] VERBOSE: Tactic: -32 time 0.16896 [TensorRT] VERBOSE: Tactic: -64 time 0.139264 [TensorRT] VERBOSE: Tactic: -128 time 0.136192 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.115872 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.068096 [TensorRT] VERBOSE: Tactic: 1 time 0.064512 [TensorRT] VERBOSE: Tactic: 2 time 0.057728 [TensorRT] VERBOSE: Tactic: 3 time 0.065184 [TensorRT] VERBOSE: Tactic: 4 time 0.059488 [TensorRT] VERBOSE: Tactic: 5 time 0.057344 [TensorRT] VERBOSE: Tactic: 6 time 0.066592 [TensorRT] VERBOSE: Tactic: 7 time 0.059328 [TensorRT] VERBOSE: Tactic: 8 time 0.05744 [TensorRT] VERBOSE: Tactic: 9 time 0.058592 [TensorRT] VERBOSE: Tactic: 28 time 0.067104 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.057344 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.117216 [TensorRT] VERBOSE: Tactic: 256 time 0.11648 [TensorRT] VERBOSE: Tactic: 512 time 0.118656 [TensorRT] VERBOSE: Tactic: -32 time 0.16912 [TensorRT] VERBOSE: Tactic: -64 time 0.140672 [TensorRT] VERBOSE: Tactic: -128 time 0.137216 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.11648 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.09216 [TensorRT] VERBOSE: Tactic: 25 time 0.094528 [TensorRT] VERBOSE: Tactic: 26 time 0.094112 [TensorRT] VERBOSE: Tactic: 27 time 0.09344 [TensorRT] VERBOSE: Tactic: 31 time 0.093568 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.09216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.157344 [TensorRT] VERBOSE: Tactic: 256 time 0.13168 [TensorRT] VERBOSE: Tactic: 512 time 0.133952 [TensorRT] VERBOSE: Tactic: -32 time 0.165888 [TensorRT] VERBOSE: Tactic: -64 time 0.17728 [TensorRT] VERBOSE: Tactic: -128 time 0.17504 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.13168 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.04192 [TensorRT] VERBOSE: Tactic: 1 time 0.031712 [TensorRT] VERBOSE: Tactic: 2 time 0.031232 [TensorRT] VERBOSE: Tactic: 3 time 0.028448 [TensorRT] VERBOSE: Tactic: 4 time 0.029696 [TensorRT] VERBOSE: Tactic: 5 time 0.030912 [TensorRT] VERBOSE: Tactic: 6 time 0.027104 [TensorRT] VERBOSE: Tactic: 7 time 0.03072 [TensorRT] VERBOSE: Tactic: 8 time 0.03728 [TensorRT] VERBOSE: Tactic: 9 time 0.0376 [TensorRT] VERBOSE: Tactic: 10 time 0.071136 [TensorRT] VERBOSE: Tactic: 11 time 0.052384 [TensorRT] VERBOSE: Tactic: 12 time 0.047168 [TensorRT] VERBOSE: Tactic: 13 time 0.043712 [TensorRT] VERBOSE: Tactic: 14 time 0.041088 [TensorRT] VERBOSE: Tactic: 15 time 0.041376 [TensorRT] VERBOSE: Tactic: 16 time 0.041984 [TensorRT] VERBOSE: Tactic: 17 time 0.03984 [TensorRT] VERBOSE: Tactic: 18 time 0.04272 [TensorRT] VERBOSE: Tactic: 19 time 0.044736 [TensorRT] VERBOSE: Tactic: 20 time 0.122176 [TensorRT] VERBOSE: Tactic: 21 time 0.085856 [TensorRT] VERBOSE: Tactic: 22 time 0.061184 [TensorRT] VERBOSE: Tactic: 23 time 0.052544 [TensorRT] VERBOSE: Tactic: 28 time 0.057664 [TensorRT] VERBOSE: Tactic: 29 time 0.075008 [TensorRT] VERBOSE: Tactic: 30 time 0.117472 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.027104 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.157024 [TensorRT] VERBOSE: Tactic: 256 time 0.131616 [TensorRT] VERBOSE: Tactic: 512 time 0.133216 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.131616 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_3 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.027648 [TensorRT] VERBOSE: Tactic: 11 time 0.028448 [TensorRT] VERBOSE: Tactic: 12 time 0.02848 [TensorRT] VERBOSE: Tactic: 13 time 0.031488 [TensorRT] VERBOSE: Tactic: 14 time 0.029696 [TensorRT] VERBOSE: Tactic: 15 time 0.0432 [TensorRT] VERBOSE: Tactic: 16 time 0.030176 [TensorRT] VERBOSE: Tactic: 17 time 0.032608 [TensorRT] VERBOSE: Tactic: 18 time 0.043776 [TensorRT] VERBOSE: Tactic: 19 time 0.060064 [TensorRT] VERBOSE: Tactic: 20 time 0.031488 [TensorRT] VERBOSE: Tactic: 21 time 0.028672 [TensorRT] VERBOSE: Tactic: 22 time 0.027904 [TensorRT] VERBOSE: Tactic: 23 time 0.03088 [TensorRT] VERBOSE: Tactic: 24 time 0.042464 [TensorRT] VERBOSE: Tactic: 25 time 0.034144 [TensorRT] VERBOSE: Tactic: 26 time 0.029312 [TensorRT] VERBOSE: Tactic: 27 time 0.028448 [TensorRT] VERBOSE: Tactic: 29 time 0.164704 [TensorRT] VERBOSE: Tactic: 30 time 0.092224 [TensorRT] VERBOSE: Tactic: 31 time 0.060544 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.027648 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.203776 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.206624 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.249184 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.20272 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.192 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.186048 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.19456 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.298624 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.235168 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.186048 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.468096 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 3211264, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 6963200, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 108544, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.468096 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.116608 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.138432 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.121856 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.113088 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.132064 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.12608 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.108128 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.112608 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.129792 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.117248 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.121856 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.114528 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.108128 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,401408) *************** [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.06608 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.071264 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.069312 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.067296 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.096896 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.072576 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.082048 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.077056 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.072672 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.078272 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.088896 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.09088 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.06608 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3145259992339075399 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.073344 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.093664 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.081344 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.067968 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.077952 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.068128 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.093152 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.0936 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.072128 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.079744 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.07024 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.07296 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.067968 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CaskConvolution) [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.04992 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.061184 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.048896 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.05392 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.06048 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.053184 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.054528 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.052544 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.05248 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.053408 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.060992 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.050112 [TensorRT] VERBOSE: Fastest Tactic: 5754467717466343388 Time: 0.048896 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_4 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5754467717466343388 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_4 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.275936 [TensorRT] VERBOSE: Tactic: 0 time 0.800576 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.275936 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.625792 [TensorRT] VERBOSE: Tactic: 0 time 0.680544 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.625792 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.350624 [TensorRT] VERBOSE: Tactic: 0 time 0.101472 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.101472 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.340672 [TensorRT] VERBOSE: Tactic: 0 time 0.779616 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.340672 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.339424 [TensorRT] VERBOSE: Tactic: 0 time 0.299872 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.299872 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.317824 [TensorRT] VERBOSE: Tactic: 0 time 1.05453 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.317824 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.229344 [TensorRT] VERBOSE: Tactic: 256 time 0.230208 [TensorRT] VERBOSE: Tactic: 512 time 0.234496 [TensorRT] VERBOSE: Tactic: -32 time 0.307008 [TensorRT] VERBOSE: Tactic: -64 time 0.268576 [TensorRT] VERBOSE: Tactic: -128 time 0.266496 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.229344 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.132704 [TensorRT] VERBOSE: Tactic: 1 time 0.124288 [TensorRT] VERBOSE: Tactic: 2 time 0.112416 [TensorRT] VERBOSE: Tactic: 3 time 0.12032 [TensorRT] VERBOSE: Tactic: 4 time 0.109632 [TensorRT] VERBOSE: Tactic: 5 time 0.112096 [TensorRT] VERBOSE: Tactic: 6 time 0.12896 [TensorRT] VERBOSE: Tactic: 7 time 0.11152 [TensorRT] VERBOSE: Tactic: 8 time 0.112192 [TensorRT] VERBOSE: Tactic: 9 time 0.109728 [TensorRT] VERBOSE: Tactic: 28 time 0.132384 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.109632 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,50176) -> Float(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.227744 [TensorRT] VERBOSE: Tactic: 256 time 0.230016 [TensorRT] VERBOSE: Tactic: 512 time 0.234944 [TensorRT] VERBOSE: Tactic: -32 time 0.310272 [TensorRT] VERBOSE: Tactic: -64 time 0.2688 [TensorRT] VERBOSE: Tactic: -128 time 0.265664 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.227744 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_5 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.185408 [TensorRT] VERBOSE: Tactic: 25 time 0.183808 [TensorRT] VERBOSE: Tactic: 26 time 0.184448 [TensorRT] VERBOSE: Tactic: 27 time 0.187648 [TensorRT] VERBOSE: Tactic: 31 time 0.185696 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.183808 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] WARNING: No implementation of layer LeakyRelu_5 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.277824 [TensorRT] VERBOSE: Tactic: 0 time 0.834592 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.277824 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.656384 [TensorRT] VERBOSE: Tactic: 0 time 0.710784 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.656384 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.13312 [TensorRT] VERBOSE: Tactic: 0 time 0.06656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.06656 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.140992 [TensorRT] VERBOSE: Tactic: 0 time 0.387616 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.140992 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.182592 [TensorRT] VERBOSE: Tactic: 0 time 0.100608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.100608 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.173408 [TensorRT] VERBOSE: Tactic: 0 time 0.289408 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.173408 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.340416 [TensorRT] VERBOSE: Tactic: 0 time 0.349344 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.340416 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.144928 [TensorRT] VERBOSE: Tactic: 0 time 0.06576 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.06576 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.187968 [TensorRT] VERBOSE: Tactic: 0 time 0.358624 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.187968 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.172384 [TensorRT] VERBOSE: Tactic: 0 time 0.62464 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.172384 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.3224 [TensorRT] VERBOSE: Tactic: 655359 time 0.322528 [TensorRT] VERBOSE: Tactic: 786431 time 0.282528 [TensorRT] VERBOSE: Tactic: 851967 time 0.429088 [TensorRT] VERBOSE: Tactic: 1179647 time 0.27488 [TensorRT] VERBOSE: Tactic: 1310719 time 0.401152 [TensorRT] VERBOSE: Tactic: 1376255 time 0.318816 [TensorRT] VERBOSE: Tactic: 1441791 time 0.405856 [TensorRT] VERBOSE: Tactic: 1507327 time 0.348032 [TensorRT] VERBOSE: Tactic: 1638399 time 0.276224 [TensorRT] VERBOSE: Tactic: 1835007 time 0.287744 [TensorRT] VERBOSE: Tactic: 1900543 time 0.356384 [TensorRT] VERBOSE: Tactic: 2097151 time 0.279648 [TensorRT] VERBOSE: Tactic: 2162687 time 0.29824 [TensorRT] VERBOSE: Tactic: 2293759 time 0.308096 [TensorRT] VERBOSE: Tactic: 2359295 time 0.259712 [TensorRT] VERBOSE: Tactic: 2686975 time 0.285312 [TensorRT] VERBOSE: Tactic: 3080191 time 0.333824 [TensorRT] VERBOSE: Tactic: 3342335 time 0.350016 [TensorRT] VERBOSE: Tactic: 3407871 time 0.280576 [TensorRT] VERBOSE: Tactic: 3538943 time 0.268064 [TensorRT] VERBOSE: Tactic: 3670015 time 0.364 [TensorRT] VERBOSE: Tactic: 3932159 time 0.344512 [TensorRT] VERBOSE: Tactic: 3997695 time 0.2816 [TensorRT] VERBOSE: Tactic: 4063231 time 0.410624 [TensorRT] VERBOSE: Tactic: 4194303 time 0.266848 [TensorRT] VERBOSE: Tactic: 4259839 time 0.271872 [TensorRT] VERBOSE: Tactic: 4325375 time 0.264416 [TensorRT] VERBOSE: Tactic: 4521983 time 0.280544 [TensorRT] VERBOSE: Tactic: 4587519 time 0.269248 [TensorRT] VERBOSE: Tactic: 4653055 time 0.252896 [TensorRT] VERBOSE: Tactic: 4915199 time 0.26752 [TensorRT] VERBOSE: Tactic: 4980735 time 0.268896 [TensorRT] VERBOSE: Tactic: 5177343 time 0.30336 [TensorRT] VERBOSE: Tactic: 5242879 time 0.281184 [TensorRT] VERBOSE: Tactic: 5373951 time 0.366912 [TensorRT] VERBOSE: Tactic: 5439487 time 0.350208 [TensorRT] VERBOSE: Tactic: 5570559 time 0.344704 [TensorRT] VERBOSE: Tactic: 5636095 time 0.408064 [TensorRT] VERBOSE: Tactic: 5701631 time 0.301088 [TensorRT] VERBOSE: Tactic: 5767167 time 0.84624 [TensorRT] VERBOSE: Tactic: 5832703 time 0.273824 [TensorRT] VERBOSE: Tactic: 5898239 time 0.273248 [TensorRT] VERBOSE: Tactic: 6029311 time 0.30208 [TensorRT] VERBOSE: Tactic: 6225919 time 0.275936 [TensorRT] VERBOSE: Tactic: 6291455 time 0.27744 [TensorRT] VERBOSE: Tactic: 6422527 time 0.32928 [TensorRT] VERBOSE: Tactic: 6750207 time 0.303936 [TensorRT] VERBOSE: Tactic: 6815743 time 0.32768 [TensorRT] VERBOSE: Tactic: 6946815 time 0.335104 [TensorRT] VERBOSE: Tactic: 7012351 time 0.281216 [TensorRT] VERBOSE: Tactic: 7077887 time 0.2584 [TensorRT] VERBOSE: Tactic: 7143423 time 0.347168 [TensorRT] VERBOSE: Tactic: 7208959 time 0.288032 [TensorRT] VERBOSE: Tactic: 7340031 time 0.281536 [TensorRT] VERBOSE: Tactic: 7405567 time 0.276896 [TensorRT] VERBOSE: Tactic: 7536639 time 0.361504 [TensorRT] VERBOSE: Tactic: 7602175 time 0.28608 [TensorRT] VERBOSE: Tactic: 7733247 time 0.250624 [TensorRT] VERBOSE: Tactic: 7798783 time 0.28256 [TensorRT] VERBOSE: Tactic: 8191999 time 0.335872 [TensorRT] VERBOSE: Tactic: 8257535 time 0.275872 [TensorRT] VERBOSE: Tactic: 8323071 time 0.29696 [TensorRT] VERBOSE: Tactic: 8650751 time 0.299936 [TensorRT] VERBOSE: Tactic: 8716287 time 0.35168 [TensorRT] VERBOSE: Tactic: 9109503 time 0.283968 [TensorRT] VERBOSE: Tactic: 9568255 time 0.271072 [TensorRT] VERBOSE: Tactic: 9895935 time 0.267648 [TensorRT] VERBOSE: Tactic: 10223615 time 0.288768 [TensorRT] VERBOSE: Tactic: 10354687 time 0.269696 [TensorRT] VERBOSE: Tactic: 10551295 time 0.29888 [TensorRT] VERBOSE: Tactic: 10747903 time 0.251584 [TensorRT] VERBOSE: Tactic: 10944511 time 0.269376 [TensorRT] VERBOSE: Fastest Tactic: 7733247 Time: 0.250624 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.188384 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.1904 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.071552 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.193024 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.102848 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.098208 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.103872 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.0912 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.0704 [TensorRT] VERBOSE: Fastest Tactic: -3946921629105938337 Time: 0.0704 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.128 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 3211264, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 3203072, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.126816 [TensorRT] VERBOSE: Fastest Tactic: 57 Time: 0.126816 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3946921629105938337 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.092512 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.045056 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.035648 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.052992 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.043488 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.036224 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.05136 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.052096 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.04448 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.091808 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.0376 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.0904 [TensorRT] VERBOSE: Fastest Tactic: 1659301557717208403 Time: 0.035648 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1659301557717208403 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,100352) *************** [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.072128 [TensorRT] VERBOSE: Tactic: 655359 time 0.102688 [TensorRT] VERBOSE: Tactic: 786431 time 0.065472 [TensorRT] VERBOSE: Tactic: 851967 time 0.195424 [TensorRT] VERBOSE: Tactic: 1179647 time 0.105472 [TensorRT] VERBOSE: Tactic: 1310719 time 0.064928 [TensorRT] VERBOSE: Tactic: 1376255 time 0.073664 [TensorRT] VERBOSE: Tactic: 1441791 time 0.118912 [TensorRT] VERBOSE: Tactic: 1507327 time 0.133568 [TensorRT] VERBOSE: Tactic: 1638399 time 0.071232 [TensorRT] VERBOSE: Tactic: 1835007 time 0.063296 [TensorRT] VERBOSE: Tactic: 1900543 time 0.125408 [TensorRT] VERBOSE: Tactic: 2162687 time 0.0896 [TensorRT] VERBOSE: Tactic: 2293759 time 0.073216 [TensorRT] VERBOSE: Tactic: 2359295 time 0.090912 [TensorRT] VERBOSE: Tactic: 2686975 time 0.080512 [TensorRT] VERBOSE: Tactic: 3080191 time 0.122272 [TensorRT] VERBOSE: Tactic: 3342335 time 0.132128 [TensorRT] VERBOSE: Tactic: 3407871 time 0.074016 [TensorRT] VERBOSE: Tactic: 3538943 time 0.080896 [TensorRT] VERBOSE: Tactic: 3670015 time 0.0976 [TensorRT] VERBOSE: Tactic: 3932159 time 0.101056 [TensorRT] VERBOSE: Tactic: 3997695 time 0.062624 [TensorRT] VERBOSE: Tactic: 4063231 time 0.192352 [TensorRT] VERBOSE: Tactic: 4194303 time 0.060032 [TensorRT] VERBOSE: Tactic: 4325375 time 0.072704 [TensorRT] VERBOSE: Tactic: 4521983 time 0.067488 [TensorRT] VERBOSE: Tactic: 4587519 time 0.059136 [TensorRT] VERBOSE: Tactic: 4653055 time 0.11088 [TensorRT] VERBOSE: Tactic: 4915199 time 0.059456 [TensorRT] VERBOSE: Tactic: 4980735 time 0.070336 [TensorRT] VERBOSE: Tactic: 5177343 time 0.108544 [TensorRT] VERBOSE: Tactic: 5242879 time 0.074624 [TensorRT] VERBOSE: Tactic: 5373951 time 0.115008 [TensorRT] VERBOSE: Tactic: 5439487 time 0.0768 [TensorRT] VERBOSE: Tactic: 5570559 time 0.12752 [TensorRT] VERBOSE: Tactic: 5636095 time 0.192192 [TensorRT] VERBOSE: Tactic: 5701631 time 0.075776 [TensorRT] VERBOSE: Tactic: 5767167 time 0.142272 [TensorRT] VERBOSE: Tactic: 5832703 time 0.072128 [TensorRT] VERBOSE: Tactic: 5898239 time 0.104096 [TensorRT] VERBOSE: Tactic: 6029311 time 0.073344 [TensorRT] VERBOSE: Tactic: 6225919 time 0.081536 [TensorRT] VERBOSE: Tactic: 6291455 time 0.10512 [TensorRT] VERBOSE: Tactic: 6422527 time 0.114208 [TensorRT] VERBOSE: Tactic: 6750207 time 0.072704 [TensorRT] VERBOSE: Tactic: 6815743 time 0.083968 [TensorRT] VERBOSE: Tactic: 6946815 time 0.075712 [TensorRT] VERBOSE: Tactic: 7077887 time 0.08016 [TensorRT] VERBOSE: Tactic: 7143423 time 0.072704 [TensorRT] VERBOSE: Tactic: 7208959 time 0.074912 [TensorRT] VERBOSE: Tactic: 7340031 time 0.106912 [TensorRT] VERBOSE: Tactic: 7405567 time 0.093056 [TensorRT] VERBOSE: Tactic: 7536639 time 0.088512 [TensorRT] VERBOSE: Tactic: 7602175 time 0.05952 [TensorRT] VERBOSE: Tactic: 7733247 time 0.078144 [TensorRT] VERBOSE: Tactic: 7798783 time 0.065504 [TensorRT] VERBOSE: Tactic: 8191999 time 0.0712 [TensorRT] VERBOSE: Tactic: 8257535 time 0.062432 [TensorRT] VERBOSE: Tactic: 8323071 time 0.063648 [TensorRT] VERBOSE: Tactic: 8650751 time 0.066336 [TensorRT] VERBOSE: Tactic: 8716287 time 0.091136 [TensorRT] VERBOSE: Tactic: 9568255 time 0.05936 [TensorRT] VERBOSE: Tactic: 9895935 time 0.059392 [TensorRT] VERBOSE: Tactic: 10223615 time 0.079776 [TensorRT] VERBOSE: Tactic: 10354687 time 0.07984 [TensorRT] VERBOSE: Tactic: 10551295 time 0.065024 [TensorRT] VERBOSE: Tactic: 10747903 time 0.077088 [TensorRT] VERBOSE: Tactic: 10944511 time 0.071232 [TensorRT] VERBOSE: Fastest Tactic: 4587519 Time: 0.059136 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.036928 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.069664 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.03904 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.037824 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.03392 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.069984 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.027424 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.027296 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.070496 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.02736 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.032 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.032288 [TensorRT] VERBOSE: Fastest Tactic: 8097855305881829878 Time: 0.027296 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8097855305881829878 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.067744 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.033216 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.028672 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.036672 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.026624 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.037248 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.032032 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.032096 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.068896 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.027264 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.038176 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.06896 [TensorRT] VERBOSE: Fastest Tactic: 8047041638267142825 Time: 0.026624 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8047041638267142825 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.040096 [TensorRT] VERBOSE: Tactic: 655359 time 0.09104 [TensorRT] VERBOSE: Tactic: 786431 time 0.044512 [TensorRT] VERBOSE: Tactic: 851967 time 0.194272 [TensorRT] VERBOSE: Tactic: 1179647 time 0.104288 [TensorRT] VERBOSE: Tactic: 1310719 time 0.0416 [TensorRT] VERBOSE: Tactic: 1376255 time 0.067552 [TensorRT] VERBOSE: Tactic: 1441791 time 0.113408 [TensorRT] VERBOSE: Tactic: 1507327 time 0.125952 [TensorRT] VERBOSE: Tactic: 1638399 time 0.066208 [TensorRT] VERBOSE: Tactic: 1835007 time 0.048512 [TensorRT] VERBOSE: Tactic: 1900543 time 0.103552 [TensorRT] VERBOSE: Tactic: 2162687 time 0.072416 [TensorRT] VERBOSE: Tactic: 2293759 time 0.069696 [TensorRT] VERBOSE: Tactic: 2359295 time 0.075808 [TensorRT] VERBOSE: Tactic: 2686975 time 0.069472 [TensorRT] VERBOSE: Tactic: 3080191 time 0.1128 [TensorRT] VERBOSE: Tactic: 3342335 time 0.121568 [TensorRT] VERBOSE: Tactic: 3407871 time 0.072992 [TensorRT] VERBOSE: Tactic: 3538943 time 0.083008 [TensorRT] VERBOSE: Tactic: 3670015 time 0.085856 [TensorRT] VERBOSE: Tactic: 3932159 time 0.099328 [TensorRT] VERBOSE: Tactic: 3997695 time 0.048128 [TensorRT] VERBOSE: Tactic: 4063231 time 0.190496 [TensorRT] VERBOSE: Tactic: 4194303 time 0.043392 [TensorRT] VERBOSE: Tactic: 4325375 time 0.069472 [TensorRT] VERBOSE: Tactic: 4521983 time 0.061088 [TensorRT] VERBOSE: Tactic: 4587519 time 0.04704 [TensorRT] VERBOSE: Tactic: 4653055 time 0.112256 [TensorRT] VERBOSE: Tactic: 4915199 time 0.04608 [TensorRT] VERBOSE: Tactic: 4980735 time 0.06608 [TensorRT] VERBOSE: Tactic: 5177343 time 0.10496 [TensorRT] VERBOSE: Tactic: 5242879 time 0.073088 [TensorRT] VERBOSE: Tactic: 5373951 time 0.110208 [TensorRT] VERBOSE: Tactic: 5439487 time 0.05696 [TensorRT] VERBOSE: Tactic: 5570559 time 0.117248 [TensorRT] VERBOSE: Tactic: 5636095 time 0.190752 [TensorRT] VERBOSE: Tactic: 5701631 time 0.0672 [TensorRT] VERBOSE: Tactic: 5767167 time 0.111968 [TensorRT] VERBOSE: Tactic: 5832703 time 0.071328 [TensorRT] VERBOSE: Tactic: 5898239 time 0.10352 [TensorRT] VERBOSE: Tactic: 6029311 time 0.067712 [TensorRT] VERBOSE: Tactic: 6225919 time 0.082528 [TensorRT] VERBOSE: Tactic: 6291455 time 0.104736 [TensorRT] VERBOSE: Tactic: 6422527 time 0.10832 [TensorRT] VERBOSE: Tactic: 6750207 time 0.06224 [TensorRT] VERBOSE: Tactic: 6815743 time 0.078848 [TensorRT] VERBOSE: Tactic: 6946815 time 0.054272 [TensorRT] VERBOSE: Tactic: 7077887 time 0.077728 [TensorRT] VERBOSE: Tactic: 7143423 time 0.064128 [TensorRT] VERBOSE: Tactic: 7208959 time 0.07168 [TensorRT] VERBOSE: Tactic: 7340031 time 0.10336 [TensorRT] VERBOSE: Tactic: 7405567 time 0.08816 [TensorRT] VERBOSE: Tactic: 7536639 time 0.093344 [TensorRT] VERBOSE: Tactic: 7602175 time 0.045344 [TensorRT] VERBOSE: Tactic: 7733247 time 0.076768 [TensorRT] VERBOSE: Tactic: 7798783 time 0.043968 [TensorRT] VERBOSE: Tactic: 8191999 time 0.062144 [TensorRT] VERBOSE: Tactic: 8257535 time 0.042912 [TensorRT] VERBOSE: Tactic: 8323071 time 0.051744 [TensorRT] VERBOSE: Tactic: 8650751 time 0.045024 [TensorRT] VERBOSE: Tactic: 8716287 time 0.086848 [TensorRT] VERBOSE: Tactic: 9568255 time 0.045184 [TensorRT] VERBOSE: Tactic: 9895935 time 0.043584 [TensorRT] VERBOSE: Tactic: 10223615 time 0.07008 [TensorRT] VERBOSE: Tactic: 10354687 time 0.074752 [TensorRT] VERBOSE: Tactic: 10551295 time 0.046752 [TensorRT] VERBOSE: Tactic: 10747903 time 0.077792 [TensorRT] VERBOSE: Tactic: 10944511 time 0.066144 [TensorRT] VERBOSE: Fastest Tactic: 589823 Time: 0.040096 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CaskConvolution) [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.046528 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.058464 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.04608 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.031584 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.059392 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.032832 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.032768 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.032256 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.030816 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.032256 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.060096 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.046784 [TensorRT] VERBOSE: Fastest Tactic: -1383447415429797909 Time: 0.030816 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_19 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1383447415429797909 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.073504 [TensorRT] VERBOSE: Tactic: 0 time 0.207328 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.073504 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.093952 [TensorRT] VERBOSE: Tactic: 0 time 0.02112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02112 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.087872 [TensorRT] VERBOSE: Tactic: 0 time 0.190464 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.087872 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.171008 [TensorRT] VERBOSE: Tactic: 0 time 0.172992 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.171008 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.095232 [TensorRT] VERBOSE: Tactic: 0 time 0.184864 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.095232 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.075808 [TensorRT] VERBOSE: Tactic: 0 time 0.401824 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.075808 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.092032 [TensorRT] VERBOSE: Tactic: 0 time 0.02768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02768 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.092736 [TensorRT] VERBOSE: Tactic: 0 time 0.198336 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.092736 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.087968 [TensorRT] VERBOSE: Tactic: 0 time 0.01328 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01328 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.089952 [TensorRT] VERBOSE: Tactic: 0 time 0.075744 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.075744 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.070944 [TensorRT] VERBOSE: Tactic: 0 time 0.27984 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.070944 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.090048 [TensorRT] VERBOSE: Tactic: 0 time 0.014656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014656 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.060576 [TensorRT] VERBOSE: Tactic: 256 time 0.062496 [TensorRT] VERBOSE: Tactic: 512 time 0.061856 [TensorRT] VERBOSE: Tactic: -32 time 0.092896 [TensorRT] VERBOSE: Tactic: -64 time 0.077088 [TensorRT] VERBOSE: Tactic: -128 time 0.073984 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.060576 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.038432 [TensorRT] VERBOSE: Tactic: 1 time 0.034816 [TensorRT] VERBOSE: Tactic: 2 time 0.031296 [TensorRT] VERBOSE: Tactic: 3 time 0.036864 [TensorRT] VERBOSE: Tactic: 4 time 0.032768 [TensorRT] VERBOSE: Tactic: 5 time 0.033344 [TensorRT] VERBOSE: Tactic: 6 time 0.039904 [TensorRT] VERBOSE: Tactic: 7 time 0.03408 [TensorRT] VERBOSE: Tactic: 8 time 0.032928 [TensorRT] VERBOSE: Tactic: 9 time 0.032192 [TensorRT] VERBOSE: Tactic: 28 time 0.03824 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.031296 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,12544) -> Float(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061792 [TensorRT] VERBOSE: Tactic: 256 time 0.060992 [TensorRT] VERBOSE: Tactic: 512 time 0.061952 [TensorRT] VERBOSE: Tactic: -32 time 0.093024 [TensorRT] VERBOSE: Tactic: -64 time 0.076928 [TensorRT] VERBOSE: Tactic: -128 time 0.072544 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.060992 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.049632 [TensorRT] VERBOSE: Tactic: 25 time 0.049152 [TensorRT] VERBOSE: Tactic: 26 time 0.050208 [TensorRT] VERBOSE: Tactic: 27 time 0.049568 [TensorRT] VERBOSE: Tactic: 31 time 0.04928 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.049152 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,100352) -> Int8(1,112,12544:4,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.079872 [TensorRT] VERBOSE: Tactic: 256 time 0.06944 [TensorRT] VERBOSE: Tactic: 512 time 0.071232 [TensorRT] VERBOSE: Tactic: -32 time 0.09472 [TensorRT] VERBOSE: Tactic: -64 time 0.095296 [TensorRT] VERBOSE: Tactic: -128 time 0.090624 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.06944 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.022976 [TensorRT] VERBOSE: Tactic: 1 time 0.018432 [TensorRT] VERBOSE: Tactic: 2 time 0.018912 [TensorRT] VERBOSE: Tactic: 3 time 0.016512 [TensorRT] VERBOSE: Tactic: 4 time 0.017184 [TensorRT] VERBOSE: Tactic: 5 time 0.018336 [TensorRT] VERBOSE: Tactic: 6 time 0.016352 [TensorRT] VERBOSE: Tactic: 7 time 0.018016 [TensorRT] VERBOSE: Tactic: 8 time 0.023104 [TensorRT] VERBOSE: Tactic: 9 time 0.024832 [TensorRT] VERBOSE: Tactic: 10 time 0.038304 [TensorRT] VERBOSE: Tactic: 11 time 0.028576 [TensorRT] VERBOSE: Tactic: 12 time 0.025952 [TensorRT] VERBOSE: Tactic: 13 time 0.025216 [TensorRT] VERBOSE: Tactic: 14 time 0.024352 [TensorRT] VERBOSE: Tactic: 15 time 0.024032 [TensorRT] VERBOSE: Tactic: 16 time 0.024384 [TensorRT] VERBOSE: Tactic: 17 time 0.023136 [TensorRT] VERBOSE: Tactic: 18 time 0.023552 [TensorRT] VERBOSE: Tactic: 19 time 0.02528 [TensorRT] VERBOSE: Tactic: 20 time 0.063008 [TensorRT] VERBOSE: Tactic: 21 time 0.04544 [TensorRT] VERBOSE: Tactic: 22 time 0.034176 [TensorRT] VERBOSE: Tactic: 23 time 0.031392 [TensorRT] VERBOSE: Tactic: 28 time 0.032096 [TensorRT] VERBOSE: Tactic: 29 time 0.040352 [TensorRT] VERBOSE: Tactic: 30 time 0.06096 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.016352 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,12544) -> Int8(1,112,12544:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.070656 [TensorRT] VERBOSE: Tactic: 256 time 0.06336 [TensorRT] VERBOSE: Tactic: 512 time 0.063296 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.063296 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_20 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.01728 [TensorRT] VERBOSE: Tactic: 11 time 0.018016 [TensorRT] VERBOSE: Tactic: 12 time 0.018432 [TensorRT] VERBOSE: Tactic: 13 time 0.01632 [TensorRT] VERBOSE: Tactic: 14 time 0.018016 [TensorRT] VERBOSE: Tactic: 15 time 0.026624 [TensorRT] VERBOSE: Tactic: 16 time 0.0224 [TensorRT] VERBOSE: Tactic: 17 time 0.023552 [TensorRT] VERBOSE: Tactic: 18 time 0.025696 [TensorRT] VERBOSE: Tactic: 19 time 0.040256 [TensorRT] VERBOSE: Tactic: 20 time 0.01808 [TensorRT] VERBOSE: Tactic: 21 time 0.016928 [TensorRT] VERBOSE: Tactic: 22 time 0.017696 [TensorRT] VERBOSE: Tactic: 23 time 0.019456 [TensorRT] VERBOSE: Tactic: 24 time 0.023744 [TensorRT] VERBOSE: Tactic: 25 time 0.02048 [TensorRT] VERBOSE: Tactic: 26 time 0.017984 [TensorRT] VERBOSE: Tactic: 27 time 0.01744 [TensorRT] VERBOSE: Tactic: 29 time 0.08704 [TensorRT] VERBOSE: Tactic: 30 time 0.04896 [TensorRT] VERBOSE: Tactic: 31 time 0.032352 [TensorRT] VERBOSE: Fastest Tactic: 13 Time: 0.01632 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.70144 [TensorRT] VERBOSE: Tactic: 720895 time 0.614912 [TensorRT] VERBOSE: Tactic: 983039 time 0.596416 [TensorRT] VERBOSE: Tactic: 1048575 time 0.6104 [TensorRT] VERBOSE: Tactic: 1703935 time 0.606752 [TensorRT] VERBOSE: Tactic: 1769471 time 0.781152 [TensorRT] VERBOSE: Tactic: 1966079 time 0.725472 [TensorRT] VERBOSE: Tactic: 2031615 time 0.724352 [TensorRT] VERBOSE: Tactic: 2228223 time 0.605088 [TensorRT] VERBOSE: Tactic: 2424831 time 0.674816 [TensorRT] VERBOSE: Tactic: 2621439 time 0.705216 [TensorRT] VERBOSE: Tactic: 2752511 time 0.606304 [TensorRT] VERBOSE: Tactic: 2818047 time 0.910688 [TensorRT] VERBOSE: Tactic: 2883583 time 0.954368 [TensorRT] VERBOSE: Tactic: 3014655 time 0.59424 [TensorRT] VERBOSE: Tactic: 3145727 time 0.595456 [TensorRT] VERBOSE: Tactic: 3473407 time 0.853024 [TensorRT] VERBOSE: Tactic: 3604479 time 0.58672 [TensorRT] VERBOSE: Tactic: 3735551 time 0.846944 [TensorRT] VERBOSE: Tactic: 4390911 time 0.710144 [TensorRT] VERBOSE: Tactic: 5046271 time 0.608064 [TensorRT] VERBOSE: Tactic: 5963775 time 0.699296 [TensorRT] VERBOSE: Tactic: 6160383 time 0.682816 [TensorRT] VERBOSE: Tactic: 6488063 time 0.609024 [TensorRT] VERBOSE: Tactic: 6881279 time 0.695776 [TensorRT] VERBOSE: Tactic: 7274495 time 0.688448 [TensorRT] VERBOSE: Tactic: 7864319 time 0.638912 [TensorRT] VERBOSE: Tactic: 7995391 time 0.60048 [TensorRT] VERBOSE: Tactic: 8585215 time 0.678912 [TensorRT] VERBOSE: Tactic: 8847359 time 0.894304 [TensorRT] VERBOSE: Tactic: 8978431 time 0.70336 [TensorRT] VERBOSE: Tactic: 9043967 time 0.60096 [TensorRT] VERBOSE: Tactic: 9175039 time 0.586944 [TensorRT] VERBOSE: Tactic: 9502719 time 0.73584 [TensorRT] VERBOSE: Tactic: 9830399 time 0.783328 [TensorRT] VERBOSE: Tactic: 9961471 time 0.800384 [TensorRT] VERBOSE: Tactic: 10027007 time 0.595136 [TensorRT] VERBOSE: Tactic: 10092543 time 0.711488 [TensorRT] VERBOSE: Tactic: 10289151 time 0.718464 [TensorRT] VERBOSE: Tactic: 10485759 time 0.600864 [TensorRT] VERBOSE: Tactic: 10682367 time 0.632768 [TensorRT] VERBOSE: Tactic: 10813439 time 0.591264 [TensorRT] VERBOSE: Fastest Tactic: 3604479 Time: 0.58672 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.742592 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.240896 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.385408 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.734144 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.815616 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.382688 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.38896 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.452896 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.412928 [TensorRT] VERBOSE: Fastest Tactic: 2775507031594384867 Time: 0.240896 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.624576 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 14450688, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 9748480, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 205312, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 149504, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.624576 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,100352) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.207328 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.139168 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.122272 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.113856 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.125088 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.131712 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.119136 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.111616 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.20256 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.279104 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.111616 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,100352) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.136384 [TensorRT] VERBOSE: Tactic: 720895 time 0.153472 [TensorRT] VERBOSE: Tactic: 983039 time 0.13392 [TensorRT] VERBOSE: Tactic: 1048575 time 0.150048 [TensorRT] VERBOSE: Tactic: 1703935 time 0.167584 [TensorRT] VERBOSE: Tactic: 1769471 time 0.2504 [TensorRT] VERBOSE: Tactic: 1966079 time 0.155648 [TensorRT] VERBOSE: Tactic: 2031615 time 0.148768 [TensorRT] VERBOSE: Tactic: 2228223 time 0.219808 [TensorRT] VERBOSE: Tactic: 2621439 time 0.217696 [TensorRT] VERBOSE: Tactic: 2752511 time 0.147488 [TensorRT] VERBOSE: Tactic: 2818047 time 0.265152 [TensorRT] VERBOSE: Tactic: 2883583 time 0.236992 [TensorRT] VERBOSE: Tactic: 3014655 time 0.179392 [TensorRT] VERBOSE: Tactic: 3145727 time 0.150528 [TensorRT] VERBOSE: Tactic: 3473407 time 0.231168 [TensorRT] VERBOSE: Tactic: 3604479 time 0.140704 [TensorRT] VERBOSE: Tactic: 3735551 time 0.220128 [TensorRT] VERBOSE: Tactic: 4390911 time 0.163264 [TensorRT] VERBOSE: Tactic: 5046271 time 0.145408 [TensorRT] VERBOSE: Tactic: 5963775 time 0.146944 [TensorRT] VERBOSE: Tactic: 6160383 time 0.25728 [TensorRT] VERBOSE: Tactic: 6488063 time 0.15904 [TensorRT] VERBOSE: Tactic: 6881279 time 0.147456 [TensorRT] VERBOSE: Tactic: 7274495 time 0.18944 [TensorRT] VERBOSE: Tactic: 7864319 time 0.18608 [TensorRT] VERBOSE: Tactic: 7995391 time 0.136192 [TensorRT] VERBOSE: Tactic: 8585215 time 0.147232 [TensorRT] VERBOSE: Tactic: 8847359 time 0.21504 [TensorRT] VERBOSE: Tactic: 8978431 time 0.14768 [TensorRT] VERBOSE: Tactic: 9043967 time 0.155648 [TensorRT] VERBOSE: Tactic: 9175039 time 0.138976 [TensorRT] VERBOSE: Tactic: 9502719 time 0.16256 [TensorRT] VERBOSE: Tactic: 9830399 time 0.247744 [TensorRT] VERBOSE: Tactic: 10027007 time 0.151456 [TensorRT] VERBOSE: Tactic: 10092543 time 0.162816 [TensorRT] VERBOSE: Tactic: 10289151 time 0.154368 [TensorRT] VERBOSE: Tactic: 10485759 time 0.148288 [TensorRT] VERBOSE: Tactic: 10682367 time 0.196704 [TensorRT] VERBOSE: Tactic: 10813439 time 0.140608 [TensorRT] VERBOSE: Fastest Tactic: 983039 Time: 0.13392 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.10752 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.105856 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.123712 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.198656 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.118016 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.198528 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.114688 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.247872 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.112288 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.106208 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.105856 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4581732244273465060 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,100352) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.12128 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.119328 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.105824 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.112896 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.10736 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.114048 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.196768 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.108064 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.201696 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.24688 [TensorRT] VERBOSE: Fastest Tactic: 7125598890155666458 Time: 0.105824 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7125598890155666458 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,12544) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,12544) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.12928 [TensorRT] VERBOSE: Tactic: 720895 time 0.129856 [TensorRT] VERBOSE: Tactic: 983039 time 0.12704 [TensorRT] VERBOSE: Tactic: 1048575 time 0.149248 [TensorRT] VERBOSE: Tactic: 1703935 time 0.150432 [TensorRT] VERBOSE: Tactic: 1769471 time 0.232448 [TensorRT] VERBOSE: Tactic: 1966079 time 0.1232 [TensorRT] VERBOSE: Tactic: 2031615 time 0.12816 [TensorRT] VERBOSE: Tactic: 2228223 time 0.207456 [TensorRT] VERBOSE: Tactic: 2621439 time 0.206368 [TensorRT] VERBOSE: Tactic: 2752511 time 0.132288 [TensorRT] VERBOSE: Tactic: 2818047 time 0.255008 [TensorRT] VERBOSE: Tactic: 2883583 time 0.220512 [TensorRT] VERBOSE: Tactic: 3014655 time 0.171936 [TensorRT] VERBOSE: Tactic: 3145727 time 0.13584 [TensorRT] VERBOSE: Tactic: 3473407 time 0.239712 [TensorRT] VERBOSE: Tactic: 3604479 time 0.13056 [TensorRT] VERBOSE: Tactic: 3735551 time 0.219712 [TensorRT] VERBOSE: Tactic: 4390911 time 0.12992 [TensorRT] VERBOSE: Tactic: 5046271 time 0.1408 [TensorRT] VERBOSE: Tactic: 5963775 time 0.126112 [TensorRT] VERBOSE: Tactic: 6160383 time 0.2784 [TensorRT] VERBOSE: Tactic: 6488063 time 0.155584 [TensorRT] VERBOSE: Tactic: 6881279 time 0.129184 [TensorRT] VERBOSE: Tactic: 7274495 time 0.183712 [TensorRT] VERBOSE: Tactic: 7864319 time 0.180448 [TensorRT] VERBOSE: Tactic: 7995391 time 0.115552 [TensorRT] VERBOSE: Tactic: 8585215 time 0.142368 [TensorRT] VERBOSE: Tactic: 8847359 time 0.205216 [TensorRT] VERBOSE: Tactic: 8978431 time 0.116128 [TensorRT] VERBOSE: Tactic: 9043967 time 0.15152 [TensorRT] VERBOSE: Tactic: 9175039 time 0.130336 [TensorRT] VERBOSE: Tactic: 9502719 time 0.131488 [TensorRT] VERBOSE: Tactic: 9830399 time 0.21936 [TensorRT] VERBOSE: Tactic: 10027007 time 0.14624 [TensorRT] VERBOSE: Tactic: 10092543 time 0.12864 [TensorRT] VERBOSE: Tactic: 10289151 time 0.121856 [TensorRT] VERBOSE: Tactic: 10485759 time 0.149088 [TensorRT] VERBOSE: Tactic: 10682367 time 0.19104 [TensorRT] VERBOSE: Tactic: 10813439 time 0.119008 [TensorRT] VERBOSE: Fastest Tactic: 7995391 Time: 0.115552 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CaskConvolution) [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.084384 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.056192 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.101184 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.055008 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.054272 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.08816 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.101536 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.054752 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.055328 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.053824 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.099904 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.08272 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.053824 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_21 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816), Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.155776 [TensorRT] VERBOSE: Tactic: 256 time 0.15536 [TensorRT] VERBOSE: Tactic: 512 time 0.157536 [TensorRT] VERBOSE: Tactic: -32 time 0.211712 [TensorRT] VERBOSE: Tactic: -64 time 0.181408 [TensorRT] VERBOSE: Tactic: -128 time 0.176128 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.15536 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.087808 [TensorRT] VERBOSE: Tactic: 1 time 0.08512 [TensorRT] VERBOSE: Tactic: 2 time 0.082944 [TensorRT] VERBOSE: Tactic: 3 time 0.086112 [TensorRT] VERBOSE: Tactic: 4 time 0.084672 [TensorRT] VERBOSE: Tactic: 5 time 0.085024 [TensorRT] VERBOSE: Tactic: 6 time 0.08896 [TensorRT] VERBOSE: Tactic: 7 time 0.083168 [TensorRT] VERBOSE: Tactic: 8 time 0.084032 [TensorRT] VERBOSE: Tactic: 9 time 0.085472 [TensorRT] VERBOSE: Tactic: 28 time 0.085024 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.082944 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088), Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.1536 [TensorRT] VERBOSE: Tactic: 256 time 0.157664 [TensorRT] VERBOSE: Tactic: 512 time 0.15744 [TensorRT] VERBOSE: Tactic: -32 time 0.21504 [TensorRT] VERBOSE: Tactic: -64 time 0.183072 [TensorRT] VERBOSE: Tactic: -128 time 0.176704 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.1536 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.15088 [TensorRT] VERBOSE: Tactic: 25 time 0.156832 [TensorRT] VERBOSE: Tactic: 26 time 0.158112 [TensorRT] VERBOSE: Tactic: 27 time 0.159808 [TensorRT] VERBOSE: Tactic: 31 time 0.150144 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.150144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704), Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.197632 [TensorRT] VERBOSE: Tactic: 256 time 0.178752 [TensorRT] VERBOSE: Tactic: 512 time 0.180832 [TensorRT] VERBOSE: Tactic: -32 time 0.237568 [TensorRT] VERBOSE: Tactic: -64 time 0.24576 [TensorRT] VERBOSE: Tactic: -128 time 0.247072 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.178752 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.051136 [TensorRT] VERBOSE: Tactic: 1 time 0.042816 [TensorRT] VERBOSE: Tactic: 2 time 0.044352 [TensorRT] VERBOSE: Tactic: 3 time 0.039296 [TensorRT] VERBOSE: Tactic: 4 time 0.04608 [TensorRT] VERBOSE: Tactic: 5 time 0.051424 [TensorRT] VERBOSE: Tactic: 6 time 0.039232 [TensorRT] VERBOSE: Tactic: 7 time 0.049216 [TensorRT] VERBOSE: Tactic: 8 time 0.050528 [TensorRT] VERBOSE: Tactic: 9 time 0.070048 [TensorRT] VERBOSE: Tactic: 10 time 0.086784 [TensorRT] VERBOSE: Tactic: 11 time 0.067424 [TensorRT] VERBOSE: Tactic: 12 time 0.060128 [TensorRT] VERBOSE: Tactic: 13 time 0.055648 [TensorRT] VERBOSE: Tactic: 14 time 0.059328 [TensorRT] VERBOSE: Tactic: 15 time 0.059264 [TensorRT] VERBOSE: Tactic: 16 time 0.054912 [TensorRT] VERBOSE: Tactic: 17 time 0.057344 [TensorRT] VERBOSE: Tactic: 18 time 0.064992 [TensorRT] VERBOSE: Tactic: 19 time 0.070272 [TensorRT] VERBOSE: Tactic: 20 time 0.139264 [TensorRT] VERBOSE: Tactic: 21 time 0.103616 [TensorRT] VERBOSE: Tactic: 22 time 0.073888 [TensorRT] VERBOSE: Tactic: 23 time 0.06336 [TensorRT] VERBOSE: Tactic: 28 time 0.089184 [TensorRT] VERBOSE: Tactic: 29 time 0.092096 [TensorRT] VERBOSE: Tactic: 30 time 0.13664 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.039232 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088), Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.197632 [TensorRT] VERBOSE: Tactic: 256 time 0.179776 [TensorRT] VERBOSE: Tactic: 512 time 0.181824 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.179776 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_22, Add_23) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.045344 [TensorRT] VERBOSE: Tactic: 11 time 0.045216 [TensorRT] VERBOSE: Tactic: 12 time 0.050816 [TensorRT] VERBOSE: Tactic: 13 time 0.046688 [TensorRT] VERBOSE: Tactic: 14 time 0.051616 [TensorRT] VERBOSE: Tactic: 15 time 0.07344 [TensorRT] VERBOSE: Tactic: 16 time 0.050976 [TensorRT] VERBOSE: Tactic: 17 time 0.057504 [TensorRT] VERBOSE: Tactic: 18 time 0.070368 [TensorRT] VERBOSE: Tactic: 19 time 0.11232 [TensorRT] VERBOSE: Tactic: 20 time 0.045792 [TensorRT] VERBOSE: Tactic: 21 time 0.04304 [TensorRT] VERBOSE: Tactic: 22 time 0.044448 [TensorRT] VERBOSE: Tactic: 23 time 0.04672 [TensorRT] VERBOSE: Tactic: 24 time 0.055008 [TensorRT] VERBOSE: Tactic: 25 time 0.049824 [TensorRT] VERBOSE: Tactic: 26 time 0.047904 [TensorRT] VERBOSE: Tactic: 27 time 0.047296 [TensorRT] VERBOSE: Tactic: 29 time 0.259936 [TensorRT] VERBOSE: Tactic: 30 time 0.143328 [TensorRT] VERBOSE: Tactic: 31 time 0.092256 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.04304 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.622944 [TensorRT] VERBOSE: Tactic: 655359 time 0.5512 [TensorRT] VERBOSE: Tactic: 786431 time 0.592896 [TensorRT] VERBOSE: Tactic: 851967 time 0.590432 [TensorRT] VERBOSE: Tactic: 1179647 time 0.586592 [TensorRT] VERBOSE: Tactic: 1310719 time 0.77984 [TensorRT] VERBOSE: Tactic: 1376255 time 0.599712 [TensorRT] VERBOSE: Tactic: 1441791 time 0.611808 [TensorRT] VERBOSE: Tactic: 1507327 time 0.53488 [TensorRT] VERBOSE: Tactic: 1638399 time 0.59168 [TensorRT] VERBOSE: Tactic: 1835007 time 0.604768 [TensorRT] VERBOSE: Tactic: 1900543 time 0.566496 [TensorRT] VERBOSE: Tactic: 2097151 time 0.607488 [TensorRT] VERBOSE: Tactic: 2162687 time 0.5864 [TensorRT] VERBOSE: Tactic: 2293759 time 0.597408 [TensorRT] VERBOSE: Tactic: 2359295 time 0.564512 [TensorRT] VERBOSE: Tactic: 2686975 time 0.579168 [TensorRT] VERBOSE: Tactic: 3080191 time 0.548864 [TensorRT] VERBOSE: Tactic: 3342335 time 0.55232 [TensorRT] VERBOSE: Tactic: 3407871 time 0.579584 [TensorRT] VERBOSE: Tactic: 3538943 time 0.575808 [TensorRT] VERBOSE: Tactic: 3670015 time 0.642816 [TensorRT] VERBOSE: Tactic: 3932159 time 0.574176 [TensorRT] VERBOSE: Tactic: 3997695 time 0.603136 [TensorRT] VERBOSE: Tactic: 4063231 time 0.572416 [TensorRT] VERBOSE: Tactic: 4194303 time 0.572576 [TensorRT] VERBOSE: Tactic: 4259839 time 0.597024 [TensorRT] VERBOSE: Tactic: 4325375 time 0.585024 [TensorRT] VERBOSE: Tactic: 4521983 time 0.568288 [TensorRT] VERBOSE: Tactic: 4587519 time 0.583552 [TensorRT] VERBOSE: Tactic: 4653055 time 0.567392 [TensorRT] VERBOSE: Tactic: 4915199 time 0.583488 [TensorRT] VERBOSE: Tactic: 4980735 time 0.573248 [TensorRT] VERBOSE: Tactic: 5177343 time 0.600992 [TensorRT] VERBOSE: Tactic: 5242879 time 0.585184 [TensorRT] VERBOSE: Tactic: 5373951 time 0.632192 [TensorRT] VERBOSE: Tactic: 5439487 time 0.683648 [TensorRT] VERBOSE: Tactic: 5570559 time 0.543296 [TensorRT] VERBOSE: Tactic: 5636095 time 0.577536 [TensorRT] VERBOSE: Tactic: 5701631 time 0.592 [TensorRT] VERBOSE: Tactic: 5767167 time 1.3048 [TensorRT] VERBOSE: Tactic: 5832703 time 0.580672 [TensorRT] VERBOSE: Tactic: 5898239 time 0.567968 [TensorRT] VERBOSE: Tactic: 6029311 time 0.58624 [TensorRT] VERBOSE: Tactic: 6225919 time 0.587488 [TensorRT] VERBOSE: Tactic: 6291455 time 0.583776 [TensorRT] VERBOSE: Tactic: 6422527 time 0.559584 [TensorRT] VERBOSE: Tactic: 6750207 time 0.636864 [TensorRT] VERBOSE: Tactic: 6815743 time 0.620704 [TensorRT] VERBOSE: Tactic: 6946815 time 0.666912 [TensorRT] VERBOSE: Tactic: 7012351 time 0.603296 [TensorRT] VERBOSE: Tactic: 7077887 time 0.578016 [TensorRT] VERBOSE: Tactic: 7143423 time 0.68048 [TensorRT] VERBOSE: Tactic: 7208959 time 0.591552 [TensorRT] VERBOSE: Tactic: 7340031 time 0.571872 [TensorRT] VERBOSE: Tactic: 7405567 time 0.580736 [TensorRT] VERBOSE: Tactic: 7536639 time 0.646304 [TensorRT] VERBOSE: Tactic: 7602175 time 0.600448 [TensorRT] VERBOSE: Tactic: 7733247 time 0.57024 [TensorRT] VERBOSE: Tactic: 7798783 time 0.588416 [TensorRT] VERBOSE: Tactic: 8191999 time 0.682752 [TensorRT] VERBOSE: Tactic: 8257535 time 0.592832 [TensorRT] VERBOSE: Tactic: 8323071 time 0.623616 [TensorRT] VERBOSE: Tactic: 8650751 time 0.619584 [TensorRT] VERBOSE: Tactic: 8716287 time 0.627328 [TensorRT] VERBOSE: Tactic: 9109503 time 0.61328 [TensorRT] VERBOSE: Tactic: 9568255 time 0.583264 [TensorRT] VERBOSE: Tactic: 9895935 time 0.572448 [TensorRT] VERBOSE: Tactic: 10223615 time 0.57872 [TensorRT] VERBOSE: Tactic: 10354687 time 0.586528 [TensorRT] VERBOSE: Tactic: 10551295 time 0.602112 [TensorRT] VERBOSE: Tactic: 10747903 time 0.56288 [TensorRT] VERBOSE: Tactic: 10944511 time 0.571776 [TensorRT] VERBOSE: Fastest Tactic: 1507327 Time: 0.53488 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.197536 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.190976 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.128 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.191744 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.104448 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.10208 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.106016 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.158432 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.125344 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.10208 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.230272 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 3211264, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 4456448, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 92160, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.230272 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.096224 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.07632 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.066752 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.06352 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.071264 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.070112 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.06176 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.063136 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.071744 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.09504 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.068256 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.091328 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.06176 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.126432 [TensorRT] VERBOSE: Tactic: 655359 time 0.112672 [TensorRT] VERBOSE: Tactic: 786431 time 0.111616 [TensorRT] VERBOSE: Tactic: 851967 time 0.199424 [TensorRT] VERBOSE: Tactic: 1179647 time 0.12768 [TensorRT] VERBOSE: Tactic: 1310719 time 0.113376 [TensorRT] VERBOSE: Tactic: 1376255 time 0.11408 [TensorRT] VERBOSE: Tactic: 1441791 time 0.138112 [TensorRT] VERBOSE: Tactic: 1507327 time 0.141408 [TensorRT] VERBOSE: Tactic: 1638399 time 0.131456 [TensorRT] VERBOSE: Tactic: 1835007 time 0.112096 [TensorRT] VERBOSE: Tactic: 1900543 time 0.129408 [TensorRT] VERBOSE: Tactic: 2162687 time 0.1296 [TensorRT] VERBOSE: Tactic: 2293759 time 0.114432 [TensorRT] VERBOSE: Tactic: 2359295 time 0.124448 [TensorRT] VERBOSE: Tactic: 2686975 time 0.117856 [TensorRT] VERBOSE: Tactic: 3080191 time 0.126528 [TensorRT] VERBOSE: Tactic: 3342335 time 0.136608 [TensorRT] VERBOSE: Tactic: 3407871 time 0.1064 [TensorRT] VERBOSE: Tactic: 3538943 time 0.11264 [TensorRT] VERBOSE: Tactic: 3670015 time 0.126976 [TensorRT] VERBOSE: Tactic: 3932159 time 0.115232 [TensorRT] VERBOSE: Tactic: 3997695 time 0.11184 [TensorRT] VERBOSE: Tactic: 4063231 time 0.193376 [TensorRT] VERBOSE: Tactic: 4194303 time 0.105312 [TensorRT] VERBOSE: Tactic: 4325375 time 0.13856 [TensorRT] VERBOSE: Tactic: 4521983 time 0.119232 [TensorRT] VERBOSE: Tactic: 4587519 time 0.109632 [TensorRT] VERBOSE: Tactic: 4653055 time 0.129024 [TensorRT] VERBOSE: Tactic: 4915199 time 0.10752 [TensorRT] VERBOSE: Tactic: 4980735 time 0.130816 [TensorRT] VERBOSE: Tactic: 5177343 time 0.12928 [TensorRT] VERBOSE: Tactic: 5242879 time 0.107488 [TensorRT] VERBOSE: Tactic: 5373951 time 0.138976 [TensorRT] VERBOSE: Tactic: 5439487 time 0.137504 [TensorRT] VERBOSE: Tactic: 5570559 time 0.133376 [TensorRT] VERBOSE: Tactic: 5636095 time 0.193856 [TensorRT] VERBOSE: Tactic: 5701631 time 0.116736 [TensorRT] VERBOSE: Tactic: 5767167 time 0.232576 [TensorRT] VERBOSE: Tactic: 5832703 time 0.10592 [TensorRT] VERBOSE: Tactic: 5898239 time 0.123488 [TensorRT] VERBOSE: Tactic: 6029311 time 0.113216 [TensorRT] VERBOSE: Tactic: 6225919 time 0.116736 [TensorRT] VERBOSE: Tactic: 6291455 time 0.126848 [TensorRT] VERBOSE: Tactic: 6422527 time 0.12288 [TensorRT] VERBOSE: Tactic: 6750207 time 0.128544 [TensorRT] VERBOSE: Tactic: 6815743 time 0.12096 [TensorRT] VERBOSE: Tactic: 6946815 time 0.134624 [TensorRT] VERBOSE: Tactic: 7077887 time 0.113536 [TensorRT] VERBOSE: Tactic: 7143423 time 0.1336 [TensorRT] VERBOSE: Tactic: 7208959 time 0.109152 [TensorRT] VERBOSE: Tactic: 7340031 time 0.124672 [TensorRT] VERBOSE: Tactic: 7405567 time 0.117056 [TensorRT] VERBOSE: Tactic: 7536639 time 0.122048 [TensorRT] VERBOSE: Tactic: 7602175 time 0.108224 [TensorRT] VERBOSE: Tactic: 7733247 time 0.10704 [TensorRT] VERBOSE: Tactic: 7798783 time 0.111648 [TensorRT] VERBOSE: Tactic: 8191999 time 0.126336 [TensorRT] VERBOSE: Tactic: 8257535 time 0.109792 [TensorRT] VERBOSE: Tactic: 8323071 time 0.114688 [TensorRT] VERBOSE: Tactic: 8650751 time 0.116 [TensorRT] VERBOSE: Tactic: 8716287 time 0.128096 [TensorRT] VERBOSE: Tactic: 9568255 time 0.107936 [TensorRT] VERBOSE: Tactic: 9895935 time 0.104832 [TensorRT] VERBOSE: Tactic: 10223615 time 0.119712 [TensorRT] VERBOSE: Tactic: 10354687 time 0.1512 [TensorRT] VERBOSE: Tactic: 10551295 time 0.117632 [TensorRT] VERBOSE: Tactic: 10747903 time 0.10688 [TensorRT] VERBOSE: Tactic: 10944511 time 0.129088 [TensorRT] VERBOSE: Fastest Tactic: 9895935 Time: 0.104832 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.037888 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.07056 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.040288 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.038912 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.053504 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.0712 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.047232 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.044064 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.070176 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.04464 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.050976 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.050848 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.037888 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3145259992339075399 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.068 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.052576 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.046048 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.039328 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.045088 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.038592 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.049664 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.052224 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.068608 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.044096 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.040032 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.068032 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.038592 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.067584 [TensorRT] VERBOSE: Tactic: 655359 time 0.091584 [TensorRT] VERBOSE: Tactic: 786431 time 0.080544 [TensorRT] VERBOSE: Tactic: 851967 time 0.193696 [TensorRT] VERBOSE: Tactic: 1179647 time 0.111808 [TensorRT] VERBOSE: Tactic: 1310719 time 0.068608 [TensorRT] VERBOSE: Tactic: 1376255 time 0.068288 [TensorRT] VERBOSE: Tactic: 1441791 time 0.119968 [TensorRT] VERBOSE: Tactic: 1507327 time 0.125824 [TensorRT] VERBOSE: Tactic: 1638399 time 0.121664 [TensorRT] VERBOSE: Tactic: 1835007 time 0.08704 [TensorRT] VERBOSE: Tactic: 1900543 time 0.106976 [TensorRT] VERBOSE: Tactic: 2162687 time 0.074016 [TensorRT] VERBOSE: Tactic: 2293759 time 0.070656 [TensorRT] VERBOSE: Tactic: 2359295 time 0.078624 [TensorRT] VERBOSE: Tactic: 2686975 time 0.0712 [TensorRT] VERBOSE: Tactic: 3080191 time 0.112992 [TensorRT] VERBOSE: Tactic: 3342335 time 0.122976 [TensorRT] VERBOSE: Tactic: 3407871 time 0.075776 [TensorRT] VERBOSE: Tactic: 3538943 time 0.087744 [TensorRT] VERBOSE: Tactic: 3670015 time 0.085568 [TensorRT] VERBOSE: Tactic: 3932159 time 0.100192 [TensorRT] VERBOSE: Tactic: 3997695 time 0.087456 [TensorRT] VERBOSE: Tactic: 4063231 time 0.190368 [TensorRT] VERBOSE: Tactic: 4194303 time 0.077216 [TensorRT] VERBOSE: Tactic: 4325375 time 0.130368 [TensorRT] VERBOSE: Tactic: 4521983 time 0.11168 [TensorRT] VERBOSE: Tactic: 4587519 time 0.086112 [TensorRT] VERBOSE: Tactic: 4653055 time 0.118848 [TensorRT] VERBOSE: Tactic: 4915199 time 0.083424 [TensorRT] VERBOSE: Tactic: 4980735 time 0.1224 [TensorRT] VERBOSE: Tactic: 5177343 time 0.111616 [TensorRT] VERBOSE: Tactic: 5242879 time 0.076224 [TensorRT] VERBOSE: Tactic: 5373951 time 0.11808 [TensorRT] VERBOSE: Tactic: 5439487 time 0.104864 [TensorRT] VERBOSE: Tactic: 5570559 time 0.11728 [TensorRT] VERBOSE: Tactic: 5636095 time 0.189984 [TensorRT] VERBOSE: Tactic: 5701631 time 0.068768 [TensorRT] VERBOSE: Tactic: 5767167 time 0.214912 [TensorRT] VERBOSE: Tactic: 5832703 time 0.074144 [TensorRT] VERBOSE: Tactic: 5898239 time 0.110176 [TensorRT] VERBOSE: Tactic: 6029311 time 0.0688 [TensorRT] VERBOSE: Tactic: 6225919 time 0.088672 [TensorRT] VERBOSE: Tactic: 6291455 time 0.112096 [TensorRT] VERBOSE: Tactic: 6422527 time 0.109568 [TensorRT] VERBOSE: Tactic: 6750207 time 0.11472 [TensorRT] VERBOSE: Tactic: 6815743 time 0.08352 [TensorRT] VERBOSE: Tactic: 6946815 time 0.097952 [TensorRT] VERBOSE: Tactic: 7077887 time 0.082464 [TensorRT] VERBOSE: Tactic: 7143423 time 0.118176 [TensorRT] VERBOSE: Tactic: 7208959 time 0.07328 [TensorRT] VERBOSE: Tactic: 7340031 time 0.108448 [TensorRT] VERBOSE: Tactic: 7405567 time 0.095584 [TensorRT] VERBOSE: Tactic: 7536639 time 0.093504 [TensorRT] VERBOSE: Tactic: 7602175 time 0.082464 [TensorRT] VERBOSE: Tactic: 7733247 time 0.078976 [TensorRT] VERBOSE: Tactic: 7798783 time 0.080768 [TensorRT] VERBOSE: Tactic: 8191999 time 0.115328 [TensorRT] VERBOSE: Tactic: 8257535 time 0.078816 [TensorRT] VERBOSE: Tactic: 8323071 time 0.094368 [TensorRT] VERBOSE: Tactic: 8650751 time 0.082368 [TensorRT] VERBOSE: Tactic: 8716287 time 0.094656 [TensorRT] VERBOSE: Tactic: 9568255 time 0.083776 [TensorRT] VERBOSE: Tactic: 9895935 time 0.0768 [TensorRT] VERBOSE: Tactic: 10223615 time 0.070688 [TensorRT] VERBOSE: Tactic: 10354687 time 0.140544 [TensorRT] VERBOSE: Tactic: 10551295 time 0.083968 [TensorRT] VERBOSE: Tactic: 10747903 time 0.081344 [TensorRT] VERBOSE: Tactic: 10944511 time 0.122944 [TensorRT] VERBOSE: Fastest Tactic: 589823 Time: 0.067584 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CaskConvolution) [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.047872 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.05984 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.046752 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.032544 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.059392 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.033792 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.033248 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.033184 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.032608 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.032896 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.059776 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.047168 [TensorRT] VERBOSE: Fastest Tactic: 7039764449991095921 Time: 0.032544 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_24 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7039764449991095921 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.119392 [TensorRT] VERBOSE: Tactic: 0 time 0.061824 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.061824 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.139264 [TensorRT] VERBOSE: Tactic: 0 time 0.430784 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.139264 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.179712 [TensorRT] VERBOSE: Tactic: 0 time 0.099328 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.099328 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.173696 [TensorRT] VERBOSE: Tactic: 0 time 0.344864 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.173696 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.322816 [TensorRT] VERBOSE: Tactic: 0 time 0.340768 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.322816 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.14464 [TensorRT] VERBOSE: Tactic: 0 time 0.063392 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.063392 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.18336 [TensorRT] VERBOSE: Tactic: 0 time 0.359968 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.18336 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.174016 [TensorRT] VERBOSE: Tactic: 0 time 0.734752 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.174016 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,1605632) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.138656 [TensorRT] VERBOSE: Tactic: 256 time 0.138784 [TensorRT] VERBOSE: Tactic: 512 time 0.141088 [TensorRT] VERBOSE: Tactic: -32 time 0.171168 [TensorRT] VERBOSE: Tactic: -64 time 0.142336 [TensorRT] VERBOSE: Tactic: -128 time 0.139232 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.138656 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.074048 [TensorRT] VERBOSE: Tactic: 1 time 0.06896 [TensorRT] VERBOSE: Tactic: 2 time 0.057856 [TensorRT] VERBOSE: Tactic: 3 time 0.066528 [TensorRT] VERBOSE: Tactic: 4 time 0.059776 [TensorRT] VERBOSE: Tactic: 5 time 0.059296 [TensorRT] VERBOSE: Tactic: 6 time 0.06896 [TensorRT] VERBOSE: Tactic: 7 time 0.061408 [TensorRT] VERBOSE: Tactic: 8 time 0.059264 [TensorRT] VERBOSE: Tactic: 9 time 0.06048 [TensorRT] VERBOSE: Tactic: 28 time 0.072512 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.057856 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.139168 [TensorRT] VERBOSE: Tactic: 256 time 0.14016 [TensorRT] VERBOSE: Tactic: 512 time 0.140096 [TensorRT] VERBOSE: Tactic: -32 time 0.169856 [TensorRT] VERBOSE: Tactic: -64 time 0.143328 [TensorRT] VERBOSE: Tactic: -128 time 0.140416 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.139168 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.09408 [TensorRT] VERBOSE: Tactic: 25 time 0.095232 [TensorRT] VERBOSE: Tactic: 26 time 0.096544 [TensorRT] VERBOSE: Tactic: 27 time 0.095808 [TensorRT] VERBOSE: Tactic: 31 time 0.095232 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.09408 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.156992 [TensorRT] VERBOSE: Tactic: 256 time 0.133824 [TensorRT] VERBOSE: Tactic: 512 time 0.134144 [TensorRT] VERBOSE: Tactic: -32 time 0.166304 [TensorRT] VERBOSE: Tactic: -64 time 0.178208 [TensorRT] VERBOSE: Tactic: -128 time 0.178112 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.133824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.041504 [TensorRT] VERBOSE: Tactic: 1 time 0.031552 [TensorRT] VERBOSE: Tactic: 2 time 0.030432 [TensorRT] VERBOSE: Tactic: 3 time 0.027456 [TensorRT] VERBOSE: Tactic: 4 time 0.030624 [TensorRT] VERBOSE: Tactic: 5 time 0.03216 [TensorRT] VERBOSE: Tactic: 6 time 0.027648 [TensorRT] VERBOSE: Tactic: 7 time 0.030176 [TensorRT] VERBOSE: Tactic: 8 time 0.036192 [TensorRT] VERBOSE: Tactic: 9 time 0.039584 [TensorRT] VERBOSE: Tactic: 10 time 0.071456 [TensorRT] VERBOSE: Tactic: 11 time 0.052672 [TensorRT] VERBOSE: Tactic: 12 time 0.04672 [TensorRT] VERBOSE: Tactic: 13 time 0.04336 [TensorRT] VERBOSE: Tactic: 14 time 0.040064 [TensorRT] VERBOSE: Tactic: 15 time 0.041376 [TensorRT] VERBOSE: Tactic: 16 time 0.042112 [TensorRT] VERBOSE: Tactic: 17 time 0.040544 [TensorRT] VERBOSE: Tactic: 18 time 0.042464 [TensorRT] VERBOSE: Tactic: 19 time 0.043936 [TensorRT] VERBOSE: Tactic: 20 time 0.122688 [TensorRT] VERBOSE: Tactic: 21 time 0.086368 [TensorRT] VERBOSE: Tactic: 22 time 0.061792 [TensorRT] VERBOSE: Tactic: 23 time 0.05264 [TensorRT] VERBOSE: Tactic: 28 time 0.0592 [TensorRT] VERBOSE: Tactic: 29 time 0.07632 [TensorRT] VERBOSE: Tactic: 30 time 0.118144 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.027456 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.156608 [TensorRT] VERBOSE: Tactic: 256 time 0.13344 [TensorRT] VERBOSE: Tactic: 512 time 0.134144 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.13344 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.029184 [TensorRT] VERBOSE: Tactic: 11 time 0.02944 [TensorRT] VERBOSE: Tactic: 12 time 0.028832 [TensorRT] VERBOSE: Tactic: 13 time 0.03184 [TensorRT] VERBOSE: Tactic: 14 time 0.031424 [TensorRT] VERBOSE: Tactic: 15 time 0.043936 [TensorRT] VERBOSE: Tactic: 16 time 0.029952 [TensorRT] VERBOSE: Tactic: 17 time 0.033728 [TensorRT] VERBOSE: Tactic: 18 time 0.043872 [TensorRT] VERBOSE: Tactic: 19 time 0.059456 [TensorRT] VERBOSE: Tactic: 20 time 0.032992 [TensorRT] VERBOSE: Tactic: 21 time 0.029504 [TensorRT] VERBOSE: Tactic: 22 time 0.02784 [TensorRT] VERBOSE: Tactic: 23 time 0.03104 [TensorRT] VERBOSE: Tactic: 24 time 0.042816 [TensorRT] VERBOSE: Tactic: 25 time 0.03552 [TensorRT] VERBOSE: Tactic: 26 time 0.029472 [TensorRT] VERBOSE: Tactic: 27 time 0.028256 [TensorRT] VERBOSE: Tactic: 29 time 0.164672 [TensorRT] VERBOSE: Tactic: 30 time 0.093024 [TensorRT] VERBOSE: Tactic: 31 time 0.061312 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.02784 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.145376 [TensorRT] VERBOSE: Tactic: 0 time 0.395264 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.145376 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.183136 [TensorRT] VERBOSE: Tactic: 0 time 0.038912 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.038912 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.17376 [TensorRT] VERBOSE: Tactic: 0 time 0.407136 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.17376 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.324096 [TensorRT] VERBOSE: Tactic: 0 time 0.3392 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.324096 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.186496 [TensorRT] VERBOSE: Tactic: 0 time 0.359424 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.186496 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.178368 [TensorRT] VERBOSE: Tactic: 0 time 0.724992 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.178368 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.178432 [TensorRT] VERBOSE: Tactic: 0 time 0.095552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.095552 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.17584 [TensorRT] VERBOSE: Tactic: 0 time 0.39824 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.17584 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.175968 [TensorRT] VERBOSE: Tactic: 0 time 0.023008 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023008 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.181824 [TensorRT] VERBOSE: Tactic: 0 time 0.152576 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.152576 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.166048 [TensorRT] VERBOSE: Tactic: 0 time 0.567296 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.166048 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.170464 [TensorRT] VERBOSE: Tactic: 0 time 0.041312 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.041312 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.34208 [TensorRT] VERBOSE: Tactic: 0 time 0.071136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.071136 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.336704 [TensorRT] VERBOSE: Tactic: 0 time 0.671072 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.336704 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.356352 [TensorRT] VERBOSE: Tactic: 0 time 0.69824 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.356352 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.346624 [TensorRT] VERBOSE: Tactic: 0 time 1.21274 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.346624 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.335776 [TensorRT] VERBOSE: Tactic: 0 time 0.06992 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.06992 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.328608 [TensorRT] VERBOSE: Tactic: 0 time 0.228512 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.228512 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,1605632) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.82176 [TensorRT] VERBOSE: Tactic: 655359 time 0.735232 [TensorRT] VERBOSE: Tactic: 786431 time 0.695296 [TensorRT] VERBOSE: Tactic: 851967 time 0.847104 [TensorRT] VERBOSE: Tactic: 1179647 time 0.685792 [TensorRT] VERBOSE: Tactic: 1310719 time 1.12787 [TensorRT] VERBOSE: Tactic: 1376255 time 0.713856 [TensorRT] VERBOSE: Tactic: 1441791 time 0.818112 [TensorRT] VERBOSE: Tactic: 1507327 time 0.749568 [TensorRT] VERBOSE: Tactic: 1638399 time 0.708608 [TensorRT] VERBOSE: Tactic: 1835007 time 0.74272 [TensorRT] VERBOSE: Tactic: 1900543 time 0.809728 [TensorRT] VERBOSE: Tactic: 2097151 time 0.716544 [TensorRT] VERBOSE: Tactic: 2162687 time 0.6824 [TensorRT] VERBOSE: Tactic: 2293759 time 0.715232 [TensorRT] VERBOSE: Tactic: 2359295 time 0.625024 [TensorRT] VERBOSE: Tactic: 2686975 time 0.655872 [TensorRT] VERBOSE: Tactic: 3080191 time 0.7544 [TensorRT] VERBOSE: Tactic: 3342335 time 0.776672 [TensorRT] VERBOSE: Tactic: 3407871 time 0.665088 [TensorRT] VERBOSE: Tactic: 3538943 time 0.658272 [TensorRT] VERBOSE: Tactic: 3670015 time 0.907904 [TensorRT] VERBOSE: Tactic: 3932159 time 0.78608 [TensorRT] VERBOSE: Tactic: 3997695 time 0.712512 [TensorRT] VERBOSE: Tactic: 4063231 time 0.819552 [TensorRT] VERBOSE: Tactic: 4194303 time 0.655296 [TensorRT] VERBOSE: Tactic: 4259839 time 0.67952 [TensorRT] VERBOSE: Tactic: 4325375 time 0.665728 [TensorRT] VERBOSE: Tactic: 4521983 time 0.68112 [TensorRT] VERBOSE: Tactic: 4587519 time 0.673888 [TensorRT] VERBOSE: Tactic: 4653055 time 0.623392 [TensorRT] VERBOSE: Tactic: 4915199 time 0.667552 [TensorRT] VERBOSE: Tactic: 4980735 time 0.657888 [TensorRT] VERBOSE: Tactic: 5177343 time 0.716096 [TensorRT] VERBOSE: Tactic: 5242879 time 0.6704 [TensorRT] VERBOSE: Tactic: 5373951 time 0.843776 [TensorRT] VERBOSE: Tactic: 5439487 time 1.01901 [TensorRT] VERBOSE: Tactic: 5570559 time 0.756672 [TensorRT] VERBOSE: Tactic: 5636095 time 0.800704 [TensorRT] VERBOSE: Tactic: 5701631 time 0.703008 [TensorRT] VERBOSE: Tactic: 5767167 time 3.91373 [TensorRT] VERBOSE: Tactic: 5832703 time 0.678112 [TensorRT] VERBOSE: Tactic: 5898239 time 0.641056 [TensorRT] VERBOSE: Tactic: 6029311 time 0.702976 [TensorRT] VERBOSE: Tactic: 6225919 time 0.674784 [TensorRT] VERBOSE: Tactic: 6291455 time 0.678912 [TensorRT] VERBOSE: Tactic: 6422527 time 0.75376 [TensorRT] VERBOSE: Tactic: 6750207 time 0.792576 [TensorRT] VERBOSE: Tactic: 6815743 time 0.803296 [TensorRT] VERBOSE: Tactic: 6946815 time 0.943584 [TensorRT] VERBOSE: Tactic: 7012351 time 0.70752 [TensorRT] VERBOSE: Tactic: 7077887 time 0.657856 [TensorRT] VERBOSE: Tactic: 7143423 time 0.977216 [TensorRT] VERBOSE: Tactic: 7208959 time 0.695264 [TensorRT] VERBOSE: Tactic: 7340031 time 0.659136 [TensorRT] VERBOSE: Tactic: 7405567 time 0.664992 [TensorRT] VERBOSE: Tactic: 7536639 time 0.821408 [TensorRT] VERBOSE: Tactic: 7602175 time 0.732256 [TensorRT] VERBOSE: Tactic: 7733247 time 0.638592 [TensorRT] VERBOSE: Tactic: 7798783 time 0.699136 [TensorRT] VERBOSE: Tactic: 8191999 time 0.93312 [TensorRT] VERBOSE: Tactic: 8257535 time 0.685056 [TensorRT] VERBOSE: Tactic: 8323071 time 0.78368 [TensorRT] VERBOSE: Tactic: 8650751 time 0.782176 [TensorRT] VERBOSE: Tactic: 8716287 time 0.81952 [TensorRT] VERBOSE: Tactic: 9109503 time 0.725536 [TensorRT] VERBOSE: Tactic: 9568255 time 0.661568 [TensorRT] VERBOSE: Tactic: 9895935 time 0.659072 [TensorRT] VERBOSE: Tactic: 10223615 time 0.660352 [TensorRT] VERBOSE: Tactic: 10354687 time 0.674816 [TensorRT] VERBOSE: Tactic: 10551295 time 0.759072 [TensorRT] VERBOSE: Tactic: 10747903 time 0.632704 [TensorRT] VERBOSE: Tactic: 10944511 time 0.657728 [TensorRT] VERBOSE: Fastest Tactic: 4653055 Time: 0.623392 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.350464 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.350208 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.227872 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.351008 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.187392 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.181952 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.189184 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.274048 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.226304 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.181952 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.345472 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 6422528, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 6963200, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 108544, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.345472 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,401408) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.123552 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.097344 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.090016 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.072384 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.096512 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.091136 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.06992 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.074336 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.093184 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.120192 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.090432 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.119328 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.06992 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,401408) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.173184 [TensorRT] VERBOSE: Tactic: 655359 time 0.17136 [TensorRT] VERBOSE: Tactic: 786431 time 0.138976 [TensorRT] VERBOSE: Tactic: 851967 time 0.278816 [TensorRT] VERBOSE: Tactic: 1179647 time 0.174624 [TensorRT] VERBOSE: Tactic: 1310719 time 0.1368 [TensorRT] VERBOSE: Tactic: 1376255 time 0.14336 [TensorRT] VERBOSE: Tactic: 1441791 time 0.188416 [TensorRT] VERBOSE: Tactic: 1507327 time 0.21008 [TensorRT] VERBOSE: Tactic: 1638399 time 0.180416 [TensorRT] VERBOSE: Tactic: 1835007 time 0.145824 [TensorRT] VERBOSE: Tactic: 1900543 time 0.20608 [TensorRT] VERBOSE: Tactic: 2097151 time 0.175104 [TensorRT] VERBOSE: Tactic: 2162687 time 0.17536 [TensorRT] VERBOSE: Tactic: 2293759 time 0.143904 [TensorRT] VERBOSE: Tactic: 2359295 time 0.176192 [TensorRT] VERBOSE: Tactic: 2686975 time 0.155872 [TensorRT] VERBOSE: Tactic: 3080191 time 0.192512 [TensorRT] VERBOSE: Tactic: 3342335 time 0.205664 [TensorRT] VERBOSE: Tactic: 3407871 time 0.138528 [TensorRT] VERBOSE: Tactic: 3538943 time 0.14656 [TensorRT] VERBOSE: Tactic: 3670015 time 0.18544 [TensorRT] VERBOSE: Tactic: 3932159 time 0.179424 [TensorRT] VERBOSE: Tactic: 3997695 time 0.148192 [TensorRT] VERBOSE: Tactic: 4063231 time 0.267552 [TensorRT] VERBOSE: Tactic: 4194303 time 0.128384 [TensorRT] VERBOSE: Tactic: 4259839 time 0.19872 [TensorRT] VERBOSE: Tactic: 4325375 time 0.2192 [TensorRT] VERBOSE: Tactic: 4521983 time 0.201088 [TensorRT] VERBOSE: Tactic: 4587519 time 0.13648 [TensorRT] VERBOSE: Tactic: 4653055 time 0.181504 [TensorRT] VERBOSE: Tactic: 4915199 time 0.134144 [TensorRT] VERBOSE: Tactic: 4980735 time 0.210912 [TensorRT] VERBOSE: Tactic: 5177343 time 0.17984 [TensorRT] VERBOSE: Tactic: 5242879 time 0.142336 [TensorRT] VERBOSE: Tactic: 5373951 time 0.199296 [TensorRT] VERBOSE: Tactic: 5439487 time 0.204448 [TensorRT] VERBOSE: Tactic: 5570559 time 0.200128 [TensorRT] VERBOSE: Tactic: 5636095 time 0.267424 [TensorRT] VERBOSE: Tactic: 5701631 time 0.151168 [TensorRT] VERBOSE: Tactic: 5767167 time 0.456 [TensorRT] VERBOSE: Tactic: 5832703 time 0.135936 [TensorRT] VERBOSE: Tactic: 5898239 time 0.167936 [TensorRT] VERBOSE: Tactic: 6029311 time 0.141536 [TensorRT] VERBOSE: Tactic: 6225919 time 0.15248 [TensorRT] VERBOSE: Tactic: 6291455 time 0.172512 [TensorRT] VERBOSE: Tactic: 6422527 time 0.185248 [TensorRT] VERBOSE: Tactic: 6750207 time 0.182784 [TensorRT] VERBOSE: Tactic: 6815743 time 0.165888 [TensorRT] VERBOSE: Tactic: 6946815 time 0.192608 [TensorRT] VERBOSE: Tactic: 7012351 time 0.170912 [TensorRT] VERBOSE: Tactic: 7077887 time 0.144544 [TensorRT] VERBOSE: Tactic: 7143423 time 0.194208 [TensorRT] VERBOSE: Tactic: 7208959 time 0.145472 [TensorRT] VERBOSE: Tactic: 7340031 time 0.17376 [TensorRT] VERBOSE: Tactic: 7405567 time 0.152224 [TensorRT] VERBOSE: Tactic: 7536639 time 0.172512 [TensorRT] VERBOSE: Tactic: 7602175 time 0.142688 [TensorRT] VERBOSE: Tactic: 7733247 time 0.140896 [TensorRT] VERBOSE: Tactic: 7798783 time 0.141856 [TensorRT] VERBOSE: Tactic: 8191999 time 0.186816 [TensorRT] VERBOSE: Tactic: 8257535 time 0.143616 [TensorRT] VERBOSE: Tactic: 8323071 time 0.156224 [TensorRT] VERBOSE: Tactic: 8650751 time 0.157216 [TensorRT] VERBOSE: Tactic: 8716287 time 0.18112 [TensorRT] VERBOSE: Tactic: 9109503 time 0.21312 [TensorRT] VERBOSE: Tactic: 9568255 time 0.135904 [TensorRT] VERBOSE: Tactic: 9895935 time 0.1288 [TensorRT] VERBOSE: Tactic: 10223615 time 0.158144 [TensorRT] VERBOSE: Tactic: 10354687 time 0.225184 [TensorRT] VERBOSE: Tactic: 10551295 time 0.1552 [TensorRT] VERBOSE: Tactic: 10747903 time 0.137952 [TensorRT] VERBOSE: Tactic: 10944511 time 0.211968 [TensorRT] VERBOSE: Fastest Tactic: 4194303 Time: 0.128384 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.054816 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.100224 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.058176 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.057344 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.075232 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.101632 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.070656 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.067104 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.099584 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.067136 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.072576 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.072448 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.054816 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3145259992339075399 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,401408) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.099296 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.075872 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.067744 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.055712 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.066624 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.056128 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.072 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.072832 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.099648 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.067552 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.057632 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.099328 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.055712 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,50176) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,50176) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,50176) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.10768 [TensorRT] VERBOSE: Tactic: 655359 time 0.148032 [TensorRT] VERBOSE: Tactic: 786431 time 0.125536 [TensorRT] VERBOSE: Tactic: 851967 time 0.270304 [TensorRT] VERBOSE: Tactic: 1179647 time 0.159616 [TensorRT] VERBOSE: Tactic: 1310719 time 0.101984 [TensorRT] VERBOSE: Tactic: 1376255 time 0.11264 [TensorRT] VERBOSE: Tactic: 1441791 time 0.169952 [TensorRT] VERBOSE: Tactic: 1507327 time 0.188544 [TensorRT] VERBOSE: Tactic: 1638399 time 0.168576 [TensorRT] VERBOSE: Tactic: 1835007 time 0.13888 [TensorRT] VERBOSE: Tactic: 1900543 time 0.1704 [TensorRT] VERBOSE: Tactic: 2097151 time 0.208416 [TensorRT] VERBOSE: Tactic: 2162687 time 0.12288 [TensorRT] VERBOSE: Tactic: 2293759 time 0.121312 [TensorRT] VERBOSE: Tactic: 2359295 time 0.127296 [TensorRT] VERBOSE: Tactic: 2686975 time 0.122624 [TensorRT] VERBOSE: Tactic: 3080191 time 0.175008 [TensorRT] VERBOSE: Tactic: 3342335 time 0.183712 [TensorRT] VERBOSE: Tactic: 3407871 time 0.127008 [TensorRT] VERBOSE: Tactic: 3538943 time 0.137824 [TensorRT] VERBOSE: Tactic: 3670015 time 0.143552 [TensorRT] VERBOSE: Tactic: 3932159 time 0.16576 [TensorRT] VERBOSE: Tactic: 3997695 time 0.133056 [TensorRT] VERBOSE: Tactic: 4063231 time 0.258912 [TensorRT] VERBOSE: Tactic: 4194303 time 0.115232 [TensorRT] VERBOSE: Tactic: 4259839 time 0.18816 [TensorRT] VERBOSE: Tactic: 4325375 time 0.219136 [TensorRT] VERBOSE: Tactic: 4521983 time 0.199392 [TensorRT] VERBOSE: Tactic: 4587519 time 0.125952 [TensorRT] VERBOSE: Tactic: 4653055 time 0.170624 [TensorRT] VERBOSE: Tactic: 4915199 time 0.122912 [TensorRT] VERBOSE: Tactic: 4980735 time 0.210944 [TensorRT] VERBOSE: Tactic: 5177343 time 0.159648 [TensorRT] VERBOSE: Tactic: 5242879 time 0.128768 [TensorRT] VERBOSE: Tactic: 5373951 time 0.174496 [TensorRT] VERBOSE: Tactic: 5439487 time 0.177888 [TensorRT] VERBOSE: Tactic: 5570559 time 0.179136 [TensorRT] VERBOSE: Tactic: 5636095 time 0.25984 [TensorRT] VERBOSE: Tactic: 5701631 time 0.116032 [TensorRT] VERBOSE: Tactic: 5767167 time 0.420864 [TensorRT] VERBOSE: Tactic: 5832703 time 0.122688 [TensorRT] VERBOSE: Tactic: 5898239 time 0.157184 [TensorRT] VERBOSE: Tactic: 6029311 time 0.121856 [TensorRT] VERBOSE: Tactic: 6225919 time 0.141152 [TensorRT] VERBOSE: Tactic: 6291455 time 0.15872 [TensorRT] VERBOSE: Tactic: 6422527 time 0.16896 [TensorRT] VERBOSE: Tactic: 6750207 time 0.173184 [TensorRT] VERBOSE: Tactic: 6815743 time 0.142656 [TensorRT] VERBOSE: Tactic: 6946815 time 0.165088 [TensorRT] VERBOSE: Tactic: 7012351 time 0.207776 [TensorRT] VERBOSE: Tactic: 7077887 time 0.130624 [TensorRT] VERBOSE: Tactic: 7143423 time 0.216928 [TensorRT] VERBOSE: Tactic: 7208959 time 0.1216 [TensorRT] VERBOSE: Tactic: 7340031 time 0.155136 [TensorRT] VERBOSE: Tactic: 7405567 time 0.130816 [TensorRT] VERBOSE: Tactic: 7536639 time 0.16544 [TensorRT] VERBOSE: Tactic: 7602175 time 0.128224 [TensorRT] VERBOSE: Tactic: 7733247 time 0.127104 [TensorRT] VERBOSE: Tactic: 7798783 time 0.124448 [TensorRT] VERBOSE: Tactic: 8191999 time 0.190976 [TensorRT] VERBOSE: Tactic: 8257535 time 0.11264 [TensorRT] VERBOSE: Tactic: 8323071 time 0.150688 [TensorRT] VERBOSE: Tactic: 8650751 time 0.131328 [TensorRT] VERBOSE: Tactic: 8716287 time 0.154976 [TensorRT] VERBOSE: Tactic: 9109503 time 0.158528 [TensorRT] VERBOSE: Tactic: 9568255 time 0.12288 [TensorRT] VERBOSE: Tactic: 9895935 time 0.114432 [TensorRT] VERBOSE: Tactic: 10223615 time 0.120448 [TensorRT] VERBOSE: Tactic: 10354687 time 0.219936 [TensorRT] VERBOSE: Tactic: 10551295 time 0.135936 [TensorRT] VERBOSE: Tactic: 10747903 time 0.12672 [TensorRT] VERBOSE: Tactic: 10944511 time 0.21072 [TensorRT] VERBOSE: Fastest Tactic: 1310719 Time: 0.101984 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CaskConvolution) [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.060736 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.073632 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.057984 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.045632 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.073216 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.040384 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.042528 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.040032 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.04112 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.045536 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.072576 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.056544 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.040032 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_27 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,112,12544,802816) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.11648 [TensorRT] VERBOSE: Tactic: 256 time 0.11904 [TensorRT] VERBOSE: Tactic: 512 time 0.119264 [TensorRT] VERBOSE: Tactic: -32 time 0.171072 [TensorRT] VERBOSE: Tactic: -64 time 0.143936 [TensorRT] VERBOSE: Tactic: -128 time 0.137568 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.11648 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.068128 [TensorRT] VERBOSE: Tactic: 1 time 0.067872 [TensorRT] VERBOSE: Tactic: 2 time 0.057824 [TensorRT] VERBOSE: Tactic: 3 time 0.065824 [TensorRT] VERBOSE: Tactic: 4 time 0.058464 [TensorRT] VERBOSE: Tactic: 5 time 0.058752 [TensorRT] VERBOSE: Tactic: 6 time 0.070048 [TensorRT] VERBOSE: Tactic: 7 time 0.062688 [TensorRT] VERBOSE: Tactic: 8 time 0.059168 [TensorRT] VERBOSE: Tactic: 9 time 0.062048 [TensorRT] VERBOSE: Tactic: 28 time 0.068896 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.057824 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544:32,25088) -> Float(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.11824 [TensorRT] VERBOSE: Tactic: 256 time 0.118848 [TensorRT] VERBOSE: Tactic: 512 time 0.11984 [TensorRT] VERBOSE: Tactic: -32 time 0.171936 [TensorRT] VERBOSE: Tactic: -64 time 0.142176 [TensorRT] VERBOSE: Tactic: -128 time 0.138816 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.11824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.095552 [TensorRT] VERBOSE: Tactic: 25 time 0.093632 [TensorRT] VERBOSE: Tactic: 26 time 0.094496 [TensorRT] VERBOSE: Tactic: 27 time 0.093536 [TensorRT] VERBOSE: Tactic: 31 time 0.095264 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.093536 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,112,12544:4,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.155488 [TensorRT] VERBOSE: Tactic: 256 time 0.1336 [TensorRT] VERBOSE: Tactic: 512 time 0.135264 [TensorRT] VERBOSE: Tactic: -32 time 0.166912 [TensorRT] VERBOSE: Tactic: -64 time 0.17632 [TensorRT] VERBOSE: Tactic: -128 time 0.1792 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.1336 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.040832 [TensorRT] VERBOSE: Tactic: 1 time 0.031616 [TensorRT] VERBOSE: Tactic: 2 time 0.032416 [TensorRT] VERBOSE: Tactic: 3 time 0.027488 [TensorRT] VERBOSE: Tactic: 4 time 0.031552 [TensorRT] VERBOSE: Tactic: 5 time 0.031168 [TensorRT] VERBOSE: Tactic: 6 time 0.027712 [TensorRT] VERBOSE: Tactic: 7 time 0.029696 [TensorRT] VERBOSE: Tactic: 8 time 0.036352 [TensorRT] VERBOSE: Tactic: 9 time 0.041312 [TensorRT] VERBOSE: Tactic: 10 time 0.072 [TensorRT] VERBOSE: Tactic: 11 time 0.05328 [TensorRT] VERBOSE: Tactic: 12 time 0.048416 [TensorRT] VERBOSE: Tactic: 13 time 0.044224 [TensorRT] VERBOSE: Tactic: 14 time 0.040896 [TensorRT] VERBOSE: Tactic: 15 time 0.040928 [TensorRT] VERBOSE: Tactic: 16 time 0.04272 [TensorRT] VERBOSE: Tactic: 17 time 0.039872 [TensorRT] VERBOSE: Tactic: 18 time 0.044128 [TensorRT] VERBOSE: Tactic: 19 time 0.043008 [TensorRT] VERBOSE: Tactic: 20 time 0.122816 [TensorRT] VERBOSE: Tactic: 21 time 0.085376 [TensorRT] VERBOSE: Tactic: 22 time 0.061408 [TensorRT] VERBOSE: Tactic: 23 time 0.054272 [TensorRT] VERBOSE: Tactic: 28 time 0.058432 [TensorRT] VERBOSE: Tactic: 29 time 0.075712 [TensorRT] VERBOSE: Tactic: 30 time 0.11808 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.027488 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,112,12544:32,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.156032 [TensorRT] VERBOSE: Tactic: 256 time 0.132384 [TensorRT] VERBOSE: Tactic: 512 time 0.134816 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.132384 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_28 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.028576 [TensorRT] VERBOSE: Tactic: 11 time 0.030656 [TensorRT] VERBOSE: Tactic: 12 time 0.031264 [TensorRT] VERBOSE: Tactic: 13 time 0.031744 [TensorRT] VERBOSE: Tactic: 14 time 0.029536 [TensorRT] VERBOSE: Tactic: 15 time 0.042656 [TensorRT] VERBOSE: Tactic: 16 time 0.03024 [TensorRT] VERBOSE: Tactic: 17 time 0.03392 [TensorRT] VERBOSE: Tactic: 18 time 0.045056 [TensorRT] VERBOSE: Tactic: 19 time 0.060416 [TensorRT] VERBOSE: Tactic: 20 time 0.031712 [TensorRT] VERBOSE: Tactic: 21 time 0.028512 [TensorRT] VERBOSE: Tactic: 22 time 0.027168 [TensorRT] VERBOSE: Tactic: 23 time 0.031552 [TensorRT] VERBOSE: Tactic: 24 time 0.043008 [TensorRT] VERBOSE: Tactic: 25 time 0.034912 [TensorRT] VERBOSE: Tactic: 26 time 0.031232 [TensorRT] VERBOSE: Tactic: 27 time 0.028672 [TensorRT] VERBOSE: Tactic: 29 time 0.164032 [TensorRT] VERBOSE: Tactic: 30 time 0.093088 [TensorRT] VERBOSE: Tactic: 31 time 0.0608 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.027168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,112,12544,802816) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.56944 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.56944 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.451424 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.436864 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.450656 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.503328 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.411136 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.415264 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.541376 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.462016 [TensorRT] VERBOSE: Fastest Tactic: 6808617066150061604 Time: 0.411136 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.60672 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 7225344, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 37322752, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 313856, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.60672 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.128512 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.135264 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.134464 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.12048 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.127264 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.138976 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.123776 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.118176 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.127488 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.150208 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.118176 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.161024 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.161024 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.115456 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.112192 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.128224 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.120864 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.12272 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.12096 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.12336 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.136896 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.121632 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.114816 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.112192 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4581732244273465060 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:4,200704) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.124928 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.126432 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.111648 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.123712 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.110208 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.116224 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.121184 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.113312 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.12192 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.134944 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.110208 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,112,12544:32,25088) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.143008 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.143008 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CaskConvolution) [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.049408 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.05504 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.05152 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.052512 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.04944 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.049408 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.054496 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.049696 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.052864 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.050016 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.049152 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.04608 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.04608 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_29 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.074752 [TensorRT] VERBOSE: Tactic: 0 time 0.17936 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.074752 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.09232 [TensorRT] VERBOSE: Tactic: 0 time 0.020704 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020704 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.090112 [TensorRT] VERBOSE: Tactic: 0 time 0.118688 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.090112 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.131072 [TensorRT] VERBOSE: Tactic: 0 time 0.090112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.090112 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.096096 [TensorRT] VERBOSE: Tactic: 0 time 0.082112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.082112 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.089248 [TensorRT] VERBOSE: Tactic: 0 time 0.161312 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.089248 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.091712 [TensorRT] VERBOSE: Tactic: 0 time 0.032032 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.032032 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.090208 [TensorRT] VERBOSE: Tactic: 0 time 0.174592 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.090208 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.089056 [TensorRT] VERBOSE: Tactic: 0 time 0.019392 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019392 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.091488 [TensorRT] VERBOSE: Tactic: 0 time 0.056768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.056768 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.085952 [TensorRT] VERBOSE: Tactic: 0 time 0.190624 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.085952 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.088448 [TensorRT] VERBOSE: Tactic: 0 time 0.053344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.053344 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.062272 [TensorRT] VERBOSE: Tactic: 256 time 0.06192 [TensorRT] VERBOSE: Tactic: 512 time 0.063904 [TensorRT] VERBOSE: Tactic: -32 time 0.093184 [TensorRT] VERBOSE: Tactic: -64 time 0.078912 [TensorRT] VERBOSE: Tactic: -128 time 0.073536 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.06192 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.038464 [TensorRT] VERBOSE: Tactic: 1 time 0.037056 [TensorRT] VERBOSE: Tactic: 2 time 0.031744 [TensorRT] VERBOSE: Tactic: 3 time 0.036832 [TensorRT] VERBOSE: Tactic: 4 time 0.032544 [TensorRT] VERBOSE: Tactic: 5 time 0.033696 [TensorRT] VERBOSE: Tactic: 6 time 0.038784 [TensorRT] VERBOSE: Tactic: 7 time 0.032608 [TensorRT] VERBOSE: Tactic: 8 time 0.032448 [TensorRT] VERBOSE: Tactic: 9 time 0.033376 [TensorRT] VERBOSE: Tactic: 28 time 0.036064 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.031744 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061248 [TensorRT] VERBOSE: Tactic: 256 time 0.062848 [TensorRT] VERBOSE: Tactic: 512 time 0.062016 [TensorRT] VERBOSE: Tactic: -32 time 0.095424 [TensorRT] VERBOSE: Tactic: -64 time 0.078048 [TensorRT] VERBOSE: Tactic: -128 time 0.073184 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.061248 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.048384 [TensorRT] VERBOSE: Tactic: 25 time 0.049152 [TensorRT] VERBOSE: Tactic: 26 time 0.04784 [TensorRT] VERBOSE: Tactic: 27 time 0.049504 [TensorRT] VERBOSE: Tactic: 31 time 0.048096 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.04784 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.079456 [TensorRT] VERBOSE: Tactic: 256 time 0.069248 [TensorRT] VERBOSE: Tactic: 512 time 0.07104 [TensorRT] VERBOSE: Tactic: -32 time 0.087808 [TensorRT] VERBOSE: Tactic: -64 time 0.10128 [TensorRT] VERBOSE: Tactic: -128 time 0.1 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.069248 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.023104 [TensorRT] VERBOSE: Tactic: 1 time 0.01936 [TensorRT] VERBOSE: Tactic: 2 time 0.018208 [TensorRT] VERBOSE: Tactic: 3 time 0.018176 [TensorRT] VERBOSE: Tactic: 4 time 0.018208 [TensorRT] VERBOSE: Tactic: 5 time 0.01888 [TensorRT] VERBOSE: Tactic: 6 time 0.016384 [TensorRT] VERBOSE: Tactic: 7 time 0.018048 [TensorRT] VERBOSE: Tactic: 8 time 0.02416 [TensorRT] VERBOSE: Tactic: 9 time 0.025664 [TensorRT] VERBOSE: Tactic: 10 time 0.038528 [TensorRT] VERBOSE: Tactic: 11 time 0.02912 [TensorRT] VERBOSE: Tactic: 12 time 0.02608 [TensorRT] VERBOSE: Tactic: 13 time 0.026048 [TensorRT] VERBOSE: Tactic: 14 time 0.025376 [TensorRT] VERBOSE: Tactic: 15 time 0.024224 [TensorRT] VERBOSE: Tactic: 16 time 0.024864 [TensorRT] VERBOSE: Tactic: 17 time 0.022976 [TensorRT] VERBOSE: Tactic: 18 time 0.024704 [TensorRT] VERBOSE: Tactic: 19 time 0.026208 [TensorRT] VERBOSE: Tactic: 20 time 0.06304 [TensorRT] VERBOSE: Tactic: 21 time 0.046304 [TensorRT] VERBOSE: Tactic: 22 time 0.035712 [TensorRT] VERBOSE: Tactic: 23 time 0.032064 [TensorRT] VERBOSE: Tactic: 28 time 0.031456 [TensorRT] VERBOSE: Tactic: 29 time 0.041248 [TensorRT] VERBOSE: Tactic: 30 time 0.061472 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.016384 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.080224 [TensorRT] VERBOSE: Tactic: 256 time 0.07008 [TensorRT] VERBOSE: Tactic: 512 time 0.070272 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.07008 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_30 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.017376 [TensorRT] VERBOSE: Tactic: 11 time 0.017984 [TensorRT] VERBOSE: Tactic: 12 time 0.020032 [TensorRT] VERBOSE: Tactic: 13 time 0.01648 [TensorRT] VERBOSE: Tactic: 14 time 0.018496 [TensorRT] VERBOSE: Tactic: 15 time 0.027392 [TensorRT] VERBOSE: Tactic: 16 time 0.02144 [TensorRT] VERBOSE: Tactic: 17 time 0.02368 [TensorRT] VERBOSE: Tactic: 18 time 0.025216 [TensorRT] VERBOSE: Tactic: 19 time 0.039584 [TensorRT] VERBOSE: Tactic: 20 time 0.018432 [TensorRT] VERBOSE: Tactic: 21 time 0.017856 [TensorRT] VERBOSE: Tactic: 22 time 0.019328 [TensorRT] VERBOSE: Tactic: 23 time 0.017472 [TensorRT] VERBOSE: Tactic: 24 time 0.023584 [TensorRT] VERBOSE: Tactic: 25 time 0.020512 [TensorRT] VERBOSE: Tactic: 26 time 0.019456 [TensorRT] VERBOSE: Tactic: 27 time 0.017664 [TensorRT] VERBOSE: Tactic: 29 time 0.086016 [TensorRT] VERBOSE: Tactic: 30 time 0.048576 [TensorRT] VERBOSE: Tactic: 31 time 0.033856 [TensorRT] VERBOSE: Fastest Tactic: 13 Time: 0.01648 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 13 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.33728 [TensorRT] VERBOSE: Tactic: 655359 time 0.364384 [TensorRT] VERBOSE: Tactic: 786431 time 0.275648 [TensorRT] VERBOSE: Tactic: 851967 time 0.32768 [TensorRT] VERBOSE: Tactic: 1179647 time 0.28144 [TensorRT] VERBOSE: Tactic: 1310719 time 0.481088 [TensorRT] VERBOSE: Tactic: 1376255 time 0.323648 [TensorRT] VERBOSE: Tactic: 1441791 time 0.392288 [TensorRT] VERBOSE: Tactic: 1507327 time 0.334112 [TensorRT] VERBOSE: Tactic: 1638399 time 0.29088 [TensorRT] VERBOSE: Tactic: 1835007 time 0.288448 [TensorRT] VERBOSE: Tactic: 1900543 time 0.367168 [TensorRT] VERBOSE: Tactic: 2097151 time 0.2808 [TensorRT] VERBOSE: Tactic: 2162687 time 0.2856 [TensorRT] VERBOSE: Tactic: 2293759 time 0.316096 [TensorRT] VERBOSE: Tactic: 2359295 time 0.267968 [TensorRT] VERBOSE: Tactic: 2686975 time 0.280864 [TensorRT] VERBOSE: Tactic: 3080191 time 0.335872 [TensorRT] VERBOSE: Tactic: 3342335 time 0.332256 [TensorRT] VERBOSE: Tactic: 3407871 time 0.280832 [TensorRT] VERBOSE: Tactic: 3538943 time 0.278336 [TensorRT] VERBOSE: Tactic: 3670015 time 0.407264 [TensorRT] VERBOSE: Tactic: 3932159 time 0.354656 [TensorRT] VERBOSE: Tactic: 3997695 time 0.292576 [TensorRT] VERBOSE: Tactic: 4063231 time 0.324064 [TensorRT] VERBOSE: Tactic: 4194303 time 0.25168 [TensorRT] VERBOSE: Tactic: 4259839 time 0.27184 [TensorRT] VERBOSE: Tactic: 4325375 time 0.259136 [TensorRT] VERBOSE: Tactic: 4521983 time 0.295456 [TensorRT] VERBOSE: Tactic: 4587519 time 0.256576 [TensorRT] VERBOSE: Tactic: 4653055 time 0.26256 [TensorRT] VERBOSE: Tactic: 4915199 time 0.252032 [TensorRT] VERBOSE: Tactic: 4980735 time 0.26912 [TensorRT] VERBOSE: Tactic: 5177343 time 0.304832 [TensorRT] VERBOSE: Tactic: 5242879 time 0.278816 [TensorRT] VERBOSE: Tactic: 5373951 time 0.373088 [TensorRT] VERBOSE: Tactic: 5439487 time 0.414176 [TensorRT] VERBOSE: Tactic: 5570559 time 0.336224 [TensorRT] VERBOSE: Tactic: 5636095 time 0.31568 [TensorRT] VERBOSE: Tactic: 5701631 time 0.289024 [TensorRT] VERBOSE: Tactic: 5767167 time 1.26 [TensorRT] VERBOSE: Tactic: 5832703 time 0.27808 [TensorRT] VERBOSE: Tactic: 5898239 time 0.270912 [TensorRT] VERBOSE: Tactic: 6029311 time 0.287744 [TensorRT] VERBOSE: Tactic: 6225919 time 0.280768 [TensorRT] VERBOSE: Tactic: 6291455 time 0.283808 [TensorRT] VERBOSE: Tactic: 6422527 time 0.335904 [TensorRT] VERBOSE: Tactic: 6750207 time 0.314752 [TensorRT] VERBOSE: Tactic: 6815743 time 0.33056 [TensorRT] VERBOSE: Tactic: 6946815 time 0.38688 [TensorRT] VERBOSE: Tactic: 7012351 time 0.282784 [TensorRT] VERBOSE: Tactic: 7077887 time 0.273504 [TensorRT] VERBOSE: Tactic: 7143423 time 0.400352 [TensorRT] VERBOSE: Tactic: 7208959 time 0.286848 [TensorRT] VERBOSE: Tactic: 7340031 time 0.278944 [TensorRT] VERBOSE: Tactic: 7405567 time 0.282592 [TensorRT] VERBOSE: Tactic: 7536639 time 0.346496 [TensorRT] VERBOSE: Tactic: 7602175 time 0.265376 [TensorRT] VERBOSE: Tactic: 7733247 time 0.26752 [TensorRT] VERBOSE: Tactic: 7798783 time 0.27376 [TensorRT] VERBOSE: Tactic: 8191999 time 0.36096 [TensorRT] VERBOSE: Tactic: 8257535 time 0.275456 [TensorRT] VERBOSE: Tactic: 8323071 time 0.30032 [TensorRT] VERBOSE: Tactic: 8650751 time 0.302208 [TensorRT] VERBOSE: Tactic: 8716287 time 0.356352 [TensorRT] VERBOSE: Tactic: 9109503 time 0.306208 [TensorRT] VERBOSE: Tactic: 9568255 time 0.253632 [TensorRT] VERBOSE: Tactic: 9895935 time 0.248032 [TensorRT] VERBOSE: Tactic: 10223615 time 0.2824 [TensorRT] VERBOSE: Tactic: 10354687 time 0.26112 [TensorRT] VERBOSE: Tactic: 10551295 time 0.297504 [TensorRT] VERBOSE: Tactic: 10747903 time 0.264096 [TensorRT] VERBOSE: Tactic: 10944511 time 0.267872 [TensorRT] VERBOSE: Fastest Tactic: 9895935 Time: 0.248032 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.113664 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.11616 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.115296 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.114688 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.106496 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.105472 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.107616 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.14464 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.118336 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.105472 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.181216 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 1605632, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 6127616, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.181696 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.181216 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.046592 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.057184 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.0448 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.043488 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.054432 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.0464 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.041696 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.042432 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.052672 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.045248 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.047488 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.044544 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.041696 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.088448 [TensorRT] VERBOSE: Tactic: 655359 time 0.079008 [TensorRT] VERBOSE: Tactic: 786431 time 0.074144 [TensorRT] VERBOSE: Tactic: 851967 time 0.086816 [TensorRT] VERBOSE: Tactic: 1179647 time 0.08528 [TensorRT] VERBOSE: Tactic: 1310719 time 0.072064 [TensorRT] VERBOSE: Tactic: 1376255 time 0.081664 [TensorRT] VERBOSE: Tactic: 1441791 time 0.097984 [TensorRT] VERBOSE: Tactic: 1507327 time 0.077088 [TensorRT] VERBOSE: Tactic: 1638399 time 0.088672 [TensorRT] VERBOSE: Tactic: 1835007 time 0.074432 [TensorRT] VERBOSE: Tactic: 1900543 time 0.081216 [TensorRT] VERBOSE: Tactic: 2097151 time 0.086272 [TensorRT] VERBOSE: Tactic: 2162687 time 0.092448 [TensorRT] VERBOSE: Tactic: 2293759 time 0.080896 [TensorRT] VERBOSE: Tactic: 2359295 time 0.101728 [TensorRT] VERBOSE: Tactic: 2686975 time 0.088032 [TensorRT] VERBOSE: Tactic: 3080191 time 0.073728 [TensorRT] VERBOSE: Tactic: 3342335 time 0.074528 [TensorRT] VERBOSE: Tactic: 3407871 time 0.07472 [TensorRT] VERBOSE: Tactic: 3538943 time 0.080544 [TensorRT] VERBOSE: Tactic: 3670015 time 0.086048 [TensorRT] VERBOSE: Tactic: 3932159 time 0.071648 [TensorRT] VERBOSE: Tactic: 3997695 time 0.076128 [TensorRT] VERBOSE: Tactic: 4063231 time 0.082496 [TensorRT] VERBOSE: Tactic: 4194303 time 0.067264 [TensorRT] VERBOSE: Tactic: 4259839 time 0.09488 [TensorRT] VERBOSE: Tactic: 4325375 time 0.113152 [TensorRT] VERBOSE: Tactic: 4521983 time 0.107008 [TensorRT] VERBOSE: Tactic: 4587519 time 0.072224 [TensorRT] VERBOSE: Tactic: 4653055 time 0.09776 [TensorRT] VERBOSE: Tactic: 4915199 time 0.068224 [TensorRT] VERBOSE: Tactic: 4980735 time 0.110592 [TensorRT] VERBOSE: Tactic: 5177343 time 0.08912 [TensorRT] VERBOSE: Tactic: 5242879 time 0.07152 [TensorRT] VERBOSE: Tactic: 5373951 time 0.096192 [TensorRT] VERBOSE: Tactic: 5439487 time 0.092576 [TensorRT] VERBOSE: Tactic: 5570559 time 0.075904 [TensorRT] VERBOSE: Tactic: 5636095 time 0.083936 [TensorRT] VERBOSE: Tactic: 5701631 time 0.083264 [TensorRT] VERBOSE: Tactic: 5767167 time 0.173312 [TensorRT] VERBOSE: Tactic: 5832703 time 0.072 [TensorRT] VERBOSE: Tactic: 5898239 time 0.085312 [TensorRT] VERBOSE: Tactic: 6029311 time 0.077824 [TensorRT] VERBOSE: Tactic: 6225919 time 0.0752 [TensorRT] VERBOSE: Tactic: 6291455 time 0.085472 [TensorRT] VERBOSE: Tactic: 6422527 time 0.068864 [TensorRT] VERBOSE: Tactic: 6750207 time 0.085568 [TensorRT] VERBOSE: Tactic: 6815743 time 0.080608 [TensorRT] VERBOSE: Tactic: 6946815 time 0.088672 [TensorRT] VERBOSE: Tactic: 7012351 time 0.08672 [TensorRT] VERBOSE: Tactic: 7077887 time 0.07248 [TensorRT] VERBOSE: Tactic: 7143423 time 0.09216 [TensorRT] VERBOSE: Tactic: 7208959 time 0.074624 [TensorRT] VERBOSE: Tactic: 7340031 time 0.086944 [TensorRT] VERBOSE: Tactic: 7405567 time 0.074912 [TensorRT] VERBOSE: Tactic: 7536639 time 0.08688 [TensorRT] VERBOSE: Tactic: 7602175 time 0.070496 [TensorRT] VERBOSE: Tactic: 7733247 time 0.072096 [TensorRT] VERBOSE: Tactic: 7798783 time 0.073152 [TensorRT] VERBOSE: Tactic: 8191999 time 0.092352 [TensorRT] VERBOSE: Tactic: 8257535 time 0.06944 [TensorRT] VERBOSE: Tactic: 8323071 time 0.0752 [TensorRT] VERBOSE: Tactic: 8650751 time 0.075776 [TensorRT] VERBOSE: Tactic: 8716287 time 0.088064 [TensorRT] VERBOSE: Tactic: 9109503 time 0.105472 [TensorRT] VERBOSE: Tactic: 9568255 time 0.066912 [TensorRT] VERBOSE: Tactic: 9895935 time 0.068416 [TensorRT] VERBOSE: Tactic: 10223615 time 0.089024 [TensorRT] VERBOSE: Tactic: 10354687 time 0.11424 [TensorRT] VERBOSE: Tactic: 10551295 time 0.078848 [TensorRT] VERBOSE: Tactic: 10747903 time 0.070176 [TensorRT] VERBOSE: Tactic: 10944511 time 0.109568 [TensorRT] VERBOSE: Fastest Tactic: 9568255 Time: 0.066912 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.033856 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.037312 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.03584 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.03504 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.043936 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.036896 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.039936 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.039424 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.03824 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.037888 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.041696 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.0424 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.033856 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3145259992339075399 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.03712 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.044256 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.040128 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.034624 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.038016 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.035104 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.04032 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.041856 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.037408 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.036 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.03504 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.037504 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.034624 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_31 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.056064 [TensorRT] VERBOSE: Tactic: 655359 time 0.045472 [TensorRT] VERBOSE: Tactic: 786431 time 0.06976 [TensorRT] VERBOSE: Tactic: 851967 time 0.077344 [TensorRT] VERBOSE: Tactic: 1179647 time 0.081088 [TensorRT] VERBOSE: Tactic: 1310719 time 0.0568 [TensorRT] VERBOSE: Tactic: 1376255 time 0.063648 [TensorRT] VERBOSE: Tactic: 1441791 time 0.088224 [TensorRT] VERBOSE: Tactic: 1507327 time 0.055616 [TensorRT] VERBOSE: Tactic: 1638399 time 0.08608 [TensorRT] VERBOSE: Tactic: 1835007 time 0.073696 [TensorRT] VERBOSE: Tactic: 1900543 time 0.051648 [TensorRT] VERBOSE: Tactic: 2097151 time 0.105408 [TensorRT] VERBOSE: Tactic: 2162687 time 0.071424 [TensorRT] VERBOSE: Tactic: 2293759 time 0.07072 [TensorRT] VERBOSE: Tactic: 2359295 time 0.067904 [TensorRT] VERBOSE: Tactic: 2686975 time 0.066592 [TensorRT] VERBOSE: Tactic: 3080191 time 0.049696 [TensorRT] VERBOSE: Tactic: 3342335 time 0.056224 [TensorRT] VERBOSE: Tactic: 3407871 time 0.071584 [TensorRT] VERBOSE: Tactic: 3538943 time 0.075584 [TensorRT] VERBOSE: Tactic: 3670015 time 0.052992 [TensorRT] VERBOSE: Tactic: 3932159 time 0.048736 [TensorRT] VERBOSE: Tactic: 3997695 time 0.073152 [TensorRT] VERBOSE: Tactic: 4063231 time 0.072704 [TensorRT] VERBOSE: Tactic: 4194303 time 0.06048 [TensorRT] VERBOSE: Tactic: 4259839 time 0.09264 [TensorRT] VERBOSE: Tactic: 4325375 time 0.113024 [TensorRT] VERBOSE: Tactic: 4521983 time 0.106496 [TensorRT] VERBOSE: Tactic: 4587519 time 0.068992 [TensorRT] VERBOSE: Tactic: 4653055 time 0.09296 [TensorRT] VERBOSE: Tactic: 4915199 time 0.063808 [TensorRT] VERBOSE: Tactic: 4980735 time 0.110592 [TensorRT] VERBOSE: Tactic: 5177343 time 0.081856 [TensorRT] VERBOSE: Tactic: 5242879 time 0.067616 [TensorRT] VERBOSE: Tactic: 5373951 time 0.088352 [TensorRT] VERBOSE: Tactic: 5439487 time 0.089792 [TensorRT] VERBOSE: Tactic: 5570559 time 0.051872 [TensorRT] VERBOSE: Tactic: 5636095 time 0.072576 [TensorRT] VERBOSE: Tactic: 5701631 time 0.064896 [TensorRT] VERBOSE: Tactic: 5767167 time 0.192736 [TensorRT] VERBOSE: Tactic: 5832703 time 0.065408 [TensorRT] VERBOSE: Tactic: 5898239 time 0.079456 [TensorRT] VERBOSE: Tactic: 6029311 time 0.06368 [TensorRT] VERBOSE: Tactic: 6225919 time 0.072864 [TensorRT] VERBOSE: Tactic: 6291455 time 0.081088 [TensorRT] VERBOSE: Tactic: 6422527 time 0.048736 [TensorRT] VERBOSE: Tactic: 6750207 time 0.09008 [TensorRT] VERBOSE: Tactic: 6815743 time 0.07408 [TensorRT] VERBOSE: Tactic: 6946815 time 0.082656 [TensorRT] VERBOSE: Tactic: 7012351 time 0.10512 [TensorRT] VERBOSE: Tactic: 7077887 time 0.068128 [TensorRT] VERBOSE: Tactic: 7143423 time 0.111648 [TensorRT] VERBOSE: Tactic: 7208959 time 0.065504 [TensorRT] VERBOSE: Tactic: 7340031 time 0.079648 [TensorRT] VERBOSE: Tactic: 7405567 time 0.06672 [TensorRT] VERBOSE: Tactic: 7536639 time 0.086016 [TensorRT] VERBOSE: Tactic: 7602175 time 0.067552 [TensorRT] VERBOSE: Tactic: 7733247 time 0.06656 [TensorRT] VERBOSE: Tactic: 7798783 time 0.069728 [TensorRT] VERBOSE: Tactic: 8191999 time 0.098656 [TensorRT] VERBOSE: Tactic: 8257535 time 0.058656 [TensorRT] VERBOSE: Tactic: 8323071 time 0.078848 [TensorRT] VERBOSE: Tactic: 8650751 time 0.067584 [TensorRT] VERBOSE: Tactic: 8716287 time 0.079264 [TensorRT] VERBOSE: Tactic: 9109503 time 0.08176 [TensorRT] VERBOSE: Tactic: 9568255 time 0.064032 [TensorRT] VERBOSE: Tactic: 9895935 time 0.061888 [TensorRT] VERBOSE: Tactic: 10223615 time 0.066688 [TensorRT] VERBOSE: Tactic: 10354687 time 0.112032 [TensorRT] VERBOSE: Tactic: 10551295 time 0.072096 [TensorRT] VERBOSE: Tactic: 10747903 time 0.06496 [TensorRT] VERBOSE: Tactic: 10944511 time 0.110112 [TensorRT] VERBOSE: Fastest Tactic: 655359 Time: 0.045472 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CaskConvolution) [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.023744 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.024672 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.023552 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.02496 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.025568 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.024864 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.026208 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.024 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.02384 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.025632 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.02432 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.02416 [TensorRT] VERBOSE: Fastest Tactic: 5754467717466343388 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_31 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5754467717466343388 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061312 [TensorRT] VERBOSE: Tactic: 256 time 0.0608 [TensorRT] VERBOSE: Tactic: 512 time 0.063488 [TensorRT] VERBOSE: Tactic: -32 time 0.092128 [TensorRT] VERBOSE: Tactic: -64 time 0.076576 [TensorRT] VERBOSE: Tactic: -128 time 0.073984 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.0608 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.036992 [TensorRT] VERBOSE: Tactic: 1 time 0.034912 [TensorRT] VERBOSE: Tactic: 2 time 0.030976 [TensorRT] VERBOSE: Tactic: 3 time 0.034752 [TensorRT] VERBOSE: Tactic: 4 time 0.030816 [TensorRT] VERBOSE: Tactic: 5 time 0.031072 [TensorRT] VERBOSE: Tactic: 6 time 0.03616 [TensorRT] VERBOSE: Tactic: 7 time 0.032096 [TensorRT] VERBOSE: Tactic: 8 time 0.031296 [TensorRT] VERBOSE: Tactic: 9 time 0.031744 [TensorRT] VERBOSE: Tactic: 28 time 0.036736 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.030816 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061664 [TensorRT] VERBOSE: Tactic: 256 time 0.061216 [TensorRT] VERBOSE: Tactic: 512 time 0.061824 [TensorRT] VERBOSE: Tactic: -32 time 0.092288 [TensorRT] VERBOSE: Tactic: -64 time 0.077696 [TensorRT] VERBOSE: Tactic: -128 time 0.073568 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.061216 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_32 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.04848 [TensorRT] VERBOSE: Tactic: 25 time 0.046816 [TensorRT] VERBOSE: Tactic: 26 time 0.048 [TensorRT] VERBOSE: Tactic: 27 time 0.049152 [TensorRT] VERBOSE: Tactic: 31 time 0.047456 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.046816 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] WARNING: No implementation of layer LeakyRelu_32 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.075648 [TensorRT] VERBOSE: Tactic: 0 time 0.17984 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.075648 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.129696 [TensorRT] VERBOSE: Tactic: 0 time 0.090112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.090112 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0344 [TensorRT] VERBOSE: Tactic: 0 time 0.019136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019136 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040448 [TensorRT] VERBOSE: Tactic: 0 time 0.093216 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040448 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051488 [TensorRT] VERBOSE: Tactic: 0 time 0.029696 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029696 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049152 [TensorRT] VERBOSE: Tactic: 0 time 0.062496 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049152 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.068288 [TensorRT] VERBOSE: Tactic: 0 time 0.048064 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.048064 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04096 [TensorRT] VERBOSE: Tactic: 0 time 0.020352 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020352 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050528 [TensorRT] VERBOSE: Tactic: 0 time 0.042944 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042944 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04896 [TensorRT] VERBOSE: Tactic: 0 time 0.08192 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04896 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049536 [TensorRT] VERBOSE: Tactic: 0 time 0.012832 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012832 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04912 [TensorRT] VERBOSE: Tactic: 0 time 0.060032 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04912 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.067552 [TensorRT] VERBOSE: Tactic: 0 time 0.047584 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047584 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05232 [TensorRT] VERBOSE: Tactic: 0 time 0.042048 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042048 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048384 [TensorRT] VERBOSE: Tactic: 0 time 0.07968 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048384 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049984 [TensorRT] VERBOSE: Tactic: 0 time 0.017408 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017408 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.045728 [TensorRT] VERBOSE: Tactic: 0 time 0.008672 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.008672 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049856 [TensorRT] VERBOSE: Tactic: 0 time 0.030944 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.030944 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047104 [TensorRT] VERBOSE: Tactic: 0 time 0.014496 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014496 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.135584 [TensorRT] VERBOSE: Tactic: 655359 time 0.132352 [TensorRT] VERBOSE: Tactic: 786431 time 0.117216 [TensorRT] VERBOSE: Tactic: 851967 time 0.13696 [TensorRT] VERBOSE: Tactic: 1179647 time 0.117216 [TensorRT] VERBOSE: Tactic: 1310719 time 0.165376 [TensorRT] VERBOSE: Tactic: 1376255 time 0.131552 [TensorRT] VERBOSE: Tactic: 1441791 time 0.143904 [TensorRT] VERBOSE: Tactic: 1507327 time 0.122848 [TensorRT] VERBOSE: Tactic: 1638399 time 0.118784 [TensorRT] VERBOSE: Tactic: 1835007 time 0.11968 [TensorRT] VERBOSE: Tactic: 1900543 time 0.143104 [TensorRT] VERBOSE: Tactic: 2097151 time 0.119488 [TensorRT] VERBOSE: Tactic: 2162687 time 0.123904 [TensorRT] VERBOSE: Tactic: 2293759 time 0.134912 [TensorRT] VERBOSE: Tactic: 2359295 time 0.115712 [TensorRT] VERBOSE: Tactic: 2686975 time 0.123392 [TensorRT] VERBOSE: Tactic: 3080191 time 0.126464 [TensorRT] VERBOSE: Tactic: 3342335 time 0.128128 [TensorRT] VERBOSE: Tactic: 3407871 time 0.119808 [TensorRT] VERBOSE: Tactic: 3538943 time 0.114016 [TensorRT] VERBOSE: Tactic: 3670015 time 0.166528 [TensorRT] VERBOSE: Tactic: 3932159 time 0.133664 [TensorRT] VERBOSE: Tactic: 3997695 time 0.1208 [TensorRT] VERBOSE: Tactic: 4063231 time 0.135072 [TensorRT] VERBOSE: Tactic: 4194303 time 0.112704 [TensorRT] VERBOSE: Tactic: 4259839 time 0.115392 [TensorRT] VERBOSE: Tactic: 4325375 time 0.114816 [TensorRT] VERBOSE: Tactic: 4521983 time 0.13312 [TensorRT] VERBOSE: Tactic: 4587519 time 0.113408 [TensorRT] VERBOSE: Tactic: 4653055 time 0.110368 [TensorRT] VERBOSE: Tactic: 4915199 time 0.114688 [TensorRT] VERBOSE: Tactic: 4980735 time 0.122624 [TensorRT] VERBOSE: Tactic: 5177343 time 0.122432 [TensorRT] VERBOSE: Tactic: 5242879 time 0.115392 [TensorRT] VERBOSE: Tactic: 5373951 time 0.134592 [TensorRT] VERBOSE: Tactic: 5439487 time 0.147456 [TensorRT] VERBOSE: Tactic: 5570559 time 0.12528 [TensorRT] VERBOSE: Tactic: 5636095 time 0.135168 [TensorRT] VERBOSE: Tactic: 5701631 time 0.11856 [TensorRT] VERBOSE: Tactic: 5767167 time 0.256416 [TensorRT] VERBOSE: Tactic: 5832703 time 0.115168 [TensorRT] VERBOSE: Tactic: 5898239 time 0.116704 [TensorRT] VERBOSE: Tactic: 6029311 time 0.118336 [TensorRT] VERBOSE: Tactic: 6225919 time 0.11584 [TensorRT] VERBOSE: Tactic: 6291455 time 0.116704 [TensorRT] VERBOSE: Tactic: 6422527 time 0.122528 [TensorRT] VERBOSE: Tactic: 6750207 time 0.123648 [TensorRT] VERBOSE: Tactic: 6815743 time 0.133408 [TensorRT] VERBOSE: Tactic: 6946815 time 0.143968 [TensorRT] VERBOSE: Tactic: 7012351 time 0.120352 [TensorRT] VERBOSE: Tactic: 7077887 time 0.111776 [TensorRT] VERBOSE: Tactic: 7143423 time 0.145824 [TensorRT] VERBOSE: Tactic: 7208959 time 0.121632 [TensorRT] VERBOSE: Tactic: 7340031 time 0.11744 [TensorRT] VERBOSE: Tactic: 7405567 time 0.11728 [TensorRT] VERBOSE: Tactic: 7536639 time 0.133696 [TensorRT] VERBOSE: Tactic: 7602175 time 0.11456 [TensorRT] VERBOSE: Tactic: 7733247 time 0.114016 [TensorRT] VERBOSE: Tactic: 7798783 time 0.115904 [TensorRT] VERBOSE: Tactic: 8191999 time 0.131072 [TensorRT] VERBOSE: Tactic: 8257535 time 0.1176 [TensorRT] VERBOSE: Tactic: 8323071 time 0.12176 [TensorRT] VERBOSE: Tactic: 8650751 time 0.124928 [TensorRT] VERBOSE: Tactic: 8716287 time 0.133632 [TensorRT] VERBOSE: Tactic: 9109503 time 0.123904 [TensorRT] VERBOSE: Tactic: 9568255 time 0.112896 [TensorRT] VERBOSE: Tactic: 9895935 time 0.111968 [TensorRT] VERBOSE: Tactic: 10223615 time 0.122912 [TensorRT] VERBOSE: Tactic: 10354687 time 0.114112 [TensorRT] VERBOSE: Tactic: 10551295 time 0.12672 [TensorRT] VERBOSE: Tactic: 10747903 time 0.115648 [TensorRT] VERBOSE: Tactic: 10944511 time 0.121664 [TensorRT] VERBOSE: Fastest Tactic: 4653055 Time: 0.110368 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.063648 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.064384 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.042944 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.064576 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.039936 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.03968 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.041312 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.049728 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.046144 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.03968 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.072992 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 802816, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 2506752, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.07088 [TensorRT] VERBOSE: Fastest Tactic: 57 Time: 0.07088 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.033664 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.02896 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.021504 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.021056 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.027936 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.0224 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.021504 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.021056 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.027712 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.0336 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.02128 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.03424 [TensorRT] VERBOSE: Fastest Tactic: 2057291331119027912 Time: 0.021056 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2057291331119027912 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.033152 [TensorRT] VERBOSE: Tactic: 655359 time 0.030816 [TensorRT] VERBOSE: Tactic: 786431 time 0.033536 [TensorRT] VERBOSE: Tactic: 851967 time 0.050112 [TensorRT] VERBOSE: Tactic: 1179647 time 0.034944 [TensorRT] VERBOSE: Tactic: 1310719 time 0.035104 [TensorRT] VERBOSE: Tactic: 1376255 time 0.037344 [TensorRT] VERBOSE: Tactic: 1441791 time 0.038016 [TensorRT] VERBOSE: Tactic: 1507327 time 0.03424 [TensorRT] VERBOSE: Tactic: 1638399 time 0.034816 [TensorRT] VERBOSE: Tactic: 1835007 time 0.033664 [TensorRT] VERBOSE: Tactic: 1900543 time 0.0344 [TensorRT] VERBOSE: Tactic: 2162687 time 0.039904 [TensorRT] VERBOSE: Tactic: 2293759 time 0.036128 [TensorRT] VERBOSE: Tactic: 2359295 time 0.039168 [TensorRT] VERBOSE: Tactic: 2686975 time 0.036864 [TensorRT] VERBOSE: Tactic: 3080191 time 0.032096 [TensorRT] VERBOSE: Tactic: 3342335 time 0.0352 [TensorRT] VERBOSE: Tactic: 3407871 time 0.033568 [TensorRT] VERBOSE: Tactic: 3538943 time 0.032192 [TensorRT] VERBOSE: Tactic: 3670015 time 0.039648 [TensorRT] VERBOSE: Tactic: 3932159 time 0.031136 [TensorRT] VERBOSE: Tactic: 3997695 time 0.033376 [TensorRT] VERBOSE: Tactic: 4063231 time 0.047616 [TensorRT] VERBOSE: Tactic: 4194303 time 0.033376 [TensorRT] VERBOSE: Tactic: 4325375 time 0.038784 [TensorRT] VERBOSE: Tactic: 4521983 time 0.040192 [TensorRT] VERBOSE: Tactic: 4587519 time 0.032448 [TensorRT] VERBOSE: Tactic: 4653055 time 0.03824 [TensorRT] VERBOSE: Tactic: 4915199 time 0.031872 [TensorRT] VERBOSE: Tactic: 4980735 time 0.037664 [TensorRT] VERBOSE: Tactic: 5177343 time 0.034976 [TensorRT] VERBOSE: Tactic: 5242879 time 0.032352 [TensorRT] VERBOSE: Tactic: 5373951 time 0.037728 [TensorRT] VERBOSE: Tactic: 5439487 time 0.037024 [TensorRT] VERBOSE: Tactic: 5570559 time 0.03328 [TensorRT] VERBOSE: Tactic: 5636095 time 0.047424 [TensorRT] VERBOSE: Tactic: 5701631 time 0.03584 [TensorRT] VERBOSE: Tactic: 5767167 time 0.05104 [TensorRT] VERBOSE: Tactic: 5832703 time 0.031872 [TensorRT] VERBOSE: Tactic: 5898239 time 0.033888 [TensorRT] VERBOSE: Tactic: 6029311 time 0.033792 [TensorRT] VERBOSE: Tactic: 6225919 time 0.03296 [TensorRT] VERBOSE: Tactic: 6291455 time 0.034112 [TensorRT] VERBOSE: Tactic: 6422527 time 0.03104 [TensorRT] VERBOSE: Tactic: 6750207 time 0.03424 [TensorRT] VERBOSE: Tactic: 6815743 time 0.035168 [TensorRT] VERBOSE: Tactic: 6946815 time 0.036544 [TensorRT] VERBOSE: Tactic: 7077887 time 0.032448 [TensorRT] VERBOSE: Tactic: 7143423 time 0.03664 [TensorRT] VERBOSE: Tactic: 7208959 time 0.033664 [TensorRT] VERBOSE: Tactic: 7340031 time 0.034912 [TensorRT] VERBOSE: Tactic: 7405567 time 0.033536 [TensorRT] VERBOSE: Tactic: 7536639 time 0.035168 [TensorRT] VERBOSE: Tactic: 7602175 time 0.03216 [TensorRT] VERBOSE: Tactic: 7733247 time 0.031744 [TensorRT] VERBOSE: Tactic: 7798783 time 0.03344 [TensorRT] VERBOSE: Tactic: 8191999 time 0.035264 [TensorRT] VERBOSE: Tactic: 8257535 time 0.032096 [TensorRT] VERBOSE: Tactic: 8323071 time 0.032704 [TensorRT] VERBOSE: Tactic: 8650751 time 0.034528 [TensorRT] VERBOSE: Tactic: 8716287 time 0.035872 [TensorRT] VERBOSE: Tactic: 9568255 time 0.032256 [TensorRT] VERBOSE: Tactic: 9895935 time 0.032352 [TensorRT] VERBOSE: Tactic: 10223615 time 0.037888 [TensorRT] VERBOSE: Tactic: 10354687 time 0.041888 [TensorRT] VERBOSE: Tactic: 10551295 time 0.034144 [TensorRT] VERBOSE: Tactic: 10747903 time 0.03232 [TensorRT] VERBOSE: Tactic: 10944511 time 0.038048 [TensorRT] VERBOSE: Fastest Tactic: 655359 Time: 0.030816 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.015584 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.025824 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.015808 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.015232 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.020416 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.025024 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.01616 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.015712 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.024896 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.015936 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.019584 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.019456 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.015232 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4581732244273465060 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.024096 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.020448 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.016672 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.016128 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.015776 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.015936 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.01936 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.019552 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.024064 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.016128 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.016384 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.02464 [TensorRT] VERBOSE: Fastest Tactic: 8047041638267142825 Time: 0.015776 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8047041638267142825 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.020832 [TensorRT] VERBOSE: Tactic: 655359 time 0.027232 [TensorRT] VERBOSE: Tactic: 786431 time 0.025856 [TensorRT] VERBOSE: Tactic: 851967 time 0.048 [TensorRT] VERBOSE: Tactic: 1179647 time 0.030912 [TensorRT] VERBOSE: Tactic: 1310719 time 0.023584 [TensorRT] VERBOSE: Tactic: 1376255 time 0.024736 [TensorRT] VERBOSE: Tactic: 1441791 time 0.034048 [TensorRT] VERBOSE: Tactic: 1507327 time 0.032768 [TensorRT] VERBOSE: Tactic: 1638399 time 0.031968 [TensorRT] VERBOSE: Tactic: 1835007 time 0.026176 [TensorRT] VERBOSE: Tactic: 1900543 time 0.029536 [TensorRT] VERBOSE: Tactic: 2162687 time 0.026784 [TensorRT] VERBOSE: Tactic: 2293759 time 0.025504 [TensorRT] VERBOSE: Tactic: 2359295 time 0.026016 [TensorRT] VERBOSE: Tactic: 2686975 time 0.024992 [TensorRT] VERBOSE: Tactic: 3080191 time 0.0288 [TensorRT] VERBOSE: Tactic: 3342335 time 0.033184 [TensorRT] VERBOSE: Tactic: 3407871 time 0.025024 [TensorRT] VERBOSE: Tactic: 3538943 time 0.026592 [TensorRT] VERBOSE: Tactic: 3670015 time 0.029248 [TensorRT] VERBOSE: Tactic: 3932159 time 0.028832 [TensorRT] VERBOSE: Tactic: 3997695 time 0.027136 [TensorRT] VERBOSE: Tactic: 4063231 time 0.04608 [TensorRT] VERBOSE: Tactic: 4194303 time 0.023776 [TensorRT] VERBOSE: Tactic: 4325375 time 0.036736 [TensorRT] VERBOSE: Tactic: 4521983 time 0.036704 [TensorRT] VERBOSE: Tactic: 4587519 time 0.0256 [TensorRT] VERBOSE: Tactic: 4653055 time 0.035104 [TensorRT] VERBOSE: Tactic: 4915199 time 0.024128 [TensorRT] VERBOSE: Tactic: 4980735 time 0.035744 [TensorRT] VERBOSE: Tactic: 5177343 time 0.0312 [TensorRT] VERBOSE: Tactic: 5242879 time 0.024288 [TensorRT] VERBOSE: Tactic: 5373951 time 0.031872 [TensorRT] VERBOSE: Tactic: 5439487 time 0.029728 [TensorRT] VERBOSE: Tactic: 5570559 time 0.029696 [TensorRT] VERBOSE: Tactic: 5636095 time 0.045824 [TensorRT] VERBOSE: Tactic: 5701631 time 0.024064 [TensorRT] VERBOSE: Tactic: 5767167 time 0.053536 [TensorRT] VERBOSE: Tactic: 5832703 time 0.023168 [TensorRT] VERBOSE: Tactic: 5898239 time 0.0304 [TensorRT] VERBOSE: Tactic: 6029311 time 0.022432 [TensorRT] VERBOSE: Tactic: 6225919 time 0.025824 [TensorRT] VERBOSE: Tactic: 6291455 time 0.03184 [TensorRT] VERBOSE: Tactic: 6422527 time 0.029088 [TensorRT] VERBOSE: Tactic: 6750207 time 0.029696 [TensorRT] VERBOSE: Tactic: 6815743 time 0.024416 [TensorRT] VERBOSE: Tactic: 6946815 time 0.027808 [TensorRT] VERBOSE: Tactic: 7077887 time 0.024576 [TensorRT] VERBOSE: Tactic: 7143423 time 0.03376 [TensorRT] VERBOSE: Tactic: 7208959 time 0.023872 [TensorRT] VERBOSE: Tactic: 7340031 time 0.030144 [TensorRT] VERBOSE: Tactic: 7405567 time 0.026176 [TensorRT] VERBOSE: Tactic: 7536639 time 0.027136 [TensorRT] VERBOSE: Tactic: 7602175 time 0.023712 [TensorRT] VERBOSE: Tactic: 7733247 time 0.022656 [TensorRT] VERBOSE: Tactic: 7798783 time 0.02592 [TensorRT] VERBOSE: Tactic: 8191999 time 0.031936 [TensorRT] VERBOSE: Tactic: 8257535 time 0.022944 [TensorRT] VERBOSE: Tactic: 8323071 time 0.026784 [TensorRT] VERBOSE: Tactic: 8650751 time 0.023616 [TensorRT] VERBOSE: Tactic: 8716287 time 0.026848 [TensorRT] VERBOSE: Tactic: 9568255 time 0.02384 [TensorRT] VERBOSE: Tactic: 9895935 time 0.023872 [TensorRT] VERBOSE: Tactic: 10223615 time 0.025088 [TensorRT] VERBOSE: Tactic: 10354687 time 0.038816 [TensorRT] VERBOSE: Tactic: 10551295 time 0.025728 [TensorRT] VERBOSE: Tactic: 10747903 time 0.02304 [TensorRT] VERBOSE: Tactic: 10944511 time 0.036384 [TensorRT] VERBOSE: Fastest Tactic: 589823 Time: 0.020832 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CaskConvolution) [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.017728 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.01888 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.017408 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.012512 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.019232 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.012832 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.012672 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.012896 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.012928 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.013152 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.018944 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.017408 [TensorRT] VERBOSE: Fastest Tactic: 7039764449991095921 Time: 0.012512 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_46 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7039764449991095921 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_46 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040896 [TensorRT] VERBOSE: Tactic: 0 time 0.091264 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040896 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049632 [TensorRT] VERBOSE: Tactic: 0 time 0.090496 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049632 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.046208 [TensorRT] VERBOSE: Tactic: 0 time 0.09728 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.046208 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033024 [TensorRT] VERBOSE: Tactic: 256 time 0.032768 [TensorRT] VERBOSE: Tactic: 512 time 0.035648 [TensorRT] VERBOSE: Tactic: -32 time 0.049792 [TensorRT] VERBOSE: Tactic: -64 time 0.048032 [TensorRT] VERBOSE: Tactic: -128 time 0.040384 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.032768 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.02 [TensorRT] VERBOSE: Tactic: 1 time 0.02 [TensorRT] VERBOSE: Tactic: 2 time 0.018656 [TensorRT] VERBOSE: Tactic: 3 time 0.020064 [TensorRT] VERBOSE: Tactic: 4 time 0.018336 [TensorRT] VERBOSE: Tactic: 5 time 0.01776 [TensorRT] VERBOSE: Tactic: 6 time 0.022048 [TensorRT] VERBOSE: Tactic: 7 time 0.018432 [TensorRT] VERBOSE: Tactic: 8 time 0.017184 [TensorRT] VERBOSE: Tactic: 9 time 0.0184 [TensorRT] VERBOSE: Tactic: 28 time 0.020512 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.017184 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033024 [TensorRT] VERBOSE: Tactic: 256 time 0.033504 [TensorRT] VERBOSE: Tactic: 512 time 0.035552 [TensorRT] VERBOSE: Tactic: -32 time 0.052544 [TensorRT] VERBOSE: Tactic: -64 time 0.046144 [TensorRT] VERBOSE: Tactic: -128 time 0.042912 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.033024 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.027392 [TensorRT] VERBOSE: Tactic: 25 time 0.027008 [TensorRT] VERBOSE: Tactic: 26 time 0.026624 [TensorRT] VERBOSE: Tactic: 27 time 0.023968 [TensorRT] VERBOSE: Tactic: 31 time 0.026784 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.023968 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.04176 [TensorRT] VERBOSE: Tactic: 256 time 0.036288 [TensorRT] VERBOSE: Tactic: 512 time 0.037888 [TensorRT] VERBOSE: Tactic: -32 time 0.050496 [TensorRT] VERBOSE: Tactic: -64 time 0.047328 [TensorRT] VERBOSE: Tactic: -128 time 0.047776 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036288 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013312 [TensorRT] VERBOSE: Tactic: 1 time 0.011616 [TensorRT] VERBOSE: Tactic: 2 time 0.012704 [TensorRT] VERBOSE: Tactic: 3 time 0.010528 [TensorRT] VERBOSE: Tactic: 4 time 0.01184 [TensorRT] VERBOSE: Tactic: 5 time 0.0128 [TensorRT] VERBOSE: Tactic: 6 time 0.009792 [TensorRT] VERBOSE: Tactic: 7 time 0.011296 [TensorRT] VERBOSE: Tactic: 8 time 0.01424 [TensorRT] VERBOSE: Tactic: 9 time 0.015904 [TensorRT] VERBOSE: Tactic: 10 time 0.021504 [TensorRT] VERBOSE: Tactic: 11 time 0.017152 [TensorRT] VERBOSE: Tactic: 12 time 0.01536 [TensorRT] VERBOSE: Tactic: 13 time 0.013344 [TensorRT] VERBOSE: Tactic: 14 time 0.0144 [TensorRT] VERBOSE: Tactic: 15 time 0.014688 [TensorRT] VERBOSE: Tactic: 16 time 0.013408 [TensorRT] VERBOSE: Tactic: 17 time 0.01264 [TensorRT] VERBOSE: Tactic: 18 time 0.01392 [TensorRT] VERBOSE: Tactic: 19 time 0.016416 [TensorRT] VERBOSE: Tactic: 20 time 0.033056 [TensorRT] VERBOSE: Tactic: 21 time 0.024448 [TensorRT] VERBOSE: Tactic: 22 time 0.017536 [TensorRT] VERBOSE: Tactic: 23 time 0.014848 [TensorRT] VERBOSE: Tactic: 28 time 0.018048 [TensorRT] VERBOSE: Tactic: 29 time 0.023424 [TensorRT] VERBOSE: Tactic: 30 time 0.032544 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.009792 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.042528 [TensorRT] VERBOSE: Tactic: 256 time 0.037088 [TensorRT] VERBOSE: Tactic: 512 time 0.037152 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.037088 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.010336 [TensorRT] VERBOSE: Tactic: 11 time 0.010592 [TensorRT] VERBOSE: Tactic: 12 time 0.012192 [TensorRT] VERBOSE: Tactic: 13 time 0.011264 [TensorRT] VERBOSE: Tactic: 14 time 0.013632 [TensorRT] VERBOSE: Tactic: 15 time 0.015104 [TensorRT] VERBOSE: Tactic: 16 time 0.015168 [TensorRT] VERBOSE: Tactic: 17 time 0.0152 [TensorRT] VERBOSE: Tactic: 18 time 0.020256 [TensorRT] VERBOSE: Tactic: 19 time 0.021792 [TensorRT] VERBOSE: Tactic: 20 time 0.01088 [TensorRT] VERBOSE: Tactic: 21 time 0.012288 [TensorRT] VERBOSE: Tactic: 22 time 0.010368 [TensorRT] VERBOSE: Tactic: 23 time 0.01104 [TensorRT] VERBOSE: Tactic: 24 time 0.013728 [TensorRT] VERBOSE: Tactic: 25 time 0.011808 [TensorRT] VERBOSE: Tactic: 26 time 0.011776 [TensorRT] VERBOSE: Tactic: 27 time 0.011264 [TensorRT] VERBOSE: Tactic: 29 time 0.046784 [TensorRT] VERBOSE: Tactic: 30 time 0.027168 [TensorRT] VERBOSE: Tactic: 31 time 0.018144 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.010336 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.260224 [TensorRT] VERBOSE: Tactic: 720895 time 0.268544 [TensorRT] VERBOSE: Tactic: 983039 time 0.224672 [TensorRT] VERBOSE: Tactic: 1048575 time 0.249376 [TensorRT] VERBOSE: Tactic: 1703935 time 0.230656 [TensorRT] VERBOSE: Tactic: 1769471 time 0.309376 [TensorRT] VERBOSE: Tactic: 1966079 time 0.270592 [TensorRT] VERBOSE: Tactic: 2031615 time 0.298944 [TensorRT] VERBOSE: Tactic: 2228223 time 0.247904 [TensorRT] VERBOSE: Tactic: 2424831 time 0.258272 [TensorRT] VERBOSE: Tactic: 2621439 time 0.264352 [TensorRT] VERBOSE: Tactic: 2752511 time 0.264 [TensorRT] VERBOSE: Tactic: 2818047 time 0.438528 [TensorRT] VERBOSE: Tactic: 2883583 time 0.475456 [TensorRT] VERBOSE: Tactic: 3014655 time 0.22352 [TensorRT] VERBOSE: Tactic: 3145727 time 0.22576 [TensorRT] VERBOSE: Tactic: 3473407 time 0.427616 [TensorRT] VERBOSE: Tactic: 3604479 time 0.220736 [TensorRT] VERBOSE: Tactic: 3735551 time 0.418688 [TensorRT] VERBOSE: Tactic: 4390911 time 0.278624 [TensorRT] VERBOSE: Tactic: 5046271 time 0.219936 [TensorRT] VERBOSE: Tactic: 5963775 time 0.275456 [TensorRT] VERBOSE: Tactic: 6160383 time 0.258432 [TensorRT] VERBOSE: Tactic: 6488063 time 0.235488 [TensorRT] VERBOSE: Tactic: 6881279 time 0.26112 [TensorRT] VERBOSE: Tactic: 7274495 time 0.26192 [TensorRT] VERBOSE: Tactic: 7864319 time 0.247424 [TensorRT] VERBOSE: Tactic: 7995391 time 0.243424 [TensorRT] VERBOSE: Tactic: 8585215 time 0.264512 [TensorRT] VERBOSE: Tactic: 8847359 time 0.33024 [TensorRT] VERBOSE: Tactic: 8978431 time 0.274912 [TensorRT] VERBOSE: Tactic: 9043967 time 0.224128 [TensorRT] VERBOSE: Tactic: 9175039 time 0.22512 [TensorRT] VERBOSE: Tactic: 9502719 time 0.275168 [TensorRT] VERBOSE: Tactic: 9830399 time 0.388928 [TensorRT] VERBOSE: Tactic: 9961471 time 0.299904 [TensorRT] VERBOSE: Tactic: 10027007 time 0.234816 [TensorRT] VERBOSE: Tactic: 10092543 time 0.277024 [TensorRT] VERBOSE: Tactic: 10289151 time 0.28784 [TensorRT] VERBOSE: Tactic: 10485759 time 0.221696 [TensorRT] VERBOSE: Tactic: 10682367 time 0.24656 [TensorRT] VERBOSE: Tactic: 10813439 time 0.222368 [TensorRT] VERBOSE: Fastest Tactic: 5046271 Time: 0.219936 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.448512 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.123008 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.264576 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.447968 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.48128 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.237568 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.238592 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.251968 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.252224 [TensorRT] VERBOSE: Fastest Tactic: 2775507031594384867 Time: 0.123008 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.312032 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 7225344, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 18939904, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 410112, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 1920000, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.312032 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.125184 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.082144 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.074496 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.071104 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.08064 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.077888 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.074336 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.070368 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.124032 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.145408 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.070368 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.06384 [TensorRT] VERBOSE: Tactic: 720895 time 0.072192 [TensorRT] VERBOSE: Tactic: 983039 time 0.059072 [TensorRT] VERBOSE: Tactic: 1048575 time 0.069632 [TensorRT] VERBOSE: Tactic: 1703935 time 0.071168 [TensorRT] VERBOSE: Tactic: 1769471 time 0.091168 [TensorRT] VERBOSE: Tactic: 1966079 time 0.075328 [TensorRT] VERBOSE: Tactic: 2031615 time 0.074496 [TensorRT] VERBOSE: Tactic: 2228223 time 0.10176 [TensorRT] VERBOSE: Tactic: 2424831 time 0.129216 [TensorRT] VERBOSE: Tactic: 2621439 time 0.081184 [TensorRT] VERBOSE: Tactic: 2752511 time 0.074176 [TensorRT] VERBOSE: Tactic: 2818047 time 0.1208 [TensorRT] VERBOSE: Tactic: 2883583 time 0.126656 [TensorRT] VERBOSE: Tactic: 3014655 time 0.07168 [TensorRT] VERBOSE: Tactic: 3145727 time 0.065184 [TensorRT] VERBOSE: Tactic: 3473407 time 0.113984 [TensorRT] VERBOSE: Tactic: 3604479 time 0.05824 [TensorRT] VERBOSE: Tactic: 3735551 time 0.109504 [TensorRT] VERBOSE: Tactic: 4390911 time 0.07424 [TensorRT] VERBOSE: Tactic: 5046271 time 0.066304 [TensorRT] VERBOSE: Tactic: 5963775 time 0.066784 [TensorRT] VERBOSE: Tactic: 6160383 time 0.136224 [TensorRT] VERBOSE: Tactic: 6488063 time 0.068064 [TensorRT] VERBOSE: Tactic: 6881279 time 0.068672 [TensorRT] VERBOSE: Tactic: 7274495 time 0.07184 [TensorRT] VERBOSE: Tactic: 7864319 time 0.079872 [TensorRT] VERBOSE: Tactic: 7995391 time 0.064576 [TensorRT] VERBOSE: Tactic: 8585215 time 0.07056 [TensorRT] VERBOSE: Tactic: 8847359 time 0.076768 [TensorRT] VERBOSE: Tactic: 8978431 time 0.076672 [TensorRT] VERBOSE: Tactic: 9043967 time 0.066464 [TensorRT] VERBOSE: Tactic: 9175039 time 0.058176 [TensorRT] VERBOSE: Tactic: 9502719 time 0.076704 [TensorRT] VERBOSE: Tactic: 9830399 time 0.111904 [TensorRT] VERBOSE: Tactic: 9961471 time 0.110592 [TensorRT] VERBOSE: Tactic: 10027007 time 0.068608 [TensorRT] VERBOSE: Tactic: 10092543 time 0.074944 [TensorRT] VERBOSE: Tactic: 10289151 time 0.075232 [TensorRT] VERBOSE: Tactic: 10485759 time 0.069024 [TensorRT] VERBOSE: Tactic: 10682367 time 0.072224 [TensorRT] VERBOSE: Tactic: 10813439 time 0.05856 [TensorRT] VERBOSE: Fastest Tactic: 9175039 Time: 0.058176 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.067104 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.065504 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.077408 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.120096 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.071968 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.120672 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.069248 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.132928 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.068672 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.067456 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.065504 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9175039 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.074848 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.071328 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.06768 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.067584 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.065536 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.069856 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.118656 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.065536 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.119936 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.131136 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.065536 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.063968 [TensorRT] VERBOSE: Tactic: 720895 time 0.0688 [TensorRT] VERBOSE: Tactic: 983039 time 0.05776 [TensorRT] VERBOSE: Tactic: 1048575 time 0.069888 [TensorRT] VERBOSE: Tactic: 1703935 time 0.069088 [TensorRT] VERBOSE: Tactic: 1769471 time 0.086208 [TensorRT] VERBOSE: Tactic: 1966079 time 0.070368 [TensorRT] VERBOSE: Tactic: 2031615 time 0.075552 [TensorRT] VERBOSE: Tactic: 2228223 time 0.104608 [TensorRT] VERBOSE: Tactic: 2424831 time 0.131072 [TensorRT] VERBOSE: Tactic: 2621439 time 0.077824 [TensorRT] VERBOSE: Tactic: 2752511 time 0.07168 [TensorRT] VERBOSE: Tactic: 2818047 time 0.120448 [TensorRT] VERBOSE: Tactic: 2883583 time 0.122464 [TensorRT] VERBOSE: Tactic: 3014655 time 0.070688 [TensorRT] VERBOSE: Tactic: 3145727 time 0.063808 [TensorRT] VERBOSE: Tactic: 3473407 time 0.114432 [TensorRT] VERBOSE: Tactic: 3604479 time 0.058336 [TensorRT] VERBOSE: Tactic: 3735551 time 0.11072 [TensorRT] VERBOSE: Tactic: 4390911 time 0.064224 [TensorRT] VERBOSE: Tactic: 5046271 time 0.066048 [TensorRT] VERBOSE: Tactic: 5963775 time 0.06656 [TensorRT] VERBOSE: Tactic: 6160383 time 0.13936 [TensorRT] VERBOSE: Tactic: 6488063 time 0.070336 [TensorRT] VERBOSE: Tactic: 6881279 time 0.06752 [TensorRT] VERBOSE: Tactic: 7274495 time 0.070464 [TensorRT] VERBOSE: Tactic: 7864319 time 0.079136 [TensorRT] VERBOSE: Tactic: 7995391 time 0.061408 [TensorRT] VERBOSE: Tactic: 8585215 time 0.072704 [TensorRT] VERBOSE: Tactic: 8847359 time 0.074432 [TensorRT] VERBOSE: Tactic: 8978431 time 0.063392 [TensorRT] VERBOSE: Tactic: 9043967 time 0.066112 [TensorRT] VERBOSE: Tactic: 9175039 time 0.058976 [TensorRT] VERBOSE: Tactic: 9502719 time 0.064192 [TensorRT] VERBOSE: Tactic: 9830399 time 0.106432 [TensorRT] VERBOSE: Tactic: 9961471 time 0.118784 [TensorRT] VERBOSE: Tactic: 10027007 time 0.069152 [TensorRT] VERBOSE: Tactic: 10092543 time 0.06656 [TensorRT] VERBOSE: Tactic: 10289151 time 0.071072 [TensorRT] VERBOSE: Tactic: 10485759 time 0.070144 [TensorRT] VERBOSE: Tactic: 10682367 time 0.072608 [TensorRT] VERBOSE: Tactic: 10813439 time 0.05664 [TensorRT] VERBOSE: Fastest Tactic: 10813439 Time: 0.05664 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CaskConvolution) [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.041824 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.025952 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.04336 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.025472 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.025184 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.042528 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.044064 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.025376 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.026144 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.023968 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.043456 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.0416 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.023968 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_48 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704), Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.04384 [TensorRT] VERBOSE: Tactic: 256 time 0.043424 [TensorRT] VERBOSE: Tactic: 512 time 0.043104 [TensorRT] VERBOSE: Tactic: -32 time 0.064384 [TensorRT] VERBOSE: Tactic: -64 time 0.059232 [TensorRT] VERBOSE: Tactic: -128 time 0.051456 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.043104 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.025664 [TensorRT] VERBOSE: Tactic: 1 time 0.02496 [TensorRT] VERBOSE: Tactic: 2 time 0.024608 [TensorRT] VERBOSE: Tactic: 3 time 0.02768 [TensorRT] VERBOSE: Tactic: 4 time 0.0248 [TensorRT] VERBOSE: Tactic: 5 time 0.025056 [TensorRT] VERBOSE: Tactic: 6 time 0.028288 [TensorRT] VERBOSE: Tactic: 7 time 0.025952 [TensorRT] VERBOSE: Tactic: 8 time 0.024672 [TensorRT] VERBOSE: Tactic: 9 time 0.025472 [TensorRT] VERBOSE: Tactic: 28 time 0.02576 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.024608 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272), Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.043872 [TensorRT] VERBOSE: Tactic: 256 time 0.043328 [TensorRT] VERBOSE: Tactic: 512 time 0.044544 [TensorRT] VERBOSE: Tactic: -32 time 0.065504 [TensorRT] VERBOSE: Tactic: -64 time 0.058144 [TensorRT] VERBOSE: Tactic: -128 time 0.052864 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.043328 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.042528 [TensorRT] VERBOSE: Tactic: 25 time 0.043328 [TensorRT] VERBOSE: Tactic: 26 time 0.043328 [TensorRT] VERBOSE: Tactic: 27 time 0.043872 [TensorRT] VERBOSE: Tactic: 31 time 0.04176 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.04176 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176), Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.052224 [TensorRT] VERBOSE: Tactic: 256 time 0.049824 [TensorRT] VERBOSE: Tactic: 512 time 0.053024 [TensorRT] VERBOSE: Tactic: -32 time 0.078336 [TensorRT] VERBOSE: Tactic: -64 time 0.072064 [TensorRT] VERBOSE: Tactic: -128 time 0.071264 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.049824 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.017408 [TensorRT] VERBOSE: Tactic: 1 time 0.014976 [TensorRT] VERBOSE: Tactic: 2 time 0.016544 [TensorRT] VERBOSE: Tactic: 3 time 0.014752 [TensorRT] VERBOSE: Tactic: 4 time 0.016864 [TensorRT] VERBOSE: Tactic: 5 time 0.01712 [TensorRT] VERBOSE: Tactic: 6 time 0.015584 [TensorRT] VERBOSE: Tactic: 7 time 0.015776 [TensorRT] VERBOSE: Tactic: 8 time 0.02048 [TensorRT] VERBOSE: Tactic: 9 time 0.025408 [TensorRT] VERBOSE: Tactic: 10 time 0.025984 [TensorRT] VERBOSE: Tactic: 11 time 0.021504 [TensorRT] VERBOSE: Tactic: 12 time 0.02064 [TensorRT] VERBOSE: Tactic: 13 time 0.019232 [TensorRT] VERBOSE: Tactic: 14 time 0.021248 [TensorRT] VERBOSE: Tactic: 15 time 0.020928 [TensorRT] VERBOSE: Tactic: 16 time 0.0192 [TensorRT] VERBOSE: Tactic: 17 time 0.022368 [TensorRT] VERBOSE: Tactic: 18 time 0.02384 [TensorRT] VERBOSE: Tactic: 19 time 0.0224 [TensorRT] VERBOSE: Tactic: 20 time 0.038848 [TensorRT] VERBOSE: Tactic: 21 time 0.029632 [TensorRT] VERBOSE: Tactic: 22 time 0.023008 [TensorRT] VERBOSE: Tactic: 23 time 0.02128 [TensorRT] VERBOSE: Tactic: 28 time 0.026624 [TensorRT] VERBOSE: Tactic: 29 time 0.027648 [TensorRT] VERBOSE: Tactic: 30 time 0.038432 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.014752 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272), Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0536 [TensorRT] VERBOSE: Tactic: 256 time 0.0512 [TensorRT] VERBOSE: Tactic: 512 time 0.053088 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.0512 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_49, Add_50) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.017216 [TensorRT] VERBOSE: Tactic: 11 time 0.018464 [TensorRT] VERBOSE: Tactic: 12 time 0.019296 [TensorRT] VERBOSE: Tactic: 13 time 0.020448 [TensorRT] VERBOSE: Tactic: 14 time 0.020832 [TensorRT] VERBOSE: Tactic: 15 time 0.023168 [TensorRT] VERBOSE: Tactic: 16 time 0.028512 [TensorRT] VERBOSE: Tactic: 17 time 0.023552 [TensorRT] VERBOSE: Tactic: 18 time 0.025088 [TensorRT] VERBOSE: Tactic: 19 time 0.035008 [TensorRT] VERBOSE: Tactic: 20 time 0.01536 [TensorRT] VERBOSE: Tactic: 21 time 0.01664 [TensorRT] VERBOSE: Tactic: 22 time 0.015936 [TensorRT] VERBOSE: Tactic: 23 time 0.020928 [TensorRT] VERBOSE: Tactic: 24 time 0.017952 [TensorRT] VERBOSE: Tactic: 25 time 0.017728 [TensorRT] VERBOSE: Tactic: 26 time 0.016192 [TensorRT] VERBOSE: Tactic: 27 time 0.020352 [TensorRT] VERBOSE: Tactic: 29 time 0.07296 [TensorRT] VERBOSE: Tactic: 30 time 0.039776 [TensorRT] VERBOSE: Tactic: 31 time 0.026784 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.01536 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.041824 [TensorRT] VERBOSE: Tactic: 0 time 0.094304 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.041824 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05136 [TensorRT] VERBOSE: Tactic: 0 time 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048832 [TensorRT] VERBOSE: Tactic: 0 time 0.060704 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048832 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.068416 [TensorRT] VERBOSE: Tactic: 0 time 0.0472 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0472 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.052768 [TensorRT] VERBOSE: Tactic: 0 time 0.04368 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04368 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050432 [TensorRT] VERBOSE: Tactic: 0 time 0.079808 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.050432 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050496 [TensorRT] VERBOSE: Tactic: 0 time 0.017696 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017696 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049152 [TensorRT] VERBOSE: Tactic: 0 time 0.090112 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049152 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04592 [TensorRT] VERBOSE: Tactic: 0 time 0.008128 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.008128 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049024 [TensorRT] VERBOSE: Tactic: 0 time 0.03072 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.03072 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.046304 [TensorRT] VERBOSE: Tactic: 0 time 0.096448 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.046304 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.046592 [TensorRT] VERBOSE: Tactic: 0 time 0.013824 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013824 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_51 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033984 [TensorRT] VERBOSE: Tactic: 256 time 0.033792 [TensorRT] VERBOSE: Tactic: 512 time 0.03488 [TensorRT] VERBOSE: Tactic: -32 time 0.050496 [TensorRT] VERBOSE: Tactic: -64 time 0.047296 [TensorRT] VERBOSE: Tactic: -128 time 0.041248 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.033792 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.021536 [TensorRT] VERBOSE: Tactic: 1 time 0.02048 [TensorRT] VERBOSE: Tactic: 2 time 0.018432 [TensorRT] VERBOSE: Tactic: 3 time 0.020256 [TensorRT] VERBOSE: Tactic: 4 time 0.018176 [TensorRT] VERBOSE: Tactic: 5 time 0.0184 [TensorRT] VERBOSE: Tactic: 6 time 0.021504 [TensorRT] VERBOSE: Tactic: 7 time 0.0184 [TensorRT] VERBOSE: Tactic: 8 time 0.018272 [TensorRT] VERBOSE: Tactic: 9 time 0.018144 [TensorRT] VERBOSE: Tactic: 28 time 0.020288 [TensorRT] VERBOSE: Fastest Tactic: 9 Time: 0.018144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.03344 [TensorRT] VERBOSE: Tactic: 256 time 0.033632 [TensorRT] VERBOSE: Tactic: 512 time 0.0336 [TensorRT] VERBOSE: Tactic: -32 time 0.052192 [TensorRT] VERBOSE: Tactic: -64 time 0.048128 [TensorRT] VERBOSE: Tactic: -128 time 0.041312 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.03344 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.026624 [TensorRT] VERBOSE: Tactic: 25 time 0.026976 [TensorRT] VERBOSE: Tactic: 26 time 0.0256 [TensorRT] VERBOSE: Tactic: 27 time 0.024192 [TensorRT] VERBOSE: Tactic: 31 time 0.02672 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.024192 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.041696 [TensorRT] VERBOSE: Tactic: 256 time 0.036864 [TensorRT] VERBOSE: Tactic: 512 time 0.037248 [TensorRT] VERBOSE: Tactic: -32 time 0.048704 [TensorRT] VERBOSE: Tactic: -64 time 0.047168 [TensorRT] VERBOSE: Tactic: -128 time 0.047968 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036864 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013472 [TensorRT] VERBOSE: Tactic: 1 time 0.011968 [TensorRT] VERBOSE: Tactic: 2 time 0.012128 [TensorRT] VERBOSE: Tactic: 3 time 0.01056 [TensorRT] VERBOSE: Tactic: 4 time 0.012096 [TensorRT] VERBOSE: Tactic: 5 time 0.01264 [TensorRT] VERBOSE: Tactic: 6 time 0.009664 [TensorRT] VERBOSE: Tactic: 7 time 0.011296 [TensorRT] VERBOSE: Tactic: 8 time 0.013984 [TensorRT] VERBOSE: Tactic: 9 time 0.014336 [TensorRT] VERBOSE: Tactic: 10 time 0.021376 [TensorRT] VERBOSE: Tactic: 11 time 0.016768 [TensorRT] VERBOSE: Tactic: 12 time 0.015904 [TensorRT] VERBOSE: Tactic: 13 time 0.013952 [TensorRT] VERBOSE: Tactic: 14 time 0.01488 [TensorRT] VERBOSE: Tactic: 15 time 0.014624 [TensorRT] VERBOSE: Tactic: 16 time 0.013792 [TensorRT] VERBOSE: Tactic: 17 time 0.012832 [TensorRT] VERBOSE: Tactic: 18 time 0.01536 [TensorRT] VERBOSE: Tactic: 19 time 0.01616 [TensorRT] VERBOSE: Tactic: 20 time 0.033216 [TensorRT] VERBOSE: Tactic: 21 time 0.023904 [TensorRT] VERBOSE: Tactic: 22 time 0.018176 [TensorRT] VERBOSE: Tactic: 23 time 0.014496 [TensorRT] VERBOSE: Tactic: 28 time 0.017632 [TensorRT] VERBOSE: Tactic: 29 time 0.022144 [TensorRT] VERBOSE: Tactic: 30 time 0.03232 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.009664 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.041504 [TensorRT] VERBOSE: Tactic: 256 time 0.036256 [TensorRT] VERBOSE: Tactic: 512 time 0.0376 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036256 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_52 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.01056 [TensorRT] VERBOSE: Tactic: 11 time 0.011392 [TensorRT] VERBOSE: Tactic: 12 time 0.01232 [TensorRT] VERBOSE: Tactic: 13 time 0.011424 [TensorRT] VERBOSE: Tactic: 14 time 0.01376 [TensorRT] VERBOSE: Tactic: 15 time 0.015328 [TensorRT] VERBOSE: Tactic: 16 time 0.014592 [TensorRT] VERBOSE: Tactic: 17 time 0.016224 [TensorRT] VERBOSE: Tactic: 18 time 0.02 [TensorRT] VERBOSE: Tactic: 19 time 0.021632 [TensorRT] VERBOSE: Tactic: 20 time 0.01184 [TensorRT] VERBOSE: Tactic: 21 time 0.011296 [TensorRT] VERBOSE: Tactic: 22 time 0.010688 [TensorRT] VERBOSE: Tactic: 23 time 0.011264 [TensorRT] VERBOSE: Tactic: 24 time 0.0144 [TensorRT] VERBOSE: Tactic: 25 time 0.013152 [TensorRT] VERBOSE: Tactic: 26 time 0.011264 [TensorRT] VERBOSE: Tactic: 27 time 0.011264 [TensorRT] VERBOSE: Tactic: 29 time 0.047104 [TensorRT] VERBOSE: Tactic: 30 time 0.027392 [TensorRT] VERBOSE: Tactic: 31 time 0.019744 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.01056 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_53 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_53 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_53 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_53 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_53 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704), Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.043712 [TensorRT] VERBOSE: Tactic: 256 time 0.042528 [TensorRT] VERBOSE: Tactic: 512 time 0.0448 [TensorRT] VERBOSE: Tactic: -32 time 0.064896 [TensorRT] VERBOSE: Tactic: -64 time 0.058176 [TensorRT] VERBOSE: Tactic: -128 time 0.051072 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.042528 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.025088 [TensorRT] VERBOSE: Tactic: 1 time 0.024448 [TensorRT] VERBOSE: Tactic: 2 time 0.024544 [TensorRT] VERBOSE: Tactic: 3 time 0.02544 [TensorRT] VERBOSE: Tactic: 4 time 0.025472 [TensorRT] VERBOSE: Tactic: 5 time 0.025184 [TensorRT] VERBOSE: Tactic: 6 time 0.028448 [TensorRT] VERBOSE: Tactic: 7 time 0.025984 [TensorRT] VERBOSE: Tactic: 8 time 0.024576 [TensorRT] VERBOSE: Tactic: 9 time 0.026464 [TensorRT] VERBOSE: Tactic: 28 time 0.024832 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.024448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272), Float(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.043232 [TensorRT] VERBOSE: Tactic: 256 time 0.042784 [TensorRT] VERBOSE: Tactic: 512 time 0.044256 [TensorRT] VERBOSE: Tactic: -32 time 0.064832 [TensorRT] VERBOSE: Tactic: -64 time 0.058336 [TensorRT] VERBOSE: Tactic: -128 time 0.05296 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.042784 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.040512 [TensorRT] VERBOSE: Tactic: 25 time 0.044032 [TensorRT] VERBOSE: Tactic: 26 time 0.042272 [TensorRT] VERBOSE: Tactic: 27 time 0.041984 [TensorRT] VERBOSE: Tactic: 31 time 0.0408 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.040512 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176), Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.053248 [TensorRT] VERBOSE: Tactic: 256 time 0.05056 [TensorRT] VERBOSE: Tactic: 512 time 0.053152 [TensorRT] VERBOSE: Tactic: -32 time 0.077792 [TensorRT] VERBOSE: Tactic: -64 time 0.08368 [TensorRT] VERBOSE: Tactic: -128 time 0.072704 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.05056 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.017408 [TensorRT] VERBOSE: Tactic: 1 time 0.014688 [TensorRT] VERBOSE: Tactic: 2 time 0.016864 [TensorRT] VERBOSE: Tactic: 3 time 0.0152 [TensorRT] VERBOSE: Tactic: 4 time 0.018464 [TensorRT] VERBOSE: Tactic: 5 time 0.017376 [TensorRT] VERBOSE: Tactic: 6 time 0.016928 [TensorRT] VERBOSE: Tactic: 7 time 0.017408 [TensorRT] VERBOSE: Tactic: 8 time 0.019584 [TensorRT] VERBOSE: Tactic: 9 time 0.0264 [TensorRT] VERBOSE: Tactic: 10 time 0.025408 [TensorRT] VERBOSE: Tactic: 11 time 0.020864 [TensorRT] VERBOSE: Tactic: 12 time 0.019872 [TensorRT] VERBOSE: Tactic: 13 time 0.019296 [TensorRT] VERBOSE: Tactic: 14 time 0.020352 [TensorRT] VERBOSE: Tactic: 15 time 0.021248 [TensorRT] VERBOSE: Tactic: 16 time 0.019456 [TensorRT] VERBOSE: Tactic: 17 time 0.022528 [TensorRT] VERBOSE: Tactic: 18 time 0.02448 [TensorRT] VERBOSE: Tactic: 19 time 0.023328 [TensorRT] VERBOSE: Tactic: 20 time 0.038656 [TensorRT] VERBOSE: Tactic: 21 time 0.029984 [TensorRT] VERBOSE: Tactic: 22 time 0.02288 [TensorRT] VERBOSE: Tactic: 23 time 0.023008 [TensorRT] VERBOSE: Tactic: 28 time 0.026624 [TensorRT] VERBOSE: Tactic: 29 time 0.02736 [TensorRT] VERBOSE: Tactic: 30 time 0.038304 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.014688 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272), Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.052384 [TensorRT] VERBOSE: Tactic: 256 time 0.050016 [TensorRT] VERBOSE: Tactic: 512 time 0.053056 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.050016 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_54, Add_55) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.016192 [TensorRT] VERBOSE: Tactic: 11 time 0.018496 [TensorRT] VERBOSE: Tactic: 12 time 0.019616 [TensorRT] VERBOSE: Tactic: 13 time 0.019392 [TensorRT] VERBOSE: Tactic: 14 time 0.019776 [TensorRT] VERBOSE: Tactic: 15 time 0.024416 [TensorRT] VERBOSE: Tactic: 16 time 0.027904 [TensorRT] VERBOSE: Tactic: 17 time 0.024 [TensorRT] VERBOSE: Tactic: 18 time 0.025568 [TensorRT] VERBOSE: Tactic: 19 time 0.033984 [TensorRT] VERBOSE: Tactic: 20 time 0.015392 [TensorRT] VERBOSE: Tactic: 21 time 0.016384 [TensorRT] VERBOSE: Tactic: 22 time 0.015936 [TensorRT] VERBOSE: Tactic: 23 time 0.020416 [TensorRT] VERBOSE: Tactic: 24 time 0.017792 [TensorRT] VERBOSE: Tactic: 25 time 0.017888 [TensorRT] VERBOSE: Tactic: 26 time 0.016384 [TensorRT] VERBOSE: Tactic: 27 time 0.021408 [TensorRT] VERBOSE: Tactic: 29 time 0.073248 [TensorRT] VERBOSE: Tactic: 30 time 0.039616 [TensorRT] VERBOSE: Tactic: 31 time 0.027008 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.015392 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Float(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_56 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.033632 [TensorRT] VERBOSE: Tactic: 0 time 0.019744 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019744 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040448 [TensorRT] VERBOSE: Tactic: 0 time 0.092768 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040448 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050208 [TensorRT] VERBOSE: Tactic: 0 time 0.030592 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.030592 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049504 [TensorRT] VERBOSE: Tactic: 0 time 0.063008 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049504 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.06848 [TensorRT] VERBOSE: Tactic: 0 time 0.047136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047136 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04144 [TensorRT] VERBOSE: Tactic: 0 time 0.018944 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.018944 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.052416 [TensorRT] VERBOSE: Tactic: 0 time 0.042848 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042848 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049152 [TensorRT] VERBOSE: Tactic: 0 time 0.083168 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.049152 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.038496 [TensorRT] VERBOSE: Tactic: 256 time 0.038208 [TensorRT] VERBOSE: Tactic: 512 time 0.038528 [TensorRT] VERBOSE: Tactic: -32 time 0.050048 [TensorRT] VERBOSE: Tactic: -64 time 0.047104 [TensorRT] VERBOSE: Tactic: -128 time 0.041248 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.038208 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.022912 [TensorRT] VERBOSE: Tactic: 1 time 0.020224 [TensorRT] VERBOSE: Tactic: 2 time 0.018432 [TensorRT] VERBOSE: Tactic: 3 time 0.021248 [TensorRT] VERBOSE: Tactic: 4 time 0.018976 [TensorRT] VERBOSE: Tactic: 5 time 0.017824 [TensorRT] VERBOSE: Tactic: 6 time 0.021248 [TensorRT] VERBOSE: Tactic: 7 time 0.018496 [TensorRT] VERBOSE: Tactic: 8 time 0.019296 [TensorRT] VERBOSE: Tactic: 9 time 0.01808 [TensorRT] VERBOSE: Tactic: 28 time 0.021504 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.017824 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,6272) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.038912 [TensorRT] VERBOSE: Tactic: 256 time 0.038272 [TensorRT] VERBOSE: Tactic: 512 time 0.038912 [TensorRT] VERBOSE: Tactic: -32 time 0.049856 [TensorRT] VERBOSE: Tactic: -64 time 0.048128 [TensorRT] VERBOSE: Tactic: -128 time 0.041952 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.038272 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.0272 [TensorRT] VERBOSE: Tactic: 25 time 0.025632 [TensorRT] VERBOSE: Tactic: 26 time 0.027904 [TensorRT] VERBOSE: Tactic: 27 time 0.024576 [TensorRT] VERBOSE: Tactic: 31 time 0.02688 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.024576 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,50176) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.041856 [TensorRT] VERBOSE: Tactic: 256 time 0.036224 [TensorRT] VERBOSE: Tactic: 512 time 0.036928 [TensorRT] VERBOSE: Tactic: -32 time 0.048736 [TensorRT] VERBOSE: Tactic: -64 time 0.047072 [TensorRT] VERBOSE: Tactic: -128 time 0.047456 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036224 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013632 [TensorRT] VERBOSE: Tactic: 1 time 0.011616 [TensorRT] VERBOSE: Tactic: 2 time 0.013152 [TensorRT] VERBOSE: Tactic: 3 time 0.01024 [TensorRT] VERBOSE: Tactic: 4 time 0.011072 [TensorRT] VERBOSE: Tactic: 5 time 0.012544 [TensorRT] VERBOSE: Tactic: 6 time 0.00992 [TensorRT] VERBOSE: Tactic: 7 time 0.011616 [TensorRT] VERBOSE: Tactic: 8 time 0.013888 [TensorRT] VERBOSE: Tactic: 9 time 0.014912 [TensorRT] VERBOSE: Tactic: 10 time 0.021536 [TensorRT] VERBOSE: Tactic: 11 time 0.016992 [TensorRT] VERBOSE: Tactic: 12 time 0.015904 [TensorRT] VERBOSE: Tactic: 13 time 0.01408 [TensorRT] VERBOSE: Tactic: 14 time 0.014496 [TensorRT] VERBOSE: Tactic: 15 time 0.014336 [TensorRT] VERBOSE: Tactic: 16 time 0.013024 [TensorRT] VERBOSE: Tactic: 17 time 0.01328 [TensorRT] VERBOSE: Tactic: 18 time 0.014112 [TensorRT] VERBOSE: Tactic: 19 time 0.016896 [TensorRT] VERBOSE: Tactic: 20 time 0.033696 [TensorRT] VERBOSE: Tactic: 21 time 0.024096 [TensorRT] VERBOSE: Tactic: 22 time 0.018112 [TensorRT] VERBOSE: Tactic: 23 time 0.015168 [TensorRT] VERBOSE: Tactic: 28 time 0.018176 [TensorRT] VERBOSE: Tactic: 29 time 0.022368 [TensorRT] VERBOSE: Tactic: 30 time 0.032 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.00992 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,6272) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.042304 [TensorRT] VERBOSE: Tactic: 256 time 0.036928 [TensorRT] VERBOSE: Tactic: 512 time 0.036864 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.036864 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_57 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.010688 [TensorRT] VERBOSE: Tactic: 11 time 0.011584 [TensorRT] VERBOSE: Tactic: 12 time 0.012736 [TensorRT] VERBOSE: Tactic: 13 time 0.011328 [TensorRT] VERBOSE: Tactic: 14 time 0.01312 [TensorRT] VERBOSE: Tactic: 15 time 0.015008 [TensorRT] VERBOSE: Tactic: 16 time 0.015936 [TensorRT] VERBOSE: Tactic: 17 time 0.014272 [TensorRT] VERBOSE: Tactic: 18 time 0.019584 [TensorRT] VERBOSE: Tactic: 19 time 0.022272 [TensorRT] VERBOSE: Tactic: 20 time 0.01184 [TensorRT] VERBOSE: Tactic: 21 time 0.012288 [TensorRT] VERBOSE: Tactic: 22 time 0.01024 [TensorRT] VERBOSE: Tactic: 23 time 0.01136 [TensorRT] VERBOSE: Tactic: 24 time 0.014464 [TensorRT] VERBOSE: Tactic: 25 time 0.012288 [TensorRT] VERBOSE: Tactic: 26 time 0.010816 [TensorRT] VERBOSE: Tactic: 27 time 0.011232 [TensorRT] VERBOSE: Tactic: 29 time 0.046592 [TensorRT] VERBOSE: Tactic: 30 time 0.027648 [TensorRT] VERBOSE: Tactic: 31 time 0.019328 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.01024 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040256 [TensorRT] VERBOSE: Tactic: 0 time 0.093856 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040256 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049824 [TensorRT] VERBOSE: Tactic: 0 time 0.013888 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013888 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048064 [TensorRT] VERBOSE: Tactic: 0 time 0.060576 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048064 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.065088 [TensorRT] VERBOSE: Tactic: 0 time 0.04784 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04784 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051776 [TensorRT] VERBOSE: Tactic: 0 time 0.043744 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.043744 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050112 [TensorRT] VERBOSE: Tactic: 0 time 0.07936 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.050112 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.049472 [TensorRT] VERBOSE: Tactic: 0 time 0.028448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050176 [TensorRT] VERBOSE: Tactic: 0 time 0.090208 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.050176 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04608 [TensorRT] VERBOSE: Tactic: 0 time 0.008096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.008096 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051136 [TensorRT] VERBOSE: Tactic: 0 time 0.03056 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.03056 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.046496 [TensorRT] VERBOSE: Tactic: 0 time 0.097856 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.046496 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04656 [TensorRT] VERBOSE: Tactic: 0 time 0.013312 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013312 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_59 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,56,3136,401408) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.06064 [TensorRT] VERBOSE: Tactic: 256 time 0.06144 [TensorRT] VERBOSE: Tactic: 512 time 0.06288 [TensorRT] VERBOSE: Tactic: -32 time 0.093696 [TensorRT] VERBOSE: Tactic: -64 time 0.076896 [TensorRT] VERBOSE: Tactic: -128 time 0.072992 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.06064 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.037728 [TensorRT] VERBOSE: Tactic: 1 time 0.035648 [TensorRT] VERBOSE: Tactic: 2 time 0.030816 [TensorRT] VERBOSE: Tactic: 3 time 0.036352 [TensorRT] VERBOSE: Tactic: 4 time 0.032192 [TensorRT] VERBOSE: Tactic: 5 time 0.032064 [TensorRT] VERBOSE: Tactic: 6 time 0.037888 [TensorRT] VERBOSE: Tactic: 7 time 0.031808 [TensorRT] VERBOSE: Tactic: 8 time 0.031456 [TensorRT] VERBOSE: Tactic: 9 time 0.033632 [TensorRT] VERBOSE: Tactic: 28 time 0.036128 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.030816 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136:32,12544) -> Float(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.061408 [TensorRT] VERBOSE: Tactic: 256 time 0.061312 [TensorRT] VERBOSE: Tactic: 512 time 0.061632 [TensorRT] VERBOSE: Tactic: -32 time 0.094688 [TensorRT] VERBOSE: Tactic: -64 time 0.077824 [TensorRT] VERBOSE: Tactic: -128 time 0.072896 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.061312 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.048 [TensorRT] VERBOSE: Tactic: 25 time 0.049024 [TensorRT] VERBOSE: Tactic: 26 time 0.049152 [TensorRT] VERBOSE: Tactic: 27 time 0.04928 [TensorRT] VERBOSE: Tactic: 31 time 0.048128 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,56,3136:4,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.079712 [TensorRT] VERBOSE: Tactic: 256 time 0.068736 [TensorRT] VERBOSE: Tactic: 512 time 0.070784 [TensorRT] VERBOSE: Tactic: -32 time 0.087648 [TensorRT] VERBOSE: Tactic: -64 time 0.09968 [TensorRT] VERBOSE: Tactic: -128 time 0.09856 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.068736 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.023296 [TensorRT] VERBOSE: Tactic: 1 time 0.019488 [TensorRT] VERBOSE: Tactic: 2 time 0.018432 [TensorRT] VERBOSE: Tactic: 3 time 0.018016 [TensorRT] VERBOSE: Tactic: 4 time 0.01952 [TensorRT] VERBOSE: Tactic: 5 time 0.019232 [TensorRT] VERBOSE: Tactic: 6 time 0.017376 [TensorRT] VERBOSE: Tactic: 7 time 0.017952 [TensorRT] VERBOSE: Tactic: 8 time 0.02304 [TensorRT] VERBOSE: Tactic: 9 time 0.024544 [TensorRT] VERBOSE: Tactic: 10 time 0.038336 [TensorRT] VERBOSE: Tactic: 11 time 0.02912 [TensorRT] VERBOSE: Tactic: 12 time 0.027168 [TensorRT] VERBOSE: Tactic: 13 time 0.025824 [TensorRT] VERBOSE: Tactic: 14 time 0.024512 [TensorRT] VERBOSE: Tactic: 15 time 0.024288 [TensorRT] VERBOSE: Tactic: 16 time 0.024896 [TensorRT] VERBOSE: Tactic: 17 time 0.02416 [TensorRT] VERBOSE: Tactic: 18 time 0.024576 [TensorRT] VERBOSE: Tactic: 19 time 0.0256 [TensorRT] VERBOSE: Tactic: 20 time 0.064256 [TensorRT] VERBOSE: Tactic: 21 time 0.04528 [TensorRT] VERBOSE: Tactic: 22 time 0.034592 [TensorRT] VERBOSE: Tactic: 23 time 0.032064 [TensorRT] VERBOSE: Tactic: 28 time 0.032032 [TensorRT] VERBOSE: Tactic: 29 time 0.040864 [TensorRT] VERBOSE: Tactic: 30 time 0.062816 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.017376 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Int8(1,56,3136:32,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.080224 [TensorRT] VERBOSE: Tactic: 256 time 0.069632 [TensorRT] VERBOSE: Tactic: 512 time 0.071296 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.069632 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_60 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.017056 [TensorRT] VERBOSE: Tactic: 11 time 0.019456 [TensorRT] VERBOSE: Tactic: 12 time 0.01824 [TensorRT] VERBOSE: Tactic: 13 time 0.01888 [TensorRT] VERBOSE: Tactic: 14 time 0.019712 [TensorRT] VERBOSE: Tactic: 15 time 0.027616 [TensorRT] VERBOSE: Tactic: 16 time 0.022144 [TensorRT] VERBOSE: Tactic: 17 time 0.022368 [TensorRT] VERBOSE: Tactic: 18 time 0.027008 [TensorRT] VERBOSE: Tactic: 19 time 0.03936 [TensorRT] VERBOSE: Tactic: 20 time 0.018176 [TensorRT] VERBOSE: Tactic: 21 time 0.017984 [TensorRT] VERBOSE: Tactic: 22 time 0.018272 [TensorRT] VERBOSE: Tactic: 23 time 0.017792 [TensorRT] VERBOSE: Tactic: 24 time 0.02448 [TensorRT] VERBOSE: Tactic: 25 time 0.020928 [TensorRT] VERBOSE: Tactic: 26 time 0.017888 [TensorRT] VERBOSE: Tactic: 27 time 0.017408 [TensorRT] VERBOSE: Tactic: 29 time 0.08624 [TensorRT] VERBOSE: Tactic: 30 time 0.0496 [TensorRT] VERBOSE: Tactic: 31 time 0.033568 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.017056 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,56,3136,401408) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.570816 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.570816 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.448032 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.516512 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.445088 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.472704 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.461216 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.467808 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.514208 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.516992 [TensorRT] VERBOSE: Fastest Tactic: 3915320020053085238 Time: 0.445088 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.632736 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 3612672, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 145948672, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 1184768, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.632736 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.122016 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.154944 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.144192 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.128192 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.146624 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.147584 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.137216 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.125984 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.12288 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.134848 [TensorRT] VERBOSE: Fastest Tactic: 892787096507693407 Time: 0.122016 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 892787096507693407 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.163104 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.163104 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.123936 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.124032 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.14944 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.119168 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.146016 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.11888 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.14096 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.12704 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.143712 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.13312 [TensorRT] VERBOSE: Fastest Tactic: -7210942453088153035 Time: 0.11888 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7210942453088153035 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:4,100352) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.148864 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.144224 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.131488 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.134976 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.123264 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.13872 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.118656 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.124064 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.120608 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.12912 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.118656 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_61 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,56,3136:32,12544) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.13856 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.13856 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CaskConvolution) [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.042816 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.045184 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.042944 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.042528 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.04304 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.043904 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.044288 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.043232 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.0448 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.041088 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.041152 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.039808 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.039808 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_61 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040832 [TensorRT] VERBOSE: Tactic: 0 time 0.089856 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040832 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051616 [TensorRT] VERBOSE: Tactic: 0 time 0.01296 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01296 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048128 [TensorRT] VERBOSE: Tactic: 0 time 0.060992 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048128 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.073728 [TensorRT] VERBOSE: Tactic: 0 time 0.044 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.044 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05152 [TensorRT] VERBOSE: Tactic: 0 time 0.038208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.038208 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050944 [TensorRT] VERBOSE: Tactic: 0 time 0.074176 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.050944 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050464 [TensorRT] VERBOSE: Tactic: 0 time 0.020224 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.020224 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050176 [TensorRT] VERBOSE: Tactic: 0 time 0.089472 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.050176 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04608 [TensorRT] VERBOSE: Tactic: 0 time 0.011232 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011232 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04976 [TensorRT] VERBOSE: Tactic: 0 time 0.029984 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029984 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047232 [TensorRT] VERBOSE: Tactic: 0 time 0.090656 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.047232 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.047488 [TensorRT] VERBOSE: Tactic: 0 time 0.027488 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.027488 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.033856 [TensorRT] VERBOSE: Tactic: 256 time 0.033088 [TensorRT] VERBOSE: Tactic: 512 time 0.034208 [TensorRT] VERBOSE: Tactic: -32 time 0.050656 [TensorRT] VERBOSE: Tactic: -64 time 0.04784 [TensorRT] VERBOSE: Tactic: -128 time 0.04144 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.033088 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.020704 [TensorRT] VERBOSE: Tactic: 1 time 0.019712 [TensorRT] VERBOSE: Tactic: 2 time 0.018272 [TensorRT] VERBOSE: Tactic: 3 time 0.0208 [TensorRT] VERBOSE: Tactic: 4 time 0.019712 [TensorRT] VERBOSE: Tactic: 5 time 0.018816 [TensorRT] VERBOSE: Tactic: 6 time 0.020256 [TensorRT] VERBOSE: Tactic: 7 time 0.01936 [TensorRT] VERBOSE: Tactic: 8 time 0.018432 [TensorRT] VERBOSE: Tactic: 9 time 0.018464 [TensorRT] VERBOSE: Tactic: 28 time 0.02016 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.018272 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032608 [TensorRT] VERBOSE: Tactic: 256 time 0.033184 [TensorRT] VERBOSE: Tactic: 512 time 0.034048 [TensorRT] VERBOSE: Tactic: -32 time 0.049952 [TensorRT] VERBOSE: Tactic: -64 time 0.050464 [TensorRT] VERBOSE: Tactic: -128 time 0.04144 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.032608 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.026912 [TensorRT] VERBOSE: Tactic: 25 time 0.026624 [TensorRT] VERBOSE: Tactic: 26 time 0.027008 [TensorRT] VERBOSE: Tactic: 27 time 0.024512 [TensorRT] VERBOSE: Tactic: 31 time 0.026048 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.024512 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.041504 [TensorRT] VERBOSE: Tactic: 256 time 0.036192 [TensorRT] VERBOSE: Tactic: 512 time 0.037408 [TensorRT] VERBOSE: Tactic: -32 time 0.052448 [TensorRT] VERBOSE: Tactic: -64 time 0.054368 [TensorRT] VERBOSE: Tactic: -128 time 0.054624 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036192 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.015008 [TensorRT] VERBOSE: Tactic: 1 time 0.012288 [TensorRT] VERBOSE: Tactic: 2 time 0.012288 [TensorRT] VERBOSE: Tactic: 3 time 0.010976 [TensorRT] VERBOSE: Tactic: 4 time 0.012128 [TensorRT] VERBOSE: Tactic: 5 time 0.012768 [TensorRT] VERBOSE: Tactic: 6 time 0.01056 [TensorRT] VERBOSE: Tactic: 7 time 0.011744 [TensorRT] VERBOSE: Tactic: 8 time 0.014336 [TensorRT] VERBOSE: Tactic: 9 time 0.014496 [TensorRT] VERBOSE: Tactic: 10 time 0.021312 [TensorRT] VERBOSE: Tactic: 11 time 0.017088 [TensorRT] VERBOSE: Tactic: 12 time 0.015904 [TensorRT] VERBOSE: Tactic: 13 time 0.014848 [TensorRT] VERBOSE: Tactic: 14 time 0.014336 [TensorRT] VERBOSE: Tactic: 15 time 0.016096 [TensorRT] VERBOSE: Tactic: 16 time 0.013568 [TensorRT] VERBOSE: Tactic: 17 time 0.013408 [TensorRT] VERBOSE: Tactic: 18 time 0.015136 [TensorRT] VERBOSE: Tactic: 19 time 0.017472 [TensorRT] VERBOSE: Tactic: 20 time 0.03312 [TensorRT] VERBOSE: Tactic: 21 time 0.024576 [TensorRT] VERBOSE: Tactic: 22 time 0.018016 [TensorRT] VERBOSE: Tactic: 23 time 0.015104 [TensorRT] VERBOSE: Tactic: 28 time 0.0192 [TensorRT] VERBOSE: Tactic: 29 time 0.022656 [TensorRT] VERBOSE: Tactic: 30 time 0.031744 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.01056 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.041632 [TensorRT] VERBOSE: Tactic: 256 time 0.03664 [TensorRT] VERBOSE: Tactic: 512 time 0.037312 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.03664 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_62 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.010656 [TensorRT] VERBOSE: Tactic: 11 time 0.01184 [TensorRT] VERBOSE: Tactic: 12 time 0.012288 [TensorRT] VERBOSE: Tactic: 13 time 0.013024 [TensorRT] VERBOSE: Tactic: 14 time 0.013312 [TensorRT] VERBOSE: Tactic: 15 time 0.01536 [TensorRT] VERBOSE: Tactic: 16 time 0.015744 [TensorRT] VERBOSE: Tactic: 17 time 0.015936 [TensorRT] VERBOSE: Tactic: 18 time 0.01936 [TensorRT] VERBOSE: Tactic: 19 time 0.021888 [TensorRT] VERBOSE: Tactic: 20 time 0.011616 [TensorRT] VERBOSE: Tactic: 21 time 0.012192 [TensorRT] VERBOSE: Tactic: 22 time 0.011744 [TensorRT] VERBOSE: Tactic: 23 time 0.01136 [TensorRT] VERBOSE: Tactic: 24 time 0.013376 [TensorRT] VERBOSE: Tactic: 25 time 0.012064 [TensorRT] VERBOSE: Tactic: 26 time 0.012032 [TensorRT] VERBOSE: Tactic: 27 time 0.011488 [TensorRT] VERBOSE: Tactic: 29 time 0.047616 [TensorRT] VERBOSE: Tactic: 30 time 0.02704 [TensorRT] VERBOSE: Tactic: 31 time 0.01904 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.010656 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.248384 [TensorRT] VERBOSE: Tactic: 655359 time 0.253824 [TensorRT] VERBOSE: Tactic: 786431 time 0.21168 [TensorRT] VERBOSE: Tactic: 851967 time 0.234848 [TensorRT] VERBOSE: Tactic: 1179647 time 0.219648 [TensorRT] VERBOSE: Tactic: 1310719 time 0.431104 [TensorRT] VERBOSE: Tactic: 1376255 time 0.274944 [TensorRT] VERBOSE: Tactic: 1441791 time 0.316832 [TensorRT] VERBOSE: Tactic: 1507327 time 0.235872 [TensorRT] VERBOSE: Tactic: 1638399 time 0.242208 [TensorRT] VERBOSE: Tactic: 1835007 time 0.221056 [TensorRT] VERBOSE: Tactic: 1900543 time 0.28816 [TensorRT] VERBOSE: Tactic: 2097151 time 0.22368 [TensorRT] VERBOSE: Tactic: 2162687 time 0.20656 [TensorRT] VERBOSE: Tactic: 2293759 time 0.266016 [TensorRT] VERBOSE: Tactic: 2359295 time 0.20112 [TensorRT] VERBOSE: Tactic: 2686975 time 0.208544 [TensorRT] VERBOSE: Tactic: 3080191 time 0.226784 [TensorRT] VERBOSE: Tactic: 3342335 time 0.235328 [TensorRT] VERBOSE: Tactic: 3407871 time 0.216864 [TensorRT] VERBOSE: Tactic: 3538943 time 0.210976 [TensorRT] VERBOSE: Tactic: 3670015 time 0.28624 [TensorRT] VERBOSE: Tactic: 3932159 time 0.2512 [TensorRT] VERBOSE: Tactic: 3997695 time 0.230912 [TensorRT] VERBOSE: Tactic: 4063231 time 0.21584 [TensorRT] VERBOSE: Tactic: 4194303 time 0.17936 [TensorRT] VERBOSE: Tactic: 4259839 time 0.221376 [TensorRT] VERBOSE: Tactic: 4325375 time 0.20768 [TensorRT] VERBOSE: Tactic: 4521983 time 0.264736 [TensorRT] VERBOSE: Tactic: 4587519 time 0.20896 [TensorRT] VERBOSE: Tactic: 4653055 time 0.200544 [TensorRT] VERBOSE: Tactic: 4915199 time 0.18432 [TensorRT] VERBOSE: Tactic: 4980735 time 0.216032 [TensorRT] VERBOSE: Tactic: 5177343 time 0.234976 [TensorRT] VERBOSE: Tactic: 5242879 time 0.206816 [TensorRT] VERBOSE: Tactic: 5373951 time 0.307808 [TensorRT] VERBOSE: Tactic: 5439487 time 0.322592 [TensorRT] VERBOSE: Tactic: 5570559 time 0.23552 [TensorRT] VERBOSE: Tactic: 5636095 time 0.2184 [TensorRT] VERBOSE: Tactic: 5701631 time 0.201504 [TensorRT] VERBOSE: Tactic: 5767167 time 0.730272 [TensorRT] VERBOSE: Tactic: 5832703 time 0.21504 [TensorRT] VERBOSE: Tactic: 5898239 time 0.193536 [TensorRT] VERBOSE: Tactic: 6029311 time 0.199584 [TensorRT] VERBOSE: Tactic: 6225919 time 0.207072 [TensorRT] VERBOSE: Tactic: 6291455 time 0.224192 [TensorRT] VERBOSE: Tactic: 6422527 time 0.215552 [TensorRT] VERBOSE: Tactic: 6750207 time 0.257376 [TensorRT] VERBOSE: Tactic: 6815743 time 0.237728 [TensorRT] VERBOSE: Tactic: 6946815 time 0.31744 [TensorRT] VERBOSE: Tactic: 7012351 time 0.223264 [TensorRT] VERBOSE: Tactic: 7077887 time 0.201952 [TensorRT] VERBOSE: Tactic: 7143423 time 0.344704 [TensorRT] VERBOSE: Tactic: 7208959 time 0.214976 [TensorRT] VERBOSE: Tactic: 7340031 time 0.2072 [TensorRT] VERBOSE: Tactic: 7405567 time 0.204288 [TensorRT] VERBOSE: Tactic: 7536639 time 0.257376 [TensorRT] VERBOSE: Tactic: 7602175 time 0.21264 [TensorRT] VERBOSE: Tactic: 7733247 time 0.1912 [TensorRT] VERBOSE: Tactic: 7798783 time 0.213248 [TensorRT] VERBOSE: Tactic: 8191999 time 0.343968 [TensorRT] VERBOSE: Tactic: 8257535 time 0.214912 [TensorRT] VERBOSE: Tactic: 8323071 time 0.232896 [TensorRT] VERBOSE: Tactic: 8650751 time 0.228 [TensorRT] VERBOSE: Tactic: 8716287 time 0.253984 [TensorRT] VERBOSE: Tactic: 9109503 time 0.23584 [TensorRT] VERBOSE: Tactic: 9568255 time 0.184736 [TensorRT] VERBOSE: Tactic: 9895935 time 0.178464 [TensorRT] VERBOSE: Tactic: 10223615 time 0.2096 [TensorRT] VERBOSE: Tactic: 10354687 time 0.216064 [TensorRT] VERBOSE: Tactic: 10551295 time 0.22064 [TensorRT] VERBOSE: Tactic: 10747903 time 0.183232 [TensorRT] VERBOSE: Tactic: 10944511 time 0.221152 [TensorRT] VERBOSE: Fastest Tactic: 9895935 Time: 0.178464 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.111328 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.111328 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.123904 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.111424 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.113568 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.110816 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.114944 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.13504 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.12288 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.110816 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.166016 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 802816, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 10862592, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.167072 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.166016 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.038272 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.04976 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.043584 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.039712 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.047232 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.045056 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.039936 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.038048 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.045792 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.03872 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.041312 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.038368 [TensorRT] VERBOSE: Fastest Tactic: -7924103240988931433 Time: 0.038048 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7924103240988931433 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.055648 [TensorRT] VERBOSE: Tactic: 655359 time 0.052544 [TensorRT] VERBOSE: Tactic: 786431 time 0.050176 [TensorRT] VERBOSE: Tactic: 851967 time 0.056672 [TensorRT] VERBOSE: Tactic: 1179647 time 0.071616 [TensorRT] VERBOSE: Tactic: 1310719 time 0.054176 [TensorRT] VERBOSE: Tactic: 1376255 time 0.06656 [TensorRT] VERBOSE: Tactic: 1441791 time 0.07168 [TensorRT] VERBOSE: Tactic: 1507327 time 0.047104 [TensorRT] VERBOSE: Tactic: 1638399 time 0.060768 [TensorRT] VERBOSE: Tactic: 1835007 time 0.050592 [TensorRT] VERBOSE: Tactic: 1900543 time 0.052288 [TensorRT] VERBOSE: Tactic: 2097151 time 0.056 [TensorRT] VERBOSE: Tactic: 2162687 time 0.072704 [TensorRT] VERBOSE: Tactic: 2293759 time 0.067008 [TensorRT] VERBOSE: Tactic: 2359295 time 0.074272 [TensorRT] VERBOSE: Tactic: 2686975 time 0.069568 [TensorRT] VERBOSE: Tactic: 3080191 time 0.044544 [TensorRT] VERBOSE: Tactic: 3342335 time 0.04624 [TensorRT] VERBOSE: Tactic: 3407871 time 0.067392 [TensorRT] VERBOSE: Tactic: 3538943 time 0.068608 [TensorRT] VERBOSE: Tactic: 3670015 time 0.061856 [TensorRT] VERBOSE: Tactic: 3932159 time 0.049152 [TensorRT] VERBOSE: Tactic: 3997695 time 0.051296 [TensorRT] VERBOSE: Tactic: 4063231 time 0.054048 [TensorRT] VERBOSE: Tactic: 4194303 time 0.045536 [TensorRT] VERBOSE: Tactic: 4259839 time 0.065376 [TensorRT] VERBOSE: Tactic: 4325375 time 0.100352 [TensorRT] VERBOSE: Tactic: 4521983 time 0.100672 [TensorRT] VERBOSE: Tactic: 4587519 time 0.057056 [TensorRT] VERBOSE: Tactic: 4653055 time 0.079872 [TensorRT] VERBOSE: Tactic: 4915199 time 0.044992 [TensorRT] VERBOSE: Tactic: 4980735 time 0.10352 [TensorRT] VERBOSE: Tactic: 5177343 time 0.065952 [TensorRT] VERBOSE: Tactic: 5242879 time 0.055616 [TensorRT] VERBOSE: Tactic: 5373951 time 0.076416 [TensorRT] VERBOSE: Tactic: 5439487 time 0.060992 [TensorRT] VERBOSE: Tactic: 5570559 time 0.043744 [TensorRT] VERBOSE: Tactic: 5636095 time 0.054208 [TensorRT] VERBOSE: Tactic: 5701631 time 0.06512 [TensorRT] VERBOSE: Tactic: 5767167 time 0.100672 [TensorRT] VERBOSE: Tactic: 5832703 time 0.06128 [TensorRT] VERBOSE: Tactic: 5898239 time 0.061408 [TensorRT] VERBOSE: Tactic: 6029311 time 0.0616 [TensorRT] VERBOSE: Tactic: 6225919 time 0.057664 [TensorRT] VERBOSE: Tactic: 6291455 time 0.071136 [TensorRT] VERBOSE: Tactic: 6422527 time 0.044384 [TensorRT] VERBOSE: Tactic: 6750207 time 0.058048 [TensorRT] VERBOSE: Tactic: 6815743 time 0.059616 [TensorRT] VERBOSE: Tactic: 6946815 time 0.062272 [TensorRT] VERBOSE: Tactic: 7012351 time 0.055776 [TensorRT] VERBOSE: Tactic: 7077887 time 0.062464 [TensorRT] VERBOSE: Tactic: 7143423 time 0.078336 [TensorRT] VERBOSE: Tactic: 7208959 time 0.057024 [TensorRT] VERBOSE: Tactic: 7340031 time 0.06112 [TensorRT] VERBOSE: Tactic: 7405567 time 0.052032 [TensorRT] VERBOSE: Tactic: 7536639 time 0.07392 [TensorRT] VERBOSE: Tactic: 7602175 time 0.056512 [TensorRT] VERBOSE: Tactic: 7733247 time 0.054848 [TensorRT] VERBOSE: Tactic: 7798783 time 0.051168 [TensorRT] VERBOSE: Tactic: 8191999 time 0.083552 [TensorRT] VERBOSE: Tactic: 8257535 time 0.045664 [TensorRT] VERBOSE: Tactic: 8323071 time 0.053696 [TensorRT] VERBOSE: Tactic: 8650751 time 0.051616 [TensorRT] VERBOSE: Tactic: 8716287 time 0.063584 [TensorRT] VERBOSE: Tactic: 9109503 time 0.063488 [TensorRT] VERBOSE: Tactic: 9568255 time 0.045536 [TensorRT] VERBOSE: Tactic: 9895935 time 0.045088 [TensorRT] VERBOSE: Tactic: 10223615 time 0.06736 [TensorRT] VERBOSE: Tactic: 10354687 time 0.10608 [TensorRT] VERBOSE: Tactic: 10551295 time 0.053632 [TensorRT] VERBOSE: Tactic: 10747903 time 0.054048 [TensorRT] VERBOSE: Tactic: 10944511 time 0.102848 [TensorRT] VERBOSE: Fastest Tactic: 5570559 Time: 0.043744 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.034272 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.034304 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.036064 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.035392 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.040608 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.034304 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.03792 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.034176 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.034336 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.036288 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.039936 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.038912 [TensorRT] VERBOSE: Fastest Tactic: 8097855305881829878 Time: 0.034176 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8097855305881829878 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.035072 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.040992 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.038176 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.034944 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.036832 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.035744 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.037216 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.038016 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.034816 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.034816 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.036256 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.035616 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.034816 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_63 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.046496 [TensorRT] VERBOSE: Tactic: 655359 time 0.047456 [TensorRT] VERBOSE: Tactic: 786431 time 0.06064 [TensorRT] VERBOSE: Tactic: 851967 time 0.051264 [TensorRT] VERBOSE: Tactic: 1179647 time 0.072544 [TensorRT] VERBOSE: Tactic: 1310719 time 0.051424 [TensorRT] VERBOSE: Tactic: 1376255 time 0.06608 [TensorRT] VERBOSE: Tactic: 1441791 time 0.068992 [TensorRT] VERBOSE: Tactic: 1507327 time 0.042112 [TensorRT] VERBOSE: Tactic: 1638399 time 0.062592 [TensorRT] VERBOSE: Tactic: 1835007 time 0.063328 [TensorRT] VERBOSE: Tactic: 1900543 time 0.044832 [TensorRT] VERBOSE: Tactic: 2097151 time 0.067424 [TensorRT] VERBOSE: Tactic: 2162687 time 0.066976 [TensorRT] VERBOSE: Tactic: 2293759 time 0.072288 [TensorRT] VERBOSE: Tactic: 2359295 time 0.066016 [TensorRT] VERBOSE: Tactic: 2686975 time 0.064 [TensorRT] VERBOSE: Tactic: 3080191 time 0.0368 [TensorRT] VERBOSE: Tactic: 3342335 time 0.041664 [TensorRT] VERBOSE: Tactic: 3407871 time 0.072384 [TensorRT] VERBOSE: Tactic: 3538943 time 0.072992 [TensorRT] VERBOSE: Tactic: 3670015 time 0.048384 [TensorRT] VERBOSE: Tactic: 3932159 time 0.04272 [TensorRT] VERBOSE: Tactic: 3997695 time 0.060672 [TensorRT] VERBOSE: Tactic: 4063231 time 0.047712 [TensorRT] VERBOSE: Tactic: 4194303 time 0.05088 [TensorRT] VERBOSE: Tactic: 4259839 time 0.06768 [TensorRT] VERBOSE: Tactic: 4325375 time 0.106112 [TensorRT] VERBOSE: Tactic: 4521983 time 0.107776 [TensorRT] VERBOSE: Tactic: 4587519 time 0.064416 [TensorRT] VERBOSE: Tactic: 4653055 time 0.083488 [TensorRT] VERBOSE: Tactic: 4915199 time 0.050528 [TensorRT] VERBOSE: Tactic: 4980735 time 0.108832 [TensorRT] VERBOSE: Tactic: 5177343 time 0.06608 [TensorRT] VERBOSE: Tactic: 5242879 time 0.061664 [TensorRT] VERBOSE: Tactic: 5373951 time 0.078336 [TensorRT] VERBOSE: Tactic: 5439487 time 0.077824 [TensorRT] VERBOSE: Tactic: 5570559 time 0.036256 [TensorRT] VERBOSE: Tactic: 5636095 time 0.04816 [TensorRT] VERBOSE: Tactic: 5701631 time 0.063776 [TensorRT] VERBOSE: Tactic: 5767167 time 0.148736 [TensorRT] VERBOSE: Tactic: 5832703 time 0.06512 [TensorRT] VERBOSE: Tactic: 5898239 time 0.062112 [TensorRT] VERBOSE: Tactic: 6029311 time 0.059584 [TensorRT] VERBOSE: Tactic: 6225919 time 0.064256 [TensorRT] VERBOSE: Tactic: 6291455 time 0.072672 [TensorRT] VERBOSE: Tactic: 6422527 time 0.038304 [TensorRT] VERBOSE: Tactic: 6750207 time 0.0704 [TensorRT] VERBOSE: Tactic: 6815743 time 0.068768 [TensorRT] VERBOSE: Tactic: 6946815 time 0.078848 [TensorRT] VERBOSE: Tactic: 7012351 time 0.06656 [TensorRT] VERBOSE: Tactic: 7077887 time 0.065504 [TensorRT] VERBOSE: Tactic: 7143423 time 0.10752 [TensorRT] VERBOSE: Tactic: 7208959 time 0.060096 [TensorRT] VERBOSE: Tactic: 7340031 time 0.061152 [TensorRT] VERBOSE: Tactic: 7405567 time 0.048928 [TensorRT] VERBOSE: Tactic: 7536639 time 0.079392 [TensorRT] VERBOSE: Tactic: 7602175 time 0.063712 [TensorRT] VERBOSE: Tactic: 7733247 time 0.054432 [TensorRT] VERBOSE: Tactic: 7798783 time 0.060096 [TensorRT] VERBOSE: Tactic: 8191999 time 0.097984 [TensorRT] VERBOSE: Tactic: 8257535 time 0.04736 [TensorRT] VERBOSE: Tactic: 8323071 time 0.06816 [TensorRT] VERBOSE: Tactic: 8650751 time 0.0568 [TensorRT] VERBOSE: Tactic: 8716287 time 0.068544 [TensorRT] VERBOSE: Tactic: 9109503 time 0.057728 [TensorRT] VERBOSE: Tactic: 9568255 time 0.050272 [TensorRT] VERBOSE: Tactic: 9895935 time 0.051136 [TensorRT] VERBOSE: Tactic: 10223615 time 0.064832 [TensorRT] VERBOSE: Tactic: 10354687 time 0.107712 [TensorRT] VERBOSE: Tactic: 10551295 time 0.065984 [TensorRT] VERBOSE: Tactic: 10747903 time 0.055456 [TensorRT] VERBOSE: Tactic: 10944511 time 0.109504 [TensorRT] VERBOSE: Fastest Tactic: 5570559 Time: 0.036256 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CaskConvolution) [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.016992 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.017024 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.0176 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.018112 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.016864 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.017536 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.017536 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.017504 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.017568 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.017504 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.017408 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.01744 [TensorRT] VERBOSE: Fastest Tactic: 7584772692956718645 Time: 0.016864 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_63 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7584772692956718645 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032672 [TensorRT] VERBOSE: Tactic: 256 time 0.032704 [TensorRT] VERBOSE: Tactic: 512 time 0.033792 [TensorRT] VERBOSE: Tactic: -32 time 0.050784 [TensorRT] VERBOSE: Tactic: -64 time 0.04784 [TensorRT] VERBOSE: Tactic: -128 time 0.039936 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.032672 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.02032 [TensorRT] VERBOSE: Tactic: 1 time 0.022304 [TensorRT] VERBOSE: Tactic: 2 time 0.017824 [TensorRT] VERBOSE: Tactic: 3 time 0.021248 [TensorRT] VERBOSE: Tactic: 4 time 0.018016 [TensorRT] VERBOSE: Tactic: 5 time 0.017696 [TensorRT] VERBOSE: Tactic: 6 time 0.020736 [TensorRT] VERBOSE: Tactic: 7 time 0.019328 [TensorRT] VERBOSE: Tactic: 8 time 0.017408 [TensorRT] VERBOSE: Tactic: 9 time 0.018176 [TensorRT] VERBOSE: Tactic: 28 time 0.01984 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.017408 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.03344 [TensorRT] VERBOSE: Tactic: 256 time 0.033728 [TensorRT] VERBOSE: Tactic: 512 time 0.036288 [TensorRT] VERBOSE: Tactic: -32 time 0.049952 [TensorRT] VERBOSE: Tactic: -64 time 0.046336 [TensorRT] VERBOSE: Tactic: -128 time 0.040896 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.03344 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_64 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.026624 [TensorRT] VERBOSE: Tactic: 25 time 0.027712 [TensorRT] VERBOSE: Tactic: 26 time 0.026624 [TensorRT] VERBOSE: Tactic: 27 time 0.02544 [TensorRT] VERBOSE: Tactic: 31 time 0.026016 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.02544 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] WARNING: No implementation of layer LeakyRelu_64 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040256 [TensorRT] VERBOSE: Tactic: 0 time 0.090432 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040256 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0776 [TensorRT] VERBOSE: Tactic: 0 time 0.04368 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04368 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.020256 [TensorRT] VERBOSE: Tactic: 0 time 0.011776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011776 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.023744 [TensorRT] VERBOSE: Tactic: 0 time 0.04848 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023744 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025984 [TensorRT] VERBOSE: Tactic: 0 time 0.015488 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015488 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02544 [TensorRT] VERBOSE: Tactic: 0 time 0.031776 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02544 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.03968 [TensorRT] VERBOSE: Tactic: 0 time 0.024864 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024864 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025024 [TensorRT] VERBOSE: Tactic: 0 time 0.011584 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011584 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027872 [TensorRT] VERBOSE: Tactic: 0 time 0.018624 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.018624 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02576 [TensorRT] VERBOSE: Tactic: 0 time 0.039456 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02576 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025984 [TensorRT] VERBOSE: Tactic: 0 time 0.006176 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006176 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025376 [TensorRT] VERBOSE: Tactic: 0 time 0.031776 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025376 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.03968 [TensorRT] VERBOSE: Tactic: 0 time 0.025728 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.025728 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027616 [TensorRT] VERBOSE: Tactic: 0 time 0.0192 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0192 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026752 [TensorRT] VERBOSE: Tactic: 0 time 0.039456 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026752 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025472 [TensorRT] VERBOSE: Tactic: 0 time 0.008672 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.008672 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026624 [TensorRT] VERBOSE: Tactic: 0 time 0.007136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007136 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025792 [TensorRT] VERBOSE: Tactic: 0 time 0.0168 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0168 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026848 [TensorRT] VERBOSE: Tactic: 0 time 0.016064 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016064 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.12272 [TensorRT] VERBOSE: Tactic: 655359 time 0.09552 [TensorRT] VERBOSE: Tactic: 786431 time 0.081024 [TensorRT] VERBOSE: Tactic: 851967 time 0.083552 [TensorRT] VERBOSE: Tactic: 1179647 time 0.074752 [TensorRT] VERBOSE: Tactic: 1310719 time 0.129696 [TensorRT] VERBOSE: Tactic: 1376255 time 0.100224 [TensorRT] VERBOSE: Tactic: 1441791 time 0.106496 [TensorRT] VERBOSE: Tactic: 1507327 time 0.09552 [TensorRT] VERBOSE: Tactic: 1638399 time 0.082528 [TensorRT] VERBOSE: Tactic: 1835007 time 0.075776 [TensorRT] VERBOSE: Tactic: 1900543 time 0.100096 [TensorRT] VERBOSE: Tactic: 2097151 time 0.075328 [TensorRT] VERBOSE: Tactic: 2162687 time 0.100384 [TensorRT] VERBOSE: Tactic: 2293759 time 0.103136 [TensorRT] VERBOSE: Tactic: 2359295 time 0.075776 [TensorRT] VERBOSE: Tactic: 2686975 time 0.09392 [TensorRT] VERBOSE: Tactic: 3080191 time 0.090112 [TensorRT] VERBOSE: Tactic: 3342335 time 0.09408 [TensorRT] VERBOSE: Tactic: 3407871 time 0.08208 [TensorRT] VERBOSE: Tactic: 3538943 time 0.074208 [TensorRT] VERBOSE: Tactic: 3670015 time 0.144576 [TensorRT] VERBOSE: Tactic: 3932159 time 0.089088 [TensorRT] VERBOSE: Tactic: 3997695 time 0.076736 [TensorRT] VERBOSE: Tactic: 4063231 time 0.083328 [TensorRT] VERBOSE: Tactic: 4194303 time 0.078784 [TensorRT] VERBOSE: Tactic: 4259839 time 0.077408 [TensorRT] VERBOSE: Tactic: 4325375 time 0.07792 [TensorRT] VERBOSE: Tactic: 4521983 time 0.092992 [TensorRT] VERBOSE: Tactic: 4587519 time 0.072096 [TensorRT] VERBOSE: Tactic: 4653055 time 0.071488 [TensorRT] VERBOSE: Tactic: 4915199 time 0.071904 [TensorRT] VERBOSE: Tactic: 4980735 time 0.089792 [TensorRT] VERBOSE: Tactic: 5177343 time 0.081184 [TensorRT] VERBOSE: Tactic: 5242879 time 0.08192 [TensorRT] VERBOSE: Tactic: 5373951 time 0.091968 [TensorRT] VERBOSE: Tactic: 5439487 time 0.09216 [TensorRT] VERBOSE: Tactic: 5570559 time 0.093056 [TensorRT] VERBOSE: Tactic: 5636095 time 0.083968 [TensorRT] VERBOSE: Tactic: 5701631 time 0.095232 [TensorRT] VERBOSE: Tactic: 5767167 time 0.13168 [TensorRT] VERBOSE: Tactic: 5832703 time 0.083008 [TensorRT] VERBOSE: Tactic: 5898239 time 0.075264 [TensorRT] VERBOSE: Tactic: 6029311 time 0.091264 [TensorRT] VERBOSE: Tactic: 6225919 time 0.072448 [TensorRT] VERBOSE: Tactic: 6291455 time 0.074752 [TensorRT] VERBOSE: Tactic: 6422527 time 0.084928 [TensorRT] VERBOSE: Tactic: 6750207 time 0.081664 [TensorRT] VERBOSE: Tactic: 6815743 time 0.09088 [TensorRT] VERBOSE: Tactic: 6946815 time 0.087168 [TensorRT] VERBOSE: Tactic: 7012351 time 0.076928 [TensorRT] VERBOSE: Tactic: 7077887 time 0.072704 [TensorRT] VERBOSE: Tactic: 7143423 time 0.102048 [TensorRT] VERBOSE: Tactic: 7208959 time 0.088352 [TensorRT] VERBOSE: Tactic: 7340031 time 0.075776 [TensorRT] VERBOSE: Tactic: 7405567 time 0.075904 [TensorRT] VERBOSE: Tactic: 7536639 time 0.088736 [TensorRT] VERBOSE: Tactic: 7602175 time 0.077824 [TensorRT] VERBOSE: Tactic: 7733247 time 0.07376 [TensorRT] VERBOSE: Tactic: 7798783 time 0.079776 [TensorRT] VERBOSE: Tactic: 8191999 time 0.096544 [TensorRT] VERBOSE: Tactic: 8257535 time 0.076128 [TensorRT] VERBOSE: Tactic: 8323071 time 0.081632 [TensorRT] VERBOSE: Tactic: 8650751 time 0.080224 [TensorRT] VERBOSE: Tactic: 8716287 time 0.082016 [TensorRT] VERBOSE: Tactic: 9109503 time 0.079136 [TensorRT] VERBOSE: Tactic: 9568255 time 0.072288 [TensorRT] VERBOSE: Tactic: 9895935 time 0.076544 [TensorRT] VERBOSE: Tactic: 10223615 time 0.09328 [TensorRT] VERBOSE: Tactic: 10354687 time 0.074528 [TensorRT] VERBOSE: Tactic: 10551295 time 0.08176 [TensorRT] VERBOSE: Tactic: 10747903 time 0.071328 [TensorRT] VERBOSE: Tactic: 10944511 time 0.090912 [TensorRT] VERBOSE: Fastest Tactic: 10747903 Time: 0.071328 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.036288 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.038176 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.042496 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.037056 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.036416 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.03664 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.039136 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.04016 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.043296 [TensorRT] VERBOSE: Fastest Tactic: 1754569683116234317 Time: 0.036288 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.06064 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 401408, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 3203072, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.060128 [TensorRT] VERBOSE: Fastest Tactic: 57 Time: 0.060128 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.018944 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.018816 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.019296 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.018336 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.018592 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.018784 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.01824 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.017536 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.017632 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.018208 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.018496 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.01872 [TensorRT] VERBOSE: Fastest Tactic: -7924103240988931433 Time: 0.017536 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7924103240988931433 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.02528 [TensorRT] VERBOSE: Tactic: 655359 time 0.023808 [TensorRT] VERBOSE: Tactic: 786431 time 0.024608 [TensorRT] VERBOSE: Tactic: 851967 time 0.02448 [TensorRT] VERBOSE: Tactic: 1179647 time 0.026176 [TensorRT] VERBOSE: Tactic: 1310719 time 0.02544 [TensorRT] VERBOSE: Tactic: 1376255 time 0.02928 [TensorRT] VERBOSE: Tactic: 1441791 time 0.028608 [TensorRT] VERBOSE: Tactic: 1507327 time 0.021792 [TensorRT] VERBOSE: Tactic: 1638399 time 0.024992 [TensorRT] VERBOSE: Tactic: 1835007 time 0.02336 [TensorRT] VERBOSE: Tactic: 1900543 time 0.02656 [TensorRT] VERBOSE: Tactic: 2097151 time 0.023552 [TensorRT] VERBOSE: Tactic: 2162687 time 0.0344 [TensorRT] VERBOSE: Tactic: 2293759 time 0.029696 [TensorRT] VERBOSE: Tactic: 2359295 time 0.027712 [TensorRT] VERBOSE: Tactic: 2686975 time 0.02816 [TensorRT] VERBOSE: Tactic: 3080191 time 0.0216 [TensorRT] VERBOSE: Tactic: 3342335 time 0.022272 [TensorRT] VERBOSE: Tactic: 3407871 time 0.025952 [TensorRT] VERBOSE: Tactic: 3538943 time 0.025024 [TensorRT] VERBOSE: Tactic: 3670015 time 0.029664 [TensorRT] VERBOSE: Tactic: 3932159 time 0.021856 [TensorRT] VERBOSE: Tactic: 3997695 time 0.021856 [TensorRT] VERBOSE: Tactic: 4063231 time 0.023232 [TensorRT] VERBOSE: Tactic: 4194303 time 0.022272 [TensorRT] VERBOSE: Tactic: 4259839 time 0.027008 [TensorRT] VERBOSE: Tactic: 4325375 time 0.033312 [TensorRT] VERBOSE: Tactic: 4521983 time 0.033312 [TensorRT] VERBOSE: Tactic: 4587519 time 0.022976 [TensorRT] VERBOSE: Tactic: 4653055 time 0.029952 [TensorRT] VERBOSE: Tactic: 4915199 time 0.0216 [TensorRT] VERBOSE: Tactic: 4980735 time 0.033536 [TensorRT] VERBOSE: Tactic: 5177343 time 0.0256 [TensorRT] VERBOSE: Tactic: 5242879 time 0.022784 [TensorRT] VERBOSE: Tactic: 5373951 time 0.02848 [TensorRT] VERBOSE: Tactic: 5439487 time 0.024544 [TensorRT] VERBOSE: Tactic: 5570559 time 0.022176 [TensorRT] VERBOSE: Tactic: 5636095 time 0.022944 [TensorRT] VERBOSE: Tactic: 5701631 time 0.029248 [TensorRT] VERBOSE: Tactic: 5767167 time 0.029888 [TensorRT] VERBOSE: Tactic: 5832703 time 0.024768 [TensorRT] VERBOSE: Tactic: 5898239 time 0.02368 [TensorRT] VERBOSE: Tactic: 6029311 time 0.025312 [TensorRT] VERBOSE: Tactic: 6225919 time 0.022784 [TensorRT] VERBOSE: Tactic: 6291455 time 0.026624 [TensorRT] VERBOSE: Tactic: 6422527 time 0.020224 [TensorRT] VERBOSE: Tactic: 6750207 time 0.023168 [TensorRT] VERBOSE: Tactic: 6815743 time 0.023552 [TensorRT] VERBOSE: Tactic: 6946815 time 0.024832 [TensorRT] VERBOSE: Tactic: 7012351 time 0.023776 [TensorRT] VERBOSE: Tactic: 7077887 time 0.023392 [TensorRT] VERBOSE: Tactic: 7143423 time 0.027456 [TensorRT] VERBOSE: Tactic: 7208959 time 0.02368 [TensorRT] VERBOSE: Tactic: 7340031 time 0.02496 [TensorRT] VERBOSE: Tactic: 7405567 time 0.02192 [TensorRT] VERBOSE: Tactic: 7536639 time 0.026848 [TensorRT] VERBOSE: Tactic: 7602175 time 0.0224 [TensorRT] VERBOSE: Tactic: 7733247 time 0.022464 [TensorRT] VERBOSE: Tactic: 7798783 time 0.025024 [TensorRT] VERBOSE: Tactic: 8191999 time 0.027744 [TensorRT] VERBOSE: Tactic: 8257535 time 0.020992 [TensorRT] VERBOSE: Tactic: 8323071 time 0.021984 [TensorRT] VERBOSE: Tactic: 8650751 time 0.023488 [TensorRT] VERBOSE: Tactic: 8716287 time 0.023648 [TensorRT] VERBOSE: Tactic: 9109503 time 0.026592 [TensorRT] VERBOSE: Tactic: 9568255 time 0.02128 [TensorRT] VERBOSE: Tactic: 9895935 time 0.023264 [TensorRT] VERBOSE: Tactic: 10223615 time 0.028032 [TensorRT] VERBOSE: Tactic: 10354687 time 0.036096 [TensorRT] VERBOSE: Tactic: 10551295 time 0.02336 [TensorRT] VERBOSE: Tactic: 10747903 time 0.021952 [TensorRT] VERBOSE: Tactic: 10944511 time 0.033856 [TensorRT] VERBOSE: Fastest Tactic: 6422527 Time: 0.020224 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.014144 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.01424 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.016064 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.015552 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.016352 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.01536 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.015584 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.014688 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.014272 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.015392 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.015584 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.018496 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.014144 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3145259992339075399 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.015136 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.018752 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.015648 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.01408 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.01536 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.015712 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.015328 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.018624 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.014624 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.01424 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.014976 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.01552 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.01408 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_78 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.02032 [TensorRT] VERBOSE: Tactic: 655359 time 0.018432 [TensorRT] VERBOSE: Tactic: 786431 time 0.022432 [TensorRT] VERBOSE: Tactic: 851967 time 0.022048 [TensorRT] VERBOSE: Tactic: 1179647 time 0.025984 [TensorRT] VERBOSE: Tactic: 1310719 time 0.022368 [TensorRT] VERBOSE: Tactic: 1376255 time 0.025568 [TensorRT] VERBOSE: Tactic: 1441791 time 0.026624 [TensorRT] VERBOSE: Tactic: 1507327 time 0.017024 [TensorRT] VERBOSE: Tactic: 1638399 time 0.023584 [TensorRT] VERBOSE: Tactic: 1835007 time 0.023264 [TensorRT] VERBOSE: Tactic: 1900543 time 0.020384 [TensorRT] VERBOSE: Tactic: 2097151 time 0.026048 [TensorRT] VERBOSE: Tactic: 2162687 time 0.026592 [TensorRT] VERBOSE: Tactic: 2293759 time 0.024832 [TensorRT] VERBOSE: Tactic: 2359295 time 0.021792 [TensorRT] VERBOSE: Tactic: 2686975 time 0.023584 [TensorRT] VERBOSE: Tactic: 3080191 time 0.015648 [TensorRT] VERBOSE: Tactic: 3342335 time 0.016448 [TensorRT] VERBOSE: Tactic: 3407871 time 0.026624 [TensorRT] VERBOSE: Tactic: 3538943 time 0.02512 [TensorRT] VERBOSE: Tactic: 3670015 time 0.023104 [TensorRT] VERBOSE: Tactic: 3932159 time 0.016896 [TensorRT] VERBOSE: Tactic: 3997695 time 0.021984 [TensorRT] VERBOSE: Tactic: 4063231 time 0.02032 [TensorRT] VERBOSE: Tactic: 4194303 time 0.02048 [TensorRT] VERBOSE: Tactic: 4259839 time 0.026464 [TensorRT] VERBOSE: Tactic: 4325375 time 0.033056 [TensorRT] VERBOSE: Tactic: 4521983 time 0.0344 [TensorRT] VERBOSE: Tactic: 4587519 time 0.023552 [TensorRT] VERBOSE: Tactic: 4653055 time 0.029664 [TensorRT] VERBOSE: Tactic: 4915199 time 0.019744 [TensorRT] VERBOSE: Tactic: 4980735 time 0.034784 [TensorRT] VERBOSE: Tactic: 5177343 time 0.024608 [TensorRT] VERBOSE: Tactic: 5242879 time 0.021824 [TensorRT] VERBOSE: Tactic: 5373951 time 0.02736 [TensorRT] VERBOSE: Tactic: 5439487 time 0.02528 [TensorRT] VERBOSE: Tactic: 5570559 time 0.015552 [TensorRT] VERBOSE: Tactic: 5636095 time 0.019936 [TensorRT] VERBOSE: Tactic: 5701631 time 0.023552 [TensorRT] VERBOSE: Tactic: 5767167 time 0.042432 [TensorRT] VERBOSE: Tactic: 5832703 time 0.023616 [TensorRT] VERBOSE: Tactic: 5898239 time 0.023808 [TensorRT] VERBOSE: Tactic: 6029311 time 0.023584 [TensorRT] VERBOSE: Tactic: 6225919 time 0.021856 [TensorRT] VERBOSE: Tactic: 6291455 time 0.026592 [TensorRT] VERBOSE: Tactic: 6422527 time 0.01568 [TensorRT] VERBOSE: Tactic: 6750207 time 0.025344 [TensorRT] VERBOSE: Tactic: 6815743 time 0.02384 [TensorRT] VERBOSE: Tactic: 6946815 time 0.025408 [TensorRT] VERBOSE: Tactic: 7012351 time 0.026592 [TensorRT] VERBOSE: Tactic: 7077887 time 0.023488 [TensorRT] VERBOSE: Tactic: 7143423 time 0.031808 [TensorRT] VERBOSE: Tactic: 7208959 time 0.02208 [TensorRT] VERBOSE: Tactic: 7340031 time 0.023584 [TensorRT] VERBOSE: Tactic: 7405567 time 0.020416 [TensorRT] VERBOSE: Tactic: 7536639 time 0.025248 [TensorRT] VERBOSE: Tactic: 7602175 time 0.023104 [TensorRT] VERBOSE: Tactic: 7733247 time 0.019808 [TensorRT] VERBOSE: Tactic: 7798783 time 0.023616 [TensorRT] VERBOSE: Tactic: 8191999 time 0.031168 [TensorRT] VERBOSE: Tactic: 8257535 time 0.01856 [TensorRT] VERBOSE: Tactic: 8323071 time 0.023552 [TensorRT] VERBOSE: Tactic: 8650751 time 0.0208 [TensorRT] VERBOSE: Tactic: 8716287 time 0.022784 [TensorRT] VERBOSE: Tactic: 9109503 time 0.022048 [TensorRT] VERBOSE: Tactic: 9568255 time 0.018592 [TensorRT] VERBOSE: Tactic: 9895935 time 0.02032 [TensorRT] VERBOSE: Tactic: 10223615 time 0.02272 [TensorRT] VERBOSE: Tactic: 10354687 time 0.034816 [TensorRT] VERBOSE: Tactic: 10551295 time 0.023552 [TensorRT] VERBOSE: Tactic: 10747903 time 0.020928 [TensorRT] VERBOSE: Tactic: 10944511 time 0.03472 [TensorRT] VERBOSE: Fastest Tactic: 5570559 Time: 0.015552 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CaskConvolution) [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.01072 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.01232 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.010496 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.010944 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.012736 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.010912 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.011008 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.010784 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.011104 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.011104 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.012704 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.010976 [TensorRT] VERBOSE: Fastest Tactic: 5754467717466343388 Time: 0.010496 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_78 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5754467717466343388 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02336 [TensorRT] VERBOSE: Tactic: 0 time 0.049088 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02336 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027072 [TensorRT] VERBOSE: Tactic: 0 time 0.04784 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.027072 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02528 [TensorRT] VERBOSE: Tactic: 0 time 0.047488 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02528 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019872 [TensorRT] VERBOSE: Tactic: 256 time 0.019104 [TensorRT] VERBOSE: Tactic: 512 time 0.019744 [TensorRT] VERBOSE: Tactic: -32 time 0.044224 [TensorRT] VERBOSE: Tactic: -64 time 0.028672 [TensorRT] VERBOSE: Tactic: -128 time 0.025696 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.019104 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.0128 [TensorRT] VERBOSE: Tactic: 1 time 0.011744 [TensorRT] VERBOSE: Tactic: 2 time 0.011488 [TensorRT] VERBOSE: Tactic: 3 time 0.013312 [TensorRT] VERBOSE: Tactic: 4 time 0.012704 [TensorRT] VERBOSE: Tactic: 5 time 0.011264 [TensorRT] VERBOSE: Tactic: 6 time 0.013056 [TensorRT] VERBOSE: Tactic: 7 time 0.011776 [TensorRT] VERBOSE: Tactic: 8 time 0.011232 [TensorRT] VERBOSE: Tactic: 9 time 0.011968 [TensorRT] VERBOSE: Tactic: 28 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.011232 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.018784 [TensorRT] VERBOSE: Tactic: 256 time 0.018944 [TensorRT] VERBOSE: Tactic: 512 time 0.020384 [TensorRT] VERBOSE: Tactic: -32 time 0.04256 [TensorRT] VERBOSE: Tactic: -64 time 0.027552 [TensorRT] VERBOSE: Tactic: -128 time 0.025184 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.018784 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014976 [TensorRT] VERBOSE: Tactic: 25 time 0.015328 [TensorRT] VERBOSE: Tactic: 26 time 0.014656 [TensorRT] VERBOSE: Tactic: 27 time 0.014016 [TensorRT] VERBOSE: Tactic: 31 time 0.014528 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.014016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022912 [TensorRT] VERBOSE: Tactic: 256 time 0.021248 [TensorRT] VERBOSE: Tactic: 512 time 0.021664 [TensorRT] VERBOSE: Tactic: -32 time 0.026624 [TensorRT] VERBOSE: Tactic: -64 time 0.029664 [TensorRT] VERBOSE: Tactic: -128 time 0.030752 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021248 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008928 [TensorRT] VERBOSE: Tactic: 1 time 0.007584 [TensorRT] VERBOSE: Tactic: 2 time 0.006848 [TensorRT] VERBOSE: Tactic: 3 time 0.007776 [TensorRT] VERBOSE: Tactic: 4 time 0.0064 [TensorRT] VERBOSE: Tactic: 5 time 0.007136 [TensorRT] VERBOSE: Tactic: 6 time 0.007584 [TensorRT] VERBOSE: Tactic: 7 time 0.00768 [TensorRT] VERBOSE: Tactic: 8 time 0.008032 [TensorRT] VERBOSE: Tactic: 9 time 0.008544 [TensorRT] VERBOSE: Tactic: 10 time 0.012288 [TensorRT] VERBOSE: Tactic: 11 time 0.010496 [TensorRT] VERBOSE: Tactic: 12 time 0.009088 [TensorRT] VERBOSE: Tactic: 13 time 0.009344 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.008448 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.008896 [TensorRT] VERBOSE: Tactic: 19 time 0.009088 [TensorRT] VERBOSE: Tactic: 20 time 0.018656 [TensorRT] VERBOSE: Tactic: 21 time 0.014336 [TensorRT] VERBOSE: Tactic: 22 time 0.012 [TensorRT] VERBOSE: Tactic: 23 time 0.010304 [TensorRT] VERBOSE: Tactic: 28 time 0.011168 [TensorRT] VERBOSE: Tactic: 29 time 0.012384 [TensorRT] VERBOSE: Tactic: 30 time 0.017856 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.0064 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022784 [TensorRT] VERBOSE: Tactic: 256 time 0.021152 [TensorRT] VERBOSE: Tactic: 512 time 0.022144 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021152 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_79 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007584 [TensorRT] VERBOSE: Tactic: 11 time 0.007584 [TensorRT] VERBOSE: Tactic: 12 time 0.00816 [TensorRT] VERBOSE: Tactic: 13 time 0.010592 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.010656 [TensorRT] VERBOSE: Tactic: 16 time 0.013856 [TensorRT] VERBOSE: Tactic: 17 time 0.013312 [TensorRT] VERBOSE: Tactic: 18 time 0.014656 [TensorRT] VERBOSE: Tactic: 19 time 0.016 [TensorRT] VERBOSE: Tactic: 20 time 0.007584 [TensorRT] VERBOSE: Tactic: 21 time 0.007584 [TensorRT] VERBOSE: Tactic: 22 time 0.00784 [TensorRT] VERBOSE: Tactic: 23 time 0.01072 [TensorRT] VERBOSE: Tactic: 24 time 0.008768 [TensorRT] VERBOSE: Tactic: 25 time 0.007392 [TensorRT] VERBOSE: Tactic: 26 time 0.007328 [TensorRT] VERBOSE: Tactic: 27 time 0.009152 [TensorRT] VERBOSE: Tactic: 29 time 0.027584 [TensorRT] VERBOSE: Tactic: 30 time 0.016096 [TensorRT] VERBOSE: Tactic: 31 time 0.01088 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.007328 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.256 [TensorRT] VERBOSE: Tactic: 720895 time 0.246784 [TensorRT] VERBOSE: Tactic: 983039 time 0.211616 [TensorRT] VERBOSE: Tactic: 1048575 time 0.28272 [TensorRT] VERBOSE: Tactic: 1703935 time 0.256736 [TensorRT] VERBOSE: Tactic: 1769471 time 0.266144 [TensorRT] VERBOSE: Tactic: 1966079 time 0.297856 [TensorRT] VERBOSE: Tactic: 2031615 time 0.31312 [TensorRT] VERBOSE: Tactic: 2228223 time 0.289824 [TensorRT] VERBOSE: Tactic: 2424831 time 0.255136 [TensorRT] VERBOSE: Tactic: 2621439 time 0.27648 [TensorRT] VERBOSE: Tactic: 2752511 time 0.262176 [TensorRT] VERBOSE: Tactic: 2818047 time 0.267872 [TensorRT] VERBOSE: Tactic: 2883583 time 0.338464 [TensorRT] VERBOSE: Tactic: 3014655 time 0.23728 [TensorRT] VERBOSE: Tactic: 3145727 time 0.217088 [TensorRT] VERBOSE: Tactic: 3473407 time 0.241408 [TensorRT] VERBOSE: Tactic: 3604479 time 0.23136 [TensorRT] VERBOSE: Tactic: 3735551 time 0.294688 [TensorRT] VERBOSE: Tactic: 4390911 time 0.309696 [TensorRT] VERBOSE: Tactic: 5046271 time 0.255904 [TensorRT] VERBOSE: Tactic: 5963775 time 0.278304 [TensorRT] VERBOSE: Tactic: 6160383 time 0.245856 [TensorRT] VERBOSE: Tactic: 6488063 time 0.214336 [TensorRT] VERBOSE: Tactic: 6881279 time 0.27392 [TensorRT] VERBOSE: Tactic: 7274495 time 0.245632 [TensorRT] VERBOSE: Tactic: 7864319 time 0.236128 [TensorRT] VERBOSE: Tactic: 7995391 time 0.24832 [TensorRT] VERBOSE: Tactic: 8585215 time 0.24496 [TensorRT] VERBOSE: Tactic: 8847359 time 0.27856 [TensorRT] VERBOSE: Tactic: 8978431 time 0.27728 [TensorRT] VERBOSE: Tactic: 9043967 time 0.213856 [TensorRT] VERBOSE: Tactic: 9175039 time 0.23136 [TensorRT] VERBOSE: Tactic: 9502719 time 0.308576 [TensorRT] VERBOSE: Tactic: 9830399 time 0.230528 [TensorRT] VERBOSE: Tactic: 9961471 time 0.281632 [TensorRT] VERBOSE: Tactic: 10027007 time 0.226624 [TensorRT] VERBOSE: Tactic: 10092543 time 0.309824 [TensorRT] VERBOSE: Tactic: 10289151 time 0.295936 [TensorRT] VERBOSE: Tactic: 10485759 time 0.21952 [TensorRT] VERBOSE: Tactic: 10682367 time 0.258592 [TensorRT] VERBOSE: Tactic: 10813439 time 0.23344 [TensorRT] VERBOSE: Fastest Tactic: 983039 Time: 0.211616 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.24064 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.127296 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.238336 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.23456 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.238912 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.23584 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.24928 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.250592 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.292384 [TensorRT] VERBOSE: Fastest Tactic: 2775507031594384867 Time: 0.127296 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.348896 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 3612672, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 72417280, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 1638912, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 1987584, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.348896 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.069536 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.072224 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.080448 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.07408 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.070656 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.085152 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.070048 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.069632 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.069152 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.07088 [TensorRT] VERBOSE: Fastest Tactic: -4973811344878172338 Time: 0.069152 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4973811344878172338 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.063872 [TensorRT] VERBOSE: Tactic: 720895 time 0.06992 [TensorRT] VERBOSE: Tactic: 983039 time 0.057344 [TensorRT] VERBOSE: Tactic: 1048575 time 0.073088 [TensorRT] VERBOSE: Tactic: 1703935 time 0.075168 [TensorRT] VERBOSE: Tactic: 1769471 time 0.07328 [TensorRT] VERBOSE: Tactic: 1966079 time 0.072128 [TensorRT] VERBOSE: Tactic: 2031615 time 0.08304 [TensorRT] VERBOSE: Tactic: 2228223 time 0.111616 [TensorRT] VERBOSE: Tactic: 2424831 time 0.117696 [TensorRT] VERBOSE: Tactic: 2621439 time 0.079552 [TensorRT] VERBOSE: Tactic: 2752511 time 0.078496 [TensorRT] VERBOSE: Tactic: 2818047 time 0.067616 [TensorRT] VERBOSE: Tactic: 2883583 time 0.088736 [TensorRT] VERBOSE: Tactic: 3014655 time 0.07264 [TensorRT] VERBOSE: Tactic: 3145727 time 0.061568 [TensorRT] VERBOSE: Tactic: 3473407 time 0.066528 [TensorRT] VERBOSE: Tactic: 3604479 time 0.061984 [TensorRT] VERBOSE: Tactic: 3735551 time 0.0632 [TensorRT] VERBOSE: Tactic: 4390911 time 0.07888 [TensorRT] VERBOSE: Tactic: 5046271 time 0.070432 [TensorRT] VERBOSE: Tactic: 5963775 time 0.06896 [TensorRT] VERBOSE: Tactic: 6160383 time 0.145888 [TensorRT] VERBOSE: Tactic: 6488063 time 0.074112 [TensorRT] VERBOSE: Tactic: 6881279 time 0.075168 [TensorRT] VERBOSE: Tactic: 7274495 time 0.066912 [TensorRT] VERBOSE: Tactic: 7864319 time 0.070656 [TensorRT] VERBOSE: Tactic: 7995391 time 0.067712 [TensorRT] VERBOSE: Tactic: 8585215 time 0.068864 [TensorRT] VERBOSE: Tactic: 8847359 time 0.066144 [TensorRT] VERBOSE: Tactic: 8978431 time 0.067328 [TensorRT] VERBOSE: Tactic: 9043967 time 0.063264 [TensorRT] VERBOSE: Tactic: 9175039 time 0.062816 [TensorRT] VERBOSE: Tactic: 9502719 time 0.081248 [TensorRT] VERBOSE: Tactic: 9830399 time 0.063552 [TensorRT] VERBOSE: Tactic: 9961471 time 0.102752 [TensorRT] VERBOSE: Tactic: 10027007 time 0.065344 [TensorRT] VERBOSE: Tactic: 10092543 time 0.079424 [TensorRT] VERBOSE: Tactic: 10289151 time 0.074336 [TensorRT] VERBOSE: Tactic: 10485759 time 0.066464 [TensorRT] VERBOSE: Tactic: 10682367 time 0.070944 [TensorRT] VERBOSE: Tactic: 10813439 time 0.060768 [TensorRT] VERBOSE: Fastest Tactic: 983039 Time: 0.057344 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.068192 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.065664 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.069056 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.065952 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.077792 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.063104 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.07312 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.06544 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.065536 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.067136 [TensorRT] VERBOSE: Fastest Tactic: -7210942453088153035 Time: 0.063104 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 983039 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.067776 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.075776 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.06768 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.069888 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.066368 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.067488 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.063488 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.069312 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.065472 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.065408 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.063488 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_80 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.066016 [TensorRT] VERBOSE: Tactic: 720895 time 0.06656 [TensorRT] VERBOSE: Tactic: 983039 time 0.056832 [TensorRT] VERBOSE: Tactic: 1048575 time 0.0736 [TensorRT] VERBOSE: Tactic: 1703935 time 0.075072 [TensorRT] VERBOSE: Tactic: 1769471 time 0.07056 [TensorRT] VERBOSE: Tactic: 1966079 time 0.069152 [TensorRT] VERBOSE: Tactic: 2031615 time 0.081696 [TensorRT] VERBOSE: Tactic: 2228223 time 0.111776 [TensorRT] VERBOSE: Tactic: 2424831 time 0.120896 [TensorRT] VERBOSE: Tactic: 2621439 time 0.074848 [TensorRT] VERBOSE: Tactic: 2752511 time 0.080832 [TensorRT] VERBOSE: Tactic: 2818047 time 0.065728 [TensorRT] VERBOSE: Tactic: 2883583 time 0.08336 [TensorRT] VERBOSE: Tactic: 3014655 time 0.074784 [TensorRT] VERBOSE: Tactic: 3145727 time 0.062624 [TensorRT] VERBOSE: Tactic: 3473407 time 0.062496 [TensorRT] VERBOSE: Tactic: 3604479 time 0.062816 [TensorRT] VERBOSE: Tactic: 3735551 time 0.064384 [TensorRT] VERBOSE: Tactic: 4390911 time 0.081504 [TensorRT] VERBOSE: Tactic: 5046271 time 0.071616 [TensorRT] VERBOSE: Tactic: 5963775 time 0.065792 [TensorRT] VERBOSE: Tactic: 6160383 time 0.157056 [TensorRT] VERBOSE: Tactic: 6488063 time 0.076672 [TensorRT] VERBOSE: Tactic: 6881279 time 0.076864 [TensorRT] VERBOSE: Tactic: 7274495 time 0.064448 [TensorRT] VERBOSE: Tactic: 7864319 time 0.070656 [TensorRT] VERBOSE: Tactic: 7995391 time 0.065664 [TensorRT] VERBOSE: Tactic: 8585215 time 0.069216 [TensorRT] VERBOSE: Tactic: 8847359 time 0.06608 [TensorRT] VERBOSE: Tactic: 8978431 time 0.064672 [TensorRT] VERBOSE: Tactic: 9043967 time 0.06288 [TensorRT] VERBOSE: Tactic: 9175039 time 0.063072 [TensorRT] VERBOSE: Tactic: 9502719 time 0.084576 [TensorRT] VERBOSE: Tactic: 9830399 time 0.062688 [TensorRT] VERBOSE: Tactic: 9961471 time 0.111936 [TensorRT] VERBOSE: Tactic: 10027007 time 0.066496 [TensorRT] VERBOSE: Tactic: 10092543 time 0.079808 [TensorRT] VERBOSE: Tactic: 10289151 time 0.068992 [TensorRT] VERBOSE: Tactic: 10485759 time 0.066496 [TensorRT] VERBOSE: Tactic: 10682367 time 0.071424 [TensorRT] VERBOSE: Tactic: 10813439 time 0.059008 [TensorRT] VERBOSE: Fastest Tactic: 983039 Time: 0.056832 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CaskConvolution) [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.025056 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.028576 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.038048 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.0256 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.025472 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.02656 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.0384 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.026624 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.02768 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.024416 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.037472 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.024192 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.024192 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_80 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023872 [TensorRT] VERBOSE: Tactic: 256 time 0.024576 [TensorRT] VERBOSE: Tactic: 512 time 0.025056 [TensorRT] VERBOSE: Tactic: -32 time 0.053568 [TensorRT] VERBOSE: Tactic: -64 time 0.034272 [TensorRT] VERBOSE: Tactic: -128 time 0.0344 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023872 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.015616 [TensorRT] VERBOSE: Tactic: 1 time 0.015872 [TensorRT] VERBOSE: Tactic: 2 time 0.014752 [TensorRT] VERBOSE: Tactic: 3 time 0.01776 [TensorRT] VERBOSE: Tactic: 4 time 0.014688 [TensorRT] VERBOSE: Tactic: 5 time 0.015424 [TensorRT] VERBOSE: Tactic: 6 time 0.014688 [TensorRT] VERBOSE: Tactic: 7 time 0.01472 [TensorRT] VERBOSE: Tactic: 8 time 0.015456 [TensorRT] VERBOSE: Tactic: 9 time 0.015968 [TensorRT] VERBOSE: Tactic: 28 time 0.014368 [TensorRT] VERBOSE: Fastest Tactic: 28 Time: 0.014368 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023552 [TensorRT] VERBOSE: Tactic: 256 time 0.024672 [TensorRT] VERBOSE: Tactic: 512 time 0.025504 [TensorRT] VERBOSE: Tactic: -32 time 0.050624 [TensorRT] VERBOSE: Tactic: -64 time 0.034368 [TensorRT] VERBOSE: Tactic: -128 time 0.032224 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.02256 [TensorRT] VERBOSE: Tactic: 25 time 0.023552 [TensorRT] VERBOSE: Tactic: 26 time 0.023328 [TensorRT] VERBOSE: Tactic: 27 time 0.02256 [TensorRT] VERBOSE: Tactic: 31 time 0.022784 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.02256 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028448 [TensorRT] VERBOSE: Tactic: 256 time 0.027392 [TensorRT] VERBOSE: Tactic: 512 time 0.028512 [TensorRT] VERBOSE: Tactic: -32 time 0.036128 [TensorRT] VERBOSE: Tactic: -64 time 0.039296 [TensorRT] VERBOSE: Tactic: -128 time 0.041984 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027392 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.010144 [TensorRT] VERBOSE: Tactic: 1 time 0.010176 [TensorRT] VERBOSE: Tactic: 2 time 0.010592 [TensorRT] VERBOSE: Tactic: 3 time 0.009184 [TensorRT] VERBOSE: Tactic: 4 time 0.009984 [TensorRT] VERBOSE: Tactic: 5 time 0.011328 [TensorRT] VERBOSE: Tactic: 6 time 0.010688 [TensorRT] VERBOSE: Tactic: 7 time 0.009632 [TensorRT] VERBOSE: Tactic: 8 time 0.009856 [TensorRT] VERBOSE: Tactic: 9 time 0.016544 [TensorRT] VERBOSE: Tactic: 10 time 0.014912 [TensorRT] VERBOSE: Tactic: 11 time 0.01296 [TensorRT] VERBOSE: Tactic: 12 time 0.011392 [TensorRT] VERBOSE: Tactic: 13 time 0.01088 [TensorRT] VERBOSE: Tactic: 14 time 0.011104 [TensorRT] VERBOSE: Tactic: 15 time 0.013056 [TensorRT] VERBOSE: Tactic: 16 time 0.010752 [TensorRT] VERBOSE: Tactic: 17 time 0.009952 [TensorRT] VERBOSE: Tactic: 18 time 0.011392 [TensorRT] VERBOSE: Tactic: 19 time 0.015328 [TensorRT] VERBOSE: Tactic: 20 time 0.021344 [TensorRT] VERBOSE: Tactic: 21 time 0.017216 [TensorRT] VERBOSE: Tactic: 22 time 0.013888 [TensorRT] VERBOSE: Tactic: 23 time 0.012288 [TensorRT] VERBOSE: Tactic: 28 time 0.014944 [TensorRT] VERBOSE: Tactic: 29 time 0.015712 [TensorRT] VERBOSE: Tactic: 30 time 0.020256 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.009184 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028096 [TensorRT] VERBOSE: Tactic: 256 time 0.02768 [TensorRT] VERBOSE: Tactic: 512 time 0.028928 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.02768 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_81, Add_82) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011104 [TensorRT] VERBOSE: Tactic: 11 time 0.010784 [TensorRT] VERBOSE: Tactic: 12 time 0.012096 [TensorRT] VERBOSE: Tactic: 13 time 0.014336 [TensorRT] VERBOSE: Tactic: 14 time 0.011264 [TensorRT] VERBOSE: Tactic: 15 time 0.016128 [TensorRT] VERBOSE: Tactic: 16 time 0.0216 [TensorRT] VERBOSE: Tactic: 17 time 0.017088 [TensorRT] VERBOSE: Tactic: 18 time 0.018016 [TensorRT] VERBOSE: Tactic: 19 time 0.023232 [TensorRT] VERBOSE: Tactic: 20 time 0.011104 [TensorRT] VERBOSE: Tactic: 21 time 0.0096 [TensorRT] VERBOSE: Tactic: 22 time 0.010944 [TensorRT] VERBOSE: Tactic: 23 time 0.013888 [TensorRT] VERBOSE: Tactic: 24 time 0.011872 [TensorRT] VERBOSE: Tactic: 25 time 0.010432 [TensorRT] VERBOSE: Tactic: 26 time 0.009216 [TensorRT] VERBOSE: Tactic: 27 time 0.012224 [TensorRT] VERBOSE: Tactic: 29 time 0.040192 [TensorRT] VERBOSE: Tactic: 30 time 0.022208 [TensorRT] VERBOSE: Tactic: 31 time 0.016352 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.023808 [TensorRT] VERBOSE: Tactic: 0 time 0.0496 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023808 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027136 [TensorRT] VERBOSE: Tactic: 0 time 0.006208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006208 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.024992 [TensorRT] VERBOSE: Tactic: 0 time 0.032768 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024992 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039744 [TensorRT] VERBOSE: Tactic: 0 time 0.02512 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02512 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02736 [TensorRT] VERBOSE: Tactic: 0 time 0.01888 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01888 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026624 [TensorRT] VERBOSE: Tactic: 0 time 0.039456 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026624 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026624 [TensorRT] VERBOSE: Tactic: 0 time 0.008928 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.008928 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025856 [TensorRT] VERBOSE: Tactic: 0 time 0.047296 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025856 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02576 [TensorRT] VERBOSE: Tactic: 0 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007552 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026272 [TensorRT] VERBOSE: Tactic: 0 time 0.016736 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016736 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026144 [TensorRT] VERBOSE: Tactic: 0 time 0.04736 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026144 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026624 [TensorRT] VERBOSE: Tactic: 0 time 0.015584 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015584 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_83 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.020352 [TensorRT] VERBOSE: Tactic: 256 time 0.019456 [TensorRT] VERBOSE: Tactic: 512 time 0.019712 [TensorRT] VERBOSE: Tactic: -32 time 0.043168 [TensorRT] VERBOSE: Tactic: -64 time 0.027168 [TensorRT] VERBOSE: Tactic: -128 time 0.025184 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.019456 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.012288 [TensorRT] VERBOSE: Tactic: 1 time 0.012288 [TensorRT] VERBOSE: Tactic: 2 time 0.011168 [TensorRT] VERBOSE: Tactic: 3 time 0.012352 [TensorRT] VERBOSE: Tactic: 4 time 0.01072 [TensorRT] VERBOSE: Tactic: 5 time 0.011936 [TensorRT] VERBOSE: Tactic: 6 time 0.012192 [TensorRT] VERBOSE: Tactic: 7 time 0.012256 [TensorRT] VERBOSE: Tactic: 8 time 0.011264 [TensorRT] VERBOSE: Tactic: 9 time 0.011904 [TensorRT] VERBOSE: Tactic: 28 time 0.01216 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.01072 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019264 [TensorRT] VERBOSE: Tactic: 256 time 0.020224 [TensorRT] VERBOSE: Tactic: 512 time 0.020224 [TensorRT] VERBOSE: Tactic: -32 time 0.043296 [TensorRT] VERBOSE: Tactic: -64 time 0.027168 [TensorRT] VERBOSE: Tactic: -128 time 0.02608 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014592 [TensorRT] VERBOSE: Tactic: 25 time 0.015232 [TensorRT] VERBOSE: Tactic: 26 time 0.014048 [TensorRT] VERBOSE: Tactic: 27 time 0.014336 [TensorRT] VERBOSE: Tactic: 31 time 0.015904 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.014048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022528 [TensorRT] VERBOSE: Tactic: 256 time 0.021472 [TensorRT] VERBOSE: Tactic: 512 time 0.022368 [TensorRT] VERBOSE: Tactic: -32 time 0.026688 [TensorRT] VERBOSE: Tactic: -64 time 0.029632 [TensorRT] VERBOSE: Tactic: -128 time 0.031168 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021472 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Tactic: 1 time 0.00752 [TensorRT] VERBOSE: Tactic: 2 time 0.00688 [TensorRT] VERBOSE: Tactic: 3 time 0.007168 [TensorRT] VERBOSE: Tactic: 4 time 0.00752 [TensorRT] VERBOSE: Tactic: 5 time 0.00688 [TensorRT] VERBOSE: Tactic: 6 time 0.007776 [TensorRT] VERBOSE: Tactic: 7 time 0.007744 [TensorRT] VERBOSE: Tactic: 8 time 0.009088 [TensorRT] VERBOSE: Tactic: 9 time 0.00832 [TensorRT] VERBOSE: Tactic: 10 time 0.012384 [TensorRT] VERBOSE: Tactic: 11 time 0.01088 [TensorRT] VERBOSE: Tactic: 12 time 0.01008 [TensorRT] VERBOSE: Tactic: 13 time 0.009568 [TensorRT] VERBOSE: Tactic: 14 time 0.009504 [TensorRT] VERBOSE: Tactic: 15 time 0.00848 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.009248 [TensorRT] VERBOSE: Tactic: 19 time 0.008608 [TensorRT] VERBOSE: Tactic: 20 time 0.01872 [TensorRT] VERBOSE: Tactic: 21 time 0.014016 [TensorRT] VERBOSE: Tactic: 22 time 0.010976 [TensorRT] VERBOSE: Tactic: 23 time 0.010976 [TensorRT] VERBOSE: Tactic: 28 time 0.011168 [TensorRT] VERBOSE: Tactic: 29 time 0.013952 [TensorRT] VERBOSE: Tactic: 30 time 0.018656 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.00688 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022208 [TensorRT] VERBOSE: Tactic: 256 time 0.022016 [TensorRT] VERBOSE: Tactic: 512 time 0.021888 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.021888 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_84 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00784 [TensorRT] VERBOSE: Tactic: 11 time 0.007552 [TensorRT] VERBOSE: Tactic: 12 time 0.007968 [TensorRT] VERBOSE: Tactic: 13 time 0.010816 [TensorRT] VERBOSE: Tactic: 14 time 0.0104 [TensorRT] VERBOSE: Tactic: 15 time 0.011136 [TensorRT] VERBOSE: Tactic: 16 time 0.013856 [TensorRT] VERBOSE: Tactic: 17 time 0.013632 [TensorRT] VERBOSE: Tactic: 18 time 0.015456 [TensorRT] VERBOSE: Tactic: 19 time 0.016064 [TensorRT] VERBOSE: Tactic: 20 time 0.007968 [TensorRT] VERBOSE: Tactic: 21 time 0.007712 [TensorRT] VERBOSE: Tactic: 22 time 0.007488 [TensorRT] VERBOSE: Tactic: 23 time 0.01072 [TensorRT] VERBOSE: Tactic: 24 time 0.009408 [TensorRT] VERBOSE: Tactic: 25 time 0.007776 [TensorRT] VERBOSE: Tactic: 26 time 0.007648 [TensorRT] VERBOSE: Tactic: 27 time 0.00768 [TensorRT] VERBOSE: Tactic: 29 time 0.02736 [TensorRT] VERBOSE: Tactic: 30 time 0.015712 [TensorRT] VERBOSE: Tactic: 31 time 0.010848 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.007488 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_85 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_85 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_85 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_85 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_85 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024032 [TensorRT] VERBOSE: Tactic: 256 time 0.025792 [TensorRT] VERBOSE: Tactic: 512 time 0.025088 [TensorRT] VERBOSE: Tactic: -32 time 0.050816 [TensorRT] VERBOSE: Tactic: -64 time 0.033568 [TensorRT] VERBOSE: Tactic: -128 time 0.031648 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.024032 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.0152 [TensorRT] VERBOSE: Tactic: 1 time 0.016192 [TensorRT] VERBOSE: Tactic: 2 time 0.01504 [TensorRT] VERBOSE: Tactic: 3 time 0.01664 [TensorRT] VERBOSE: Tactic: 4 time 0.015168 [TensorRT] VERBOSE: Tactic: 5 time 0.015392 [TensorRT] VERBOSE: Tactic: 6 time 0.015264 [TensorRT] VERBOSE: Tactic: 7 time 0.015296 [TensorRT] VERBOSE: Tactic: 8 time 0.015392 [TensorRT] VERBOSE: Tactic: 9 time 0.015456 [TensorRT] VERBOSE: Tactic: 28 time 0.014848 [TensorRT] VERBOSE: Fastest Tactic: 28 Time: 0.014848 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024192 [TensorRT] VERBOSE: Tactic: 256 time 0.024256 [TensorRT] VERBOSE: Tactic: 512 time 0.025888 [TensorRT] VERBOSE: Tactic: -32 time 0.05296 [TensorRT] VERBOSE: Tactic: -64 time 0.035232 [TensorRT] VERBOSE: Tactic: -128 time 0.032288 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.024192 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.023072 [TensorRT] VERBOSE: Tactic: 25 time 0.022624 [TensorRT] VERBOSE: Tactic: 26 time 0.022016 [TensorRT] VERBOSE: Tactic: 27 time 0.023552 [TensorRT] VERBOSE: Tactic: 31 time 0.02272 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.022016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028512 [TensorRT] VERBOSE: Tactic: 256 time 0.028032 [TensorRT] VERBOSE: Tactic: 512 time 0.02816 [TensorRT] VERBOSE: Tactic: -32 time 0.036352 [TensorRT] VERBOSE: Tactic: -64 time 0.04064 [TensorRT] VERBOSE: Tactic: -128 time 0.041856 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.028032 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01024 [TensorRT] VERBOSE: Tactic: 1 time 0.009728 [TensorRT] VERBOSE: Tactic: 2 time 0.010432 [TensorRT] VERBOSE: Tactic: 3 time 0.009216 [TensorRT] VERBOSE: Tactic: 4 time 0.009728 [TensorRT] VERBOSE: Tactic: 5 time 0.012352 [TensorRT] VERBOSE: Tactic: 6 time 0.010048 [TensorRT] VERBOSE: Tactic: 7 time 0.008992 [TensorRT] VERBOSE: Tactic: 8 time 0.009664 [TensorRT] VERBOSE: Tactic: 9 time 0.01536 [TensorRT] VERBOSE: Tactic: 10 time 0.014208 [TensorRT] VERBOSE: Tactic: 11 time 0.01248 [TensorRT] VERBOSE: Tactic: 12 time 0.011968 [TensorRT] VERBOSE: Tactic: 13 time 0.010912 [TensorRT] VERBOSE: Tactic: 14 time 0.011328 [TensorRT] VERBOSE: Tactic: 15 time 0.012992 [TensorRT] VERBOSE: Tactic: 16 time 0.011264 [TensorRT] VERBOSE: Tactic: 17 time 0.010304 [TensorRT] VERBOSE: Tactic: 18 time 0.012224 [TensorRT] VERBOSE: Tactic: 19 time 0.015232 [TensorRT] VERBOSE: Tactic: 20 time 0.021088 [TensorRT] VERBOSE: Tactic: 21 time 0.016864 [TensorRT] VERBOSE: Tactic: 22 time 0.013088 [TensorRT] VERBOSE: Tactic: 23 time 0.011648 [TensorRT] VERBOSE: Tactic: 28 time 0.015328 [TensorRT] VERBOSE: Tactic: 29 time 0.016032 [TensorRT] VERBOSE: Tactic: 30 time 0.020416 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.008992 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028032 [TensorRT] VERBOSE: Tactic: 256 time 0.026848 [TensorRT] VERBOSE: Tactic: 512 time 0.028448 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.026848 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_86, Add_87) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011584 [TensorRT] VERBOSE: Tactic: 11 time 0.0112 [TensorRT] VERBOSE: Tactic: 12 time 0.012288 [TensorRT] VERBOSE: Tactic: 13 time 0.01376 [TensorRT] VERBOSE: Tactic: 14 time 0.011328 [TensorRT] VERBOSE: Tactic: 15 time 0.0168 [TensorRT] VERBOSE: Tactic: 16 time 0.022048 [TensorRT] VERBOSE: Tactic: 17 time 0.017152 [TensorRT] VERBOSE: Tactic: 18 time 0.018144 [TensorRT] VERBOSE: Tactic: 19 time 0.023616 [TensorRT] VERBOSE: Tactic: 20 time 0.011008 [TensorRT] VERBOSE: Tactic: 21 time 0.009664 [TensorRT] VERBOSE: Tactic: 22 time 0.01072 [TensorRT] VERBOSE: Tactic: 23 time 0.014112 [TensorRT] VERBOSE: Tactic: 24 time 0.01072 [TensorRT] VERBOSE: Tactic: 25 time 0.009728 [TensorRT] VERBOSE: Tactic: 26 time 0.00944 [TensorRT] VERBOSE: Tactic: 27 time 0.012416 [TensorRT] VERBOSE: Tactic: 29 time 0.040448 [TensorRT] VERBOSE: Tactic: 30 time 0.022688 [TensorRT] VERBOSE: Tactic: 31 time 0.01616 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.00944 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_88 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019168 [TensorRT] VERBOSE: Tactic: 256 time 0.019296 [TensorRT] VERBOSE: Tactic: 512 time 0.019808 [TensorRT] VERBOSE: Tactic: -32 time 0.044064 [TensorRT] VERBOSE: Tactic: -64 time 0.027648 [TensorRT] VERBOSE: Tactic: -128 time 0.027392 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019168 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01232 [TensorRT] VERBOSE: Tactic: 1 time 0.012288 [TensorRT] VERBOSE: Tactic: 2 time 0.011136 [TensorRT] VERBOSE: Tactic: 3 time 0.012832 [TensorRT] VERBOSE: Tactic: 4 time 0.010976 [TensorRT] VERBOSE: Tactic: 5 time 0.011872 [TensorRT] VERBOSE: Tactic: 6 time 0.012448 [TensorRT] VERBOSE: Tactic: 7 time 0.01216 [TensorRT] VERBOSE: Tactic: 8 time 0.01056 [TensorRT] VERBOSE: Tactic: 9 time 0.012128 [TensorRT] VERBOSE: Tactic: 28 time 0.01216 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.01056 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.018752 [TensorRT] VERBOSE: Tactic: 256 time 0.0192 [TensorRT] VERBOSE: Tactic: 512 time 0.02 [TensorRT] VERBOSE: Tactic: -32 time 0.043904 [TensorRT] VERBOSE: Tactic: -64 time 0.026656 [TensorRT] VERBOSE: Tactic: -128 time 0.026048 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.018752 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.015008 [TensorRT] VERBOSE: Tactic: 25 time 0.01536 [TensorRT] VERBOSE: Tactic: 26 time 0.01392 [TensorRT] VERBOSE: Tactic: 27 time 0.014144 [TensorRT] VERBOSE: Tactic: 31 time 0.015168 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.01392 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023712 [TensorRT] VERBOSE: Tactic: 256 time 0.021792 [TensorRT] VERBOSE: Tactic: 512 time 0.02224 [TensorRT] VERBOSE: Tactic: -32 time 0.026688 [TensorRT] VERBOSE: Tactic: -64 time 0.029568 [TensorRT] VERBOSE: Tactic: -128 time 0.031264 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021792 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Tactic: 1 time 0.007584 [TensorRT] VERBOSE: Tactic: 2 time 0.007168 [TensorRT] VERBOSE: Tactic: 3 time 0.00768 [TensorRT] VERBOSE: Tactic: 4 time 0.007616 [TensorRT] VERBOSE: Tactic: 5 time 0.008128 [TensorRT] VERBOSE: Tactic: 6 time 0.007552 [TensorRT] VERBOSE: Tactic: 7 time 0.007776 [TensorRT] VERBOSE: Tactic: 8 time 0.009312 [TensorRT] VERBOSE: Tactic: 9 time 0.008576 [TensorRT] VERBOSE: Tactic: 10 time 0.012704 [TensorRT] VERBOSE: Tactic: 11 time 0.010784 [TensorRT] VERBOSE: Tactic: 12 time 0.009216 [TensorRT] VERBOSE: Tactic: 13 time 0.009504 [TensorRT] VERBOSE: Tactic: 14 time 0.0096 [TensorRT] VERBOSE: Tactic: 15 time 0.008192 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009312 [TensorRT] VERBOSE: Tactic: 18 time 0.008032 [TensorRT] VERBOSE: Tactic: 19 time 0.008448 [TensorRT] VERBOSE: Tactic: 20 time 0.018784 [TensorRT] VERBOSE: Tactic: 21 time 0.013888 [TensorRT] VERBOSE: Tactic: 22 time 0.011168 [TensorRT] VERBOSE: Tactic: 23 time 0.010688 [TensorRT] VERBOSE: Tactic: 28 time 0.011232 [TensorRT] VERBOSE: Tactic: 29 time 0.012384 [TensorRT] VERBOSE: Tactic: 30 time 0.019072 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.007168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022112 [TensorRT] VERBOSE: Tactic: 256 time 0.02176 [TensorRT] VERBOSE: Tactic: 512 time 0.021504 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.021504 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_89 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007872 [TensorRT] VERBOSE: Tactic: 11 time 0.007584 [TensorRT] VERBOSE: Tactic: 12 time 0.007936 [TensorRT] VERBOSE: Tactic: 13 time 0.010624 [TensorRT] VERBOSE: Tactic: 14 time 0.009152 [TensorRT] VERBOSE: Tactic: 15 time 0.010624 [TensorRT] VERBOSE: Tactic: 16 time 0.013728 [TensorRT] VERBOSE: Tactic: 17 time 0.013632 [TensorRT] VERBOSE: Tactic: 18 time 0.014336 [TensorRT] VERBOSE: Tactic: 19 time 0.016064 [TensorRT] VERBOSE: Tactic: 20 time 0.008096 [TensorRT] VERBOSE: Tactic: 21 time 0.007648 [TensorRT] VERBOSE: Tactic: 22 time 0.007456 [TensorRT] VERBOSE: Tactic: 23 time 0.010592 [TensorRT] VERBOSE: Tactic: 24 time 0.009408 [TensorRT] VERBOSE: Tactic: 25 time 0.008192 [TensorRT] VERBOSE: Tactic: 26 time 0.007328 [TensorRT] VERBOSE: Tactic: 27 time 0.009088 [TensorRT] VERBOSE: Tactic: 29 time 0.027104 [TensorRT] VERBOSE: Tactic: 30 time 0.016384 [TensorRT] VERBOSE: Tactic: 31 time 0.011264 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.007328 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_90 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_90 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_90 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_90 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_90 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023712 [TensorRT] VERBOSE: Tactic: 256 time 0.023648 [TensorRT] VERBOSE: Tactic: 512 time 0.025408 [TensorRT] VERBOSE: Tactic: -32 time 0.052768 [TensorRT] VERBOSE: Tactic: -64 time 0.035584 [TensorRT] VERBOSE: Tactic: -128 time 0.032 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.023648 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01536 [TensorRT] VERBOSE: Tactic: 1 time 0.01536 [TensorRT] VERBOSE: Tactic: 2 time 0.01504 [TensorRT] VERBOSE: Tactic: 3 time 0.015936 [TensorRT] VERBOSE: Tactic: 4 time 0.01536 [TensorRT] VERBOSE: Tactic: 5 time 0.0152 [TensorRT] VERBOSE: Tactic: 6 time 0.016256 [TensorRT] VERBOSE: Tactic: 7 time 0.014912 [TensorRT] VERBOSE: Tactic: 8 time 0.015904 [TensorRT] VERBOSE: Tactic: 9 time 0.015168 [TensorRT] VERBOSE: Tactic: 28 time 0.01584 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.014912 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023744 [TensorRT] VERBOSE: Tactic: 256 time 0.023744 [TensorRT] VERBOSE: Tactic: 512 time 0.025504 [TensorRT] VERBOSE: Tactic: -32 time 0.051968 [TensorRT] VERBOSE: Tactic: -64 time 0.034304 [TensorRT] VERBOSE: Tactic: -128 time 0.031424 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023744 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.02224 [TensorRT] VERBOSE: Tactic: 25 time 0.022528 [TensorRT] VERBOSE: Tactic: 26 time 0.024128 [TensorRT] VERBOSE: Tactic: 27 time 0.022048 [TensorRT] VERBOSE: Tactic: 31 time 0.02256 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.022048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028384 [TensorRT] VERBOSE: Tactic: 256 time 0.027968 [TensorRT] VERBOSE: Tactic: 512 time 0.028224 [TensorRT] VERBOSE: Tactic: -32 time 0.035552 [TensorRT] VERBOSE: Tactic: -64 time 0.039232 [TensorRT] VERBOSE: Tactic: -128 time 0.041376 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027968 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.010368 [TensorRT] VERBOSE: Tactic: 1 time 0.009248 [TensorRT] VERBOSE: Tactic: 2 time 0.010624 [TensorRT] VERBOSE: Tactic: 3 time 0.00928 [TensorRT] VERBOSE: Tactic: 4 time 0.009216 [TensorRT] VERBOSE: Tactic: 5 time 0.012288 [TensorRT] VERBOSE: Tactic: 6 time 0.010688 [TensorRT] VERBOSE: Tactic: 7 time 0.009216 [TensorRT] VERBOSE: Tactic: 8 time 0.009984 [TensorRT] VERBOSE: Tactic: 9 time 0.017024 [TensorRT] VERBOSE: Tactic: 10 time 0.015424 [TensorRT] VERBOSE: Tactic: 11 time 0.01232 [TensorRT] VERBOSE: Tactic: 12 time 0.012032 [TensorRT] VERBOSE: Tactic: 13 time 0.010592 [TensorRT] VERBOSE: Tactic: 14 time 0.011296 [TensorRT] VERBOSE: Tactic: 15 time 0.012576 [TensorRT] VERBOSE: Tactic: 16 time 0.01088 [TensorRT] VERBOSE: Tactic: 17 time 0.010752 [TensorRT] VERBOSE: Tactic: 18 time 0.012 [TensorRT] VERBOSE: Tactic: 19 time 0.01488 [TensorRT] VERBOSE: Tactic: 20 time 0.020704 [TensorRT] VERBOSE: Tactic: 21 time 0.016992 [TensorRT] VERBOSE: Tactic: 22 time 0.013824 [TensorRT] VERBOSE: Tactic: 23 time 0.012128 [TensorRT] VERBOSE: Tactic: 28 time 0.014752 [TensorRT] VERBOSE: Tactic: 29 time 0.015584 [TensorRT] VERBOSE: Tactic: 30 time 0.020576 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028032 [TensorRT] VERBOSE: Tactic: 256 time 0.027488 [TensorRT] VERBOSE: Tactic: 512 time 0.02816 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027488 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_91, Add_92) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011264 [TensorRT] VERBOSE: Tactic: 11 time 0.011072 [TensorRT] VERBOSE: Tactic: 12 time 0.011808 [TensorRT] VERBOSE: Tactic: 13 time 0.013888 [TensorRT] VERBOSE: Tactic: 14 time 0.011232 [TensorRT] VERBOSE: Tactic: 15 time 0.015456 [TensorRT] VERBOSE: Tactic: 16 time 0.020704 [TensorRT] VERBOSE: Tactic: 17 time 0.01696 [TensorRT] VERBOSE: Tactic: 18 time 0.017504 [TensorRT] VERBOSE: Tactic: 19 time 0.023552 [TensorRT] VERBOSE: Tactic: 20 time 0.011136 [TensorRT] VERBOSE: Tactic: 21 time 0.009568 [TensorRT] VERBOSE: Tactic: 22 time 0.010912 [TensorRT] VERBOSE: Tactic: 23 time 0.01392 [TensorRT] VERBOSE: Tactic: 24 time 0.010656 [TensorRT] VERBOSE: Tactic: 25 time 0.01024 [TensorRT] VERBOSE: Tactic: 26 time 0.00912 [TensorRT] VERBOSE: Tactic: 27 time 0.012288 [TensorRT] VERBOSE: Tactic: 29 time 0.039616 [TensorRT] VERBOSE: Tactic: 30 time 0.022656 [TensorRT] VERBOSE: Tactic: 31 time 0.016352 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.00912 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_93 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.018816 [TensorRT] VERBOSE: Tactic: 256 time 0.019456 [TensorRT] VERBOSE: Tactic: 512 time 0.019456 [TensorRT] VERBOSE: Tactic: -32 time 0.044672 [TensorRT] VERBOSE: Tactic: -64 time 0.027424 [TensorRT] VERBOSE: Tactic: -128 time 0.026208 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.018816 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01328 [TensorRT] VERBOSE: Tactic: 1 time 0.012288 [TensorRT] VERBOSE: Tactic: 2 time 0.011296 [TensorRT] VERBOSE: Tactic: 3 time 0.012576 [TensorRT] VERBOSE: Tactic: 4 time 0.011456 [TensorRT] VERBOSE: Tactic: 5 time 0.010752 [TensorRT] VERBOSE: Tactic: 6 time 0.013024 [TensorRT] VERBOSE: Tactic: 7 time 0.011264 [TensorRT] VERBOSE: Tactic: 8 time 0.0112 [TensorRT] VERBOSE: Tactic: 9 time 0.01184 [TensorRT] VERBOSE: Tactic: 28 time 0.013312 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.010752 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019264 [TensorRT] VERBOSE: Tactic: 256 time 0.0192 [TensorRT] VERBOSE: Tactic: 512 time 0.02016 [TensorRT] VERBOSE: Tactic: -32 time 0.04288 [TensorRT] VERBOSE: Tactic: -64 time 0.027968 [TensorRT] VERBOSE: Tactic: -128 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.0192 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014496 [TensorRT] VERBOSE: Tactic: 25 time 0.014688 [TensorRT] VERBOSE: Tactic: 26 time 0.014272 [TensorRT] VERBOSE: Tactic: 27 time 0.014336 [TensorRT] VERBOSE: Tactic: 31 time 0.015936 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.014272 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023616 [TensorRT] VERBOSE: Tactic: 256 time 0.021216 [TensorRT] VERBOSE: Tactic: 512 time 0.021888 [TensorRT] VERBOSE: Tactic: -32 time 0.026144 [TensorRT] VERBOSE: Tactic: -64 time 0.029312 [TensorRT] VERBOSE: Tactic: -128 time 0.031776 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021216 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009248 [TensorRT] VERBOSE: Tactic: 1 time 0.0072 [TensorRT] VERBOSE: Tactic: 2 time 0.007168 [TensorRT] VERBOSE: Tactic: 3 time 0.00752 [TensorRT] VERBOSE: Tactic: 4 time 0.007648 [TensorRT] VERBOSE: Tactic: 5 time 0.007168 [TensorRT] VERBOSE: Tactic: 6 time 0.007712 [TensorRT] VERBOSE: Tactic: 7 time 0.007872 [TensorRT] VERBOSE: Tactic: 8 time 0.00928 [TensorRT] VERBOSE: Tactic: 9 time 0.008128 [TensorRT] VERBOSE: Tactic: 10 time 0.012704 [TensorRT] VERBOSE: Tactic: 11 time 0.009856 [TensorRT] VERBOSE: Tactic: 12 time 0.009632 [TensorRT] VERBOSE: Tactic: 13 time 0.009088 [TensorRT] VERBOSE: Tactic: 14 time 0.009408 [TensorRT] VERBOSE: Tactic: 15 time 0.008352 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009184 [TensorRT] VERBOSE: Tactic: 18 time 0.009408 [TensorRT] VERBOSE: Tactic: 19 time 0.008192 [TensorRT] VERBOSE: Tactic: 20 time 0.018688 [TensorRT] VERBOSE: Tactic: 21 time 0.014112 [TensorRT] VERBOSE: Tactic: 22 time 0.010752 [TensorRT] VERBOSE: Tactic: 23 time 0.010624 [TensorRT] VERBOSE: Tactic: 28 time 0.010848 [TensorRT] VERBOSE: Tactic: 29 time 0.012608 [TensorRT] VERBOSE: Tactic: 30 time 0.018656 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.007168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022528 [TensorRT] VERBOSE: Tactic: 256 time 0.021248 [TensorRT] VERBOSE: Tactic: 512 time 0.021824 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021248 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_94 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.008032 [TensorRT] VERBOSE: Tactic: 11 time 0.00752 [TensorRT] VERBOSE: Tactic: 12 time 0.00784 [TensorRT] VERBOSE: Tactic: 13 time 0.009312 [TensorRT] VERBOSE: Tactic: 14 time 0.009728 [TensorRT] VERBOSE: Tactic: 15 time 0.011232 [TensorRT] VERBOSE: Tactic: 16 time 0.01392 [TensorRT] VERBOSE: Tactic: 17 time 0.01408 [TensorRT] VERBOSE: Tactic: 18 time 0.015456 [TensorRT] VERBOSE: Tactic: 19 time 0.015648 [TensorRT] VERBOSE: Tactic: 20 time 0.008 [TensorRT] VERBOSE: Tactic: 21 time 0.007616 [TensorRT] VERBOSE: Tactic: 22 time 0.007392 [TensorRT] VERBOSE: Tactic: 23 time 0.010592 [TensorRT] VERBOSE: Tactic: 24 time 0.009216 [TensorRT] VERBOSE: Tactic: 25 time 0.007616 [TensorRT] VERBOSE: Tactic: 26 time 0.007584 [TensorRT] VERBOSE: Tactic: 27 time 0.009216 [TensorRT] VERBOSE: Tactic: 29 time 0.026752 [TensorRT] VERBOSE: Tactic: 30 time 0.01632 [TensorRT] VERBOSE: Tactic: 31 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.007392 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_95 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_95 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_95 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_95 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_95 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023552 [TensorRT] VERBOSE: Tactic: 256 time 0.023424 [TensorRT] VERBOSE: Tactic: 512 time 0.024576 [TensorRT] VERBOSE: Tactic: -32 time 0.051296 [TensorRT] VERBOSE: Tactic: -64 time 0.034624 [TensorRT] VERBOSE: Tactic: -128 time 0.032544 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.023424 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014368 [TensorRT] VERBOSE: Tactic: 1 time 0.014592 [TensorRT] VERBOSE: Tactic: 2 time 0.015232 [TensorRT] VERBOSE: Tactic: 3 time 0.015168 [TensorRT] VERBOSE: Tactic: 4 time 0.014528 [TensorRT] VERBOSE: Tactic: 5 time 0.014112 [TensorRT] VERBOSE: Tactic: 6 time 0.015936 [TensorRT] VERBOSE: Tactic: 7 time 0.015168 [TensorRT] VERBOSE: Tactic: 8 time 0.015648 [TensorRT] VERBOSE: Tactic: 9 time 0.015296 [TensorRT] VERBOSE: Tactic: 28 time 0.014464 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.014112 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023744 [TensorRT] VERBOSE: Tactic: 256 time 0.02416 [TensorRT] VERBOSE: Tactic: 512 time 0.025024 [TensorRT] VERBOSE: Tactic: -32 time 0.052 [TensorRT] VERBOSE: Tactic: -64 time 0.033728 [TensorRT] VERBOSE: Tactic: -128 time 0.031136 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023744 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.022336 [TensorRT] VERBOSE: Tactic: 25 time 0.022528 [TensorRT] VERBOSE: Tactic: 26 time 0.023776 [TensorRT] VERBOSE: Tactic: 27 time 0.023808 [TensorRT] VERBOSE: Tactic: 31 time 0.02272 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.022336 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028032 [TensorRT] VERBOSE: Tactic: 256 time 0.02704 [TensorRT] VERBOSE: Tactic: 512 time 0.027968 [TensorRT] VERBOSE: Tactic: -32 time 0.036288 [TensorRT] VERBOSE: Tactic: -64 time 0.039808 [TensorRT] VERBOSE: Tactic: -128 time 0.042144 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.02704 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.011776 [TensorRT] VERBOSE: Tactic: 1 time 0.00928 [TensorRT] VERBOSE: Tactic: 2 time 0.010304 [TensorRT] VERBOSE: Tactic: 3 time 0.009408 [TensorRT] VERBOSE: Tactic: 4 time 0.009728 [TensorRT] VERBOSE: Tactic: 5 time 0.012288 [TensorRT] VERBOSE: Tactic: 6 time 0.01088 [TensorRT] VERBOSE: Tactic: 7 time 0.00848 [TensorRT] VERBOSE: Tactic: 8 time 0.009568 [TensorRT] VERBOSE: Tactic: 9 time 0.016384 [TensorRT] VERBOSE: Tactic: 10 time 0.01536 [TensorRT] VERBOSE: Tactic: 11 time 0.012448 [TensorRT] VERBOSE: Tactic: 12 time 0.012704 [TensorRT] VERBOSE: Tactic: 13 time 0.010752 [TensorRT] VERBOSE: Tactic: 14 time 0.011264 [TensorRT] VERBOSE: Tactic: 15 time 0.012768 [TensorRT] VERBOSE: Tactic: 16 time 0.010912 [TensorRT] VERBOSE: Tactic: 17 time 0.010752 [TensorRT] VERBOSE: Tactic: 18 time 0.012576 [TensorRT] VERBOSE: Tactic: 19 time 0.015328 [TensorRT] VERBOSE: Tactic: 20 time 0.020608 [TensorRT] VERBOSE: Tactic: 21 time 0.017312 [TensorRT] VERBOSE: Tactic: 22 time 0.013952 [TensorRT] VERBOSE: Tactic: 23 time 0.012384 [TensorRT] VERBOSE: Tactic: 28 time 0.01536 [TensorRT] VERBOSE: Tactic: 29 time 0.015968 [TensorRT] VERBOSE: Tactic: 30 time 0.02064 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.00848 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02816 [TensorRT] VERBOSE: Tactic: 256 time 0.026752 [TensorRT] VERBOSE: Tactic: 512 time 0.028288 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.026752 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_96, Add_97) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011648 [TensorRT] VERBOSE: Tactic: 11 time 0.010816 [TensorRT] VERBOSE: Tactic: 12 time 0.012032 [TensorRT] VERBOSE: Tactic: 13 time 0.013792 [TensorRT] VERBOSE: Tactic: 14 time 0.012032 [TensorRT] VERBOSE: Tactic: 15 time 0.016416 [TensorRT] VERBOSE: Tactic: 16 time 0.021504 [TensorRT] VERBOSE: Tactic: 17 time 0.01712 [TensorRT] VERBOSE: Tactic: 18 time 0.018112 [TensorRT] VERBOSE: Tactic: 19 time 0.022944 [TensorRT] VERBOSE: Tactic: 20 time 0.01072 [TensorRT] VERBOSE: Tactic: 21 time 0.009472 [TensorRT] VERBOSE: Tactic: 22 time 0.01072 [TensorRT] VERBOSE: Tactic: 23 time 0.014112 [TensorRT] VERBOSE: Tactic: 24 time 0.01088 [TensorRT] VERBOSE: Tactic: 25 time 0.011328 [TensorRT] VERBOSE: Tactic: 26 time 0.010176 [TensorRT] VERBOSE: Tactic: 27 time 0.012512 [TensorRT] VERBOSE: Tactic: 29 time 0.039488 [TensorRT] VERBOSE: Tactic: 30 time 0.022528 [TensorRT] VERBOSE: Tactic: 31 time 0.015744 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.009472 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_98 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019264 [TensorRT] VERBOSE: Tactic: 256 time 0.019776 [TensorRT] VERBOSE: Tactic: 512 time 0.01984 [TensorRT] VERBOSE: Tactic: -32 time 0.043904 [TensorRT] VERBOSE: Tactic: -64 time 0.026624 [TensorRT] VERBOSE: Tactic: -128 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.012576 [TensorRT] VERBOSE: Tactic: 1 time 0.012992 [TensorRT] VERBOSE: Tactic: 2 time 0.011264 [TensorRT] VERBOSE: Tactic: 3 time 0.012256 [TensorRT] VERBOSE: Tactic: 4 time 0.011264 [TensorRT] VERBOSE: Tactic: 5 time 0.011648 [TensorRT] VERBOSE: Tactic: 6 time 0.01184 [TensorRT] VERBOSE: Tactic: 7 time 0.012288 [TensorRT] VERBOSE: Tactic: 8 time 0.011104 [TensorRT] VERBOSE: Tactic: 9 time 0.012192 [TensorRT] VERBOSE: Tactic: 28 time 0.012928 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.011104 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019328 [TensorRT] VERBOSE: Tactic: 256 time 0.01984 [TensorRT] VERBOSE: Tactic: 512 time 0.019712 [TensorRT] VERBOSE: Tactic: -32 time 0.043872 [TensorRT] VERBOSE: Tactic: -64 time 0.028736 [TensorRT] VERBOSE: Tactic: -128 time 0.025312 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019328 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014272 [TensorRT] VERBOSE: Tactic: 25 time 0.014976 [TensorRT] VERBOSE: Tactic: 26 time 0.015008 [TensorRT] VERBOSE: Tactic: 27 time 0.014272 [TensorRT] VERBOSE: Tactic: 31 time 0.01536 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.014272 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023552 [TensorRT] VERBOSE: Tactic: 256 time 0.020832 [TensorRT] VERBOSE: Tactic: 512 time 0.022208 [TensorRT] VERBOSE: Tactic: -32 time 0.026112 [TensorRT] VERBOSE: Tactic: -64 time 0.029504 [TensorRT] VERBOSE: Tactic: -128 time 0.03088 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.020832 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Tactic: 1 time 0.007616 [TensorRT] VERBOSE: Tactic: 2 time 0.007936 [TensorRT] VERBOSE: Tactic: 3 time 0.007552 [TensorRT] VERBOSE: Tactic: 4 time 0.00768 [TensorRT] VERBOSE: Tactic: 5 time 0.00704 [TensorRT] VERBOSE: Tactic: 6 time 0.00736 [TensorRT] VERBOSE: Tactic: 7 time 0.008192 [TensorRT] VERBOSE: Tactic: 8 time 0.009216 [TensorRT] VERBOSE: Tactic: 9 time 0.008192 [TensorRT] VERBOSE: Tactic: 10 time 0.012096 [TensorRT] VERBOSE: Tactic: 11 time 0.009856 [TensorRT] VERBOSE: Tactic: 12 time 0.009728 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.008192 [TensorRT] VERBOSE: Tactic: 16 time 0.009312 [TensorRT] VERBOSE: Tactic: 17 time 0.009248 [TensorRT] VERBOSE: Tactic: 18 time 0.008896 [TensorRT] VERBOSE: Tactic: 19 time 0.008416 [TensorRT] VERBOSE: Tactic: 20 time 0.018912 [TensorRT] VERBOSE: Tactic: 21 time 0.014048 [TensorRT] VERBOSE: Tactic: 22 time 0.010784 [TensorRT] VERBOSE: Tactic: 23 time 0.010848 [TensorRT] VERBOSE: Tactic: 28 time 0.01104 [TensorRT] VERBOSE: Tactic: 29 time 0.01296 [TensorRT] VERBOSE: Tactic: 30 time 0.01856 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.00704 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0232 [TensorRT] VERBOSE: Tactic: 256 time 0.021152 [TensorRT] VERBOSE: Tactic: 512 time 0.02224 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021152 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_99 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007584 [TensorRT] VERBOSE: Tactic: 11 time 0.00864 [TensorRT] VERBOSE: Tactic: 12 time 0.008096 [TensorRT] VERBOSE: Tactic: 13 time 0.009984 [TensorRT] VERBOSE: Tactic: 14 time 0.009024 [TensorRT] VERBOSE: Tactic: 15 time 0.011232 [TensorRT] VERBOSE: Tactic: 16 time 0.013952 [TensorRT] VERBOSE: Tactic: 17 time 0.013152 [TensorRT] VERBOSE: Tactic: 18 time 0.015424 [TensorRT] VERBOSE: Tactic: 19 time 0.015712 [TensorRT] VERBOSE: Tactic: 20 time 0.007936 [TensorRT] VERBOSE: Tactic: 21 time 0.007616 [TensorRT] VERBOSE: Tactic: 22 time 0.007424 [TensorRT] VERBOSE: Tactic: 23 time 0.01056 [TensorRT] VERBOSE: Tactic: 24 time 0.008608 [TensorRT] VERBOSE: Tactic: 25 time 0.007616 [TensorRT] VERBOSE: Tactic: 26 time 0.007552 [TensorRT] VERBOSE: Tactic: 27 time 0.009184 [TensorRT] VERBOSE: Tactic: 29 time 0.0272 [TensorRT] VERBOSE: Tactic: 30 time 0.015488 [TensorRT] VERBOSE: Tactic: 31 time 0.011392 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.007424 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_100 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_100 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_100 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_100 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_100 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023872 [TensorRT] VERBOSE: Tactic: 256 time 0.023904 [TensorRT] VERBOSE: Tactic: 512 time 0.025152 [TensorRT] VERBOSE: Tactic: -32 time 0.051968 [TensorRT] VERBOSE: Tactic: -64 time 0.03376 [TensorRT] VERBOSE: Tactic: -128 time 0.032 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023872 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014368 [TensorRT] VERBOSE: Tactic: 1 time 0.015776 [TensorRT] VERBOSE: Tactic: 2 time 0.014688 [TensorRT] VERBOSE: Tactic: 3 time 0.015552 [TensorRT] VERBOSE: Tactic: 4 time 0.014592 [TensorRT] VERBOSE: Tactic: 5 time 0.015072 [TensorRT] VERBOSE: Tactic: 6 time 0.01536 [TensorRT] VERBOSE: Tactic: 7 time 0.014816 [TensorRT] VERBOSE: Tactic: 8 time 0.01568 [TensorRT] VERBOSE: Tactic: 9 time 0.015904 [TensorRT] VERBOSE: Tactic: 28 time 0.014624 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014368 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.024544 [TensorRT] VERBOSE: Tactic: 256 time 0.024768 [TensorRT] VERBOSE: Tactic: 512 time 0.025184 [TensorRT] VERBOSE: Tactic: -32 time 0.051552 [TensorRT] VERBOSE: Tactic: -64 time 0.035616 [TensorRT] VERBOSE: Tactic: -128 time 0.031392 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.024544 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.023008 [TensorRT] VERBOSE: Tactic: 25 time 0.023104 [TensorRT] VERBOSE: Tactic: 26 time 0.022464 [TensorRT] VERBOSE: Tactic: 27 time 0.023008 [TensorRT] VERBOSE: Tactic: 31 time 0.022528 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.022464 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028448 [TensorRT] VERBOSE: Tactic: 256 time 0.026912 [TensorRT] VERBOSE: Tactic: 512 time 0.028544 [TensorRT] VERBOSE: Tactic: -32 time 0.03584 [TensorRT] VERBOSE: Tactic: -64 time 0.039936 [TensorRT] VERBOSE: Tactic: -128 time 0.041376 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.026912 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01024 [TensorRT] VERBOSE: Tactic: 1 time 0.010144 [TensorRT] VERBOSE: Tactic: 2 time 0.010784 [TensorRT] VERBOSE: Tactic: 3 time 0.009312 [TensorRT] VERBOSE: Tactic: 4 time 0.009504 [TensorRT] VERBOSE: Tactic: 5 time 0.011776 [TensorRT] VERBOSE: Tactic: 6 time 0.010784 [TensorRT] VERBOSE: Tactic: 7 time 0.009216 [TensorRT] VERBOSE: Tactic: 8 time 0.009888 [TensorRT] VERBOSE: Tactic: 9 time 0.017152 [TensorRT] VERBOSE: Tactic: 10 time 0.01472 [TensorRT] VERBOSE: Tactic: 11 time 0.012512 [TensorRT] VERBOSE: Tactic: 12 time 0.011904 [TensorRT] VERBOSE: Tactic: 13 time 0.010944 [TensorRT] VERBOSE: Tactic: 14 time 0.011552 [TensorRT] VERBOSE: Tactic: 15 time 0.012992 [TensorRT] VERBOSE: Tactic: 16 time 0.010496 [TensorRT] VERBOSE: Tactic: 17 time 0.010816 [TensorRT] VERBOSE: Tactic: 18 time 0.011456 [TensorRT] VERBOSE: Tactic: 19 time 0.014752 [TensorRT] VERBOSE: Tactic: 20 time 0.021088 [TensorRT] VERBOSE: Tactic: 21 time 0.01696 [TensorRT] VERBOSE: Tactic: 22 time 0.013792 [TensorRT] VERBOSE: Tactic: 23 time 0.012416 [TensorRT] VERBOSE: Tactic: 28 time 0.014944 [TensorRT] VERBOSE: Tactic: 29 time 0.01568 [TensorRT] VERBOSE: Tactic: 30 time 0.020448 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028416 [TensorRT] VERBOSE: Tactic: 256 time 0.028128 [TensorRT] VERBOSE: Tactic: 512 time 0.02848 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.028128 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_101, Add_102) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.012 [TensorRT] VERBOSE: Tactic: 11 time 0.0112 [TensorRT] VERBOSE: Tactic: 12 time 0.011968 [TensorRT] VERBOSE: Tactic: 13 time 0.013856 [TensorRT] VERBOSE: Tactic: 14 time 0.011456 [TensorRT] VERBOSE: Tactic: 15 time 0.016384 [TensorRT] VERBOSE: Tactic: 16 time 0.021568 [TensorRT] VERBOSE: Tactic: 17 time 0.017184 [TensorRT] VERBOSE: Tactic: 18 time 0.018176 [TensorRT] VERBOSE: Tactic: 19 time 0.024128 [TensorRT] VERBOSE: Tactic: 20 time 0.010752 [TensorRT] VERBOSE: Tactic: 21 time 0.009824 [TensorRT] VERBOSE: Tactic: 22 time 0.010848 [TensorRT] VERBOSE: Tactic: 23 time 0.01376 [TensorRT] VERBOSE: Tactic: 24 time 0.010592 [TensorRT] VERBOSE: Tactic: 25 time 0.011552 [TensorRT] VERBOSE: Tactic: 26 time 0.009984 [TensorRT] VERBOSE: Tactic: 27 time 0.012288 [TensorRT] VERBOSE: Tactic: 29 time 0.040224 [TensorRT] VERBOSE: Tactic: 30 time 0.02256 [TensorRT] VERBOSE: Tactic: 31 time 0.015936 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.009824 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_103 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01952 [TensorRT] VERBOSE: Tactic: 256 time 0.019552 [TensorRT] VERBOSE: Tactic: 512 time 0.020064 [TensorRT] VERBOSE: Tactic: -32 time 0.0432 [TensorRT] VERBOSE: Tactic: -64 time 0.026624 [TensorRT] VERBOSE: Tactic: -128 time 0.025728 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01952 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.012768 [TensorRT] VERBOSE: Tactic: 1 time 0.012064 [TensorRT] VERBOSE: Tactic: 2 time 0.011168 [TensorRT] VERBOSE: Tactic: 3 time 0.013312 [TensorRT] VERBOSE: Tactic: 4 time 0.010976 [TensorRT] VERBOSE: Tactic: 5 time 0.012192 [TensorRT] VERBOSE: Tactic: 6 time 0.012288 [TensorRT] VERBOSE: Tactic: 7 time 0.010976 [TensorRT] VERBOSE: Tactic: 8 time 0.011168 [TensorRT] VERBOSE: Tactic: 9 time 0.012128 [TensorRT] VERBOSE: Tactic: 28 time 0.01216 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.010976 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019328 [TensorRT] VERBOSE: Tactic: 256 time 0.018944 [TensorRT] VERBOSE: Tactic: 512 time 0.019456 [TensorRT] VERBOSE: Tactic: -32 time 0.042752 [TensorRT] VERBOSE: Tactic: -64 time 0.02752 [TensorRT] VERBOSE: Tactic: -128 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.018944 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.015296 [TensorRT] VERBOSE: Tactic: 25 time 0.01536 [TensorRT] VERBOSE: Tactic: 26 time 0.014816 [TensorRT] VERBOSE: Tactic: 27 time 0.014336 [TensorRT] VERBOSE: Tactic: 31 time 0.014368 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.014336 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023264 [TensorRT] VERBOSE: Tactic: 256 time 0.021472 [TensorRT] VERBOSE: Tactic: 512 time 0.022304 [TensorRT] VERBOSE: Tactic: -32 time 0.026624 [TensorRT] VERBOSE: Tactic: -64 time 0.030048 [TensorRT] VERBOSE: Tactic: -128 time 0.03104 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021472 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008192 [TensorRT] VERBOSE: Tactic: 1 time 0.007936 [TensorRT] VERBOSE: Tactic: 2 time 0.007168 [TensorRT] VERBOSE: Tactic: 3 time 0.00768 [TensorRT] VERBOSE: Tactic: 4 time 0.007648 [TensorRT] VERBOSE: Tactic: 5 time 0.006912 [TensorRT] VERBOSE: Tactic: 6 time 0.007584 [TensorRT] VERBOSE: Tactic: 7 time 0.007648 [TensorRT] VERBOSE: Tactic: 8 time 0.008 [TensorRT] VERBOSE: Tactic: 9 time 0.008992 [TensorRT] VERBOSE: Tactic: 10 time 0.012416 [TensorRT] VERBOSE: Tactic: 11 time 0.009856 [TensorRT] VERBOSE: Tactic: 12 time 0.009536 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.008288 [TensorRT] VERBOSE: Tactic: 16 time 0.009504 [TensorRT] VERBOSE: Tactic: 17 time 0.00912 [TensorRT] VERBOSE: Tactic: 18 time 0.007872 [TensorRT] VERBOSE: Tactic: 19 time 0.0088 [TensorRT] VERBOSE: Tactic: 20 time 0.018816 [TensorRT] VERBOSE: Tactic: 21 time 0.013856 [TensorRT] VERBOSE: Tactic: 22 time 0.012192 [TensorRT] VERBOSE: Tactic: 23 time 0.01072 [TensorRT] VERBOSE: Tactic: 28 time 0.010752 [TensorRT] VERBOSE: Tactic: 29 time 0.012384 [TensorRT] VERBOSE: Tactic: 30 time 0.017952 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.006912 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022336 [TensorRT] VERBOSE: Tactic: 256 time 0.021504 [TensorRT] VERBOSE: Tactic: 512 time 0.02224 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021504 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_104 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00768 [TensorRT] VERBOSE: Tactic: 11 time 0.007936 [TensorRT] VERBOSE: Tactic: 12 time 0.00784 [TensorRT] VERBOSE: Tactic: 13 time 0.01024 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.0112 [TensorRT] VERBOSE: Tactic: 16 time 0.01392 [TensorRT] VERBOSE: Tactic: 17 time 0.013664 [TensorRT] VERBOSE: Tactic: 18 time 0.01504 [TensorRT] VERBOSE: Tactic: 19 time 0.015744 [TensorRT] VERBOSE: Tactic: 20 time 0.007584 [TensorRT] VERBOSE: Tactic: 21 time 0.007552 [TensorRT] VERBOSE: Tactic: 22 time 0.00768 [TensorRT] VERBOSE: Tactic: 23 time 0.010432 [TensorRT] VERBOSE: Tactic: 24 time 0.009184 [TensorRT] VERBOSE: Tactic: 25 time 0.007488 [TensorRT] VERBOSE: Tactic: 26 time 0.007488 [TensorRT] VERBOSE: Tactic: 27 time 0.009056 [TensorRT] VERBOSE: Tactic: 29 time 0.027136 [TensorRT] VERBOSE: Tactic: 30 time 0.016 [TensorRT] VERBOSE: Tactic: 31 time 0.011136 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.007488 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_105 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_105 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_105 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_105 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_105 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023776 [TensorRT] VERBOSE: Tactic: 256 time 0.024704 [TensorRT] VERBOSE: Tactic: 512 time 0.024576 [TensorRT] VERBOSE: Tactic: -32 time 0.0512 [TensorRT] VERBOSE: Tactic: -64 time 0.034112 [TensorRT] VERBOSE: Tactic: -128 time 0.031744 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023776 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014592 [TensorRT] VERBOSE: Tactic: 1 time 0.01536 [TensorRT] VERBOSE: Tactic: 2 time 0.014688 [TensorRT] VERBOSE: Tactic: 3 time 0.01488 [TensorRT] VERBOSE: Tactic: 4 time 0.015328 [TensorRT] VERBOSE: Tactic: 5 time 0.01408 [TensorRT] VERBOSE: Tactic: 6 time 0.015488 [TensorRT] VERBOSE: Tactic: 7 time 0.014848 [TensorRT] VERBOSE: Tactic: 8 time 0.014816 [TensorRT] VERBOSE: Tactic: 9 time 0.01584 [TensorRT] VERBOSE: Tactic: 28 time 0.014496 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.01408 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02416 [TensorRT] VERBOSE: Tactic: 256 time 0.02448 [TensorRT] VERBOSE: Tactic: 512 time 0.0256 [TensorRT] VERBOSE: Tactic: -32 time 0.052832 [TensorRT] VERBOSE: Tactic: -64 time 0.033984 [TensorRT] VERBOSE: Tactic: -128 time 0.031584 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.02416 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.02224 [TensorRT] VERBOSE: Tactic: 25 time 0.022656 [TensorRT] VERBOSE: Tactic: 26 time 0.023488 [TensorRT] VERBOSE: Tactic: 27 time 0.022336 [TensorRT] VERBOSE: Tactic: 31 time 0.023296 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.02224 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.027424 [TensorRT] VERBOSE: Tactic: 256 time 0.027168 [TensorRT] VERBOSE: Tactic: 512 time 0.028384 [TensorRT] VERBOSE: Tactic: -32 time 0.03616 [TensorRT] VERBOSE: Tactic: -64 time 0.040576 [TensorRT] VERBOSE: Tactic: -128 time 0.041408 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027168 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01024 [TensorRT] VERBOSE: Tactic: 1 time 0.009344 [TensorRT] VERBOSE: Tactic: 2 time 0.010304 [TensorRT] VERBOSE: Tactic: 3 time 0.009216 [TensorRT] VERBOSE: Tactic: 4 time 0.008608 [TensorRT] VERBOSE: Tactic: 5 time 0.012608 [TensorRT] VERBOSE: Tactic: 6 time 0.010144 [TensorRT] VERBOSE: Tactic: 7 time 0.009152 [TensorRT] VERBOSE: Tactic: 8 time 0.009728 [TensorRT] VERBOSE: Tactic: 9 time 0.016256 [TensorRT] VERBOSE: Tactic: 10 time 0.01536 [TensorRT] VERBOSE: Tactic: 11 time 0.012832 [TensorRT] VERBOSE: Tactic: 12 time 0.011712 [TensorRT] VERBOSE: Tactic: 13 time 0.010624 [TensorRT] VERBOSE: Tactic: 14 time 0.011264 [TensorRT] VERBOSE: Tactic: 15 time 0.013088 [TensorRT] VERBOSE: Tactic: 16 time 0.010752 [TensorRT] VERBOSE: Tactic: 17 time 0.010816 [TensorRT] VERBOSE: Tactic: 18 time 0.011808 [TensorRT] VERBOSE: Tactic: 19 time 0.01536 [TensorRT] VERBOSE: Tactic: 20 time 0.021792 [TensorRT] VERBOSE: Tactic: 21 time 0.016224 [TensorRT] VERBOSE: Tactic: 22 time 0.013888 [TensorRT] VERBOSE: Tactic: 23 time 0.012288 [TensorRT] VERBOSE: Tactic: 28 time 0.016224 [TensorRT] VERBOSE: Tactic: 29 time 0.01584 [TensorRT] VERBOSE: Tactic: 30 time 0.021088 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.008608 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028288 [TensorRT] VERBOSE: Tactic: 256 time 0.027456 [TensorRT] VERBOSE: Tactic: 512 time 0.028448 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.027456 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_106, Add_107) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011872 [TensorRT] VERBOSE: Tactic: 11 time 0.011136 [TensorRT] VERBOSE: Tactic: 12 time 0.011712 [TensorRT] VERBOSE: Tactic: 13 time 0.01408 [TensorRT] VERBOSE: Tactic: 14 time 0.011712 [TensorRT] VERBOSE: Tactic: 15 time 0.016288 [TensorRT] VERBOSE: Tactic: 16 time 0.021216 [TensorRT] VERBOSE: Tactic: 17 time 0.017056 [TensorRT] VERBOSE: Tactic: 18 time 0.01792 [TensorRT] VERBOSE: Tactic: 19 time 0.022784 [TensorRT] VERBOSE: Tactic: 20 time 0.010336 [TensorRT] VERBOSE: Tactic: 21 time 0.00944 [TensorRT] VERBOSE: Tactic: 22 time 0.010528 [TensorRT] VERBOSE: Tactic: 23 time 0.013856 [TensorRT] VERBOSE: Tactic: 24 time 0.0104 [TensorRT] VERBOSE: Tactic: 25 time 0.0112 [TensorRT] VERBOSE: Tactic: 26 time 0.009568 [TensorRT] VERBOSE: Tactic: 27 time 0.012256 [TensorRT] VERBOSE: Tactic: 29 time 0.040416 [TensorRT] VERBOSE: Tactic: 30 time 0.023296 [TensorRT] VERBOSE: Tactic: 31 time 0.01536 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.00944 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_108 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01936 [TensorRT] VERBOSE: Tactic: 256 time 0.019232 [TensorRT] VERBOSE: Tactic: 512 time 0.01936 [TensorRT] VERBOSE: Tactic: -32 time 0.04416 [TensorRT] VERBOSE: Tactic: -64 time 0.026624 [TensorRT] VERBOSE: Tactic: -128 time 0.026496 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.019232 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.013312 [TensorRT] VERBOSE: Tactic: 1 time 0.012288 [TensorRT] VERBOSE: Tactic: 2 time 0.011264 [TensorRT] VERBOSE: Tactic: 3 time 0.013184 [TensorRT] VERBOSE: Tactic: 4 time 0.010848 [TensorRT] VERBOSE: Tactic: 5 time 0.012192 [TensorRT] VERBOSE: Tactic: 6 time 0.013408 [TensorRT] VERBOSE: Tactic: 7 time 0.012288 [TensorRT] VERBOSE: Tactic: 8 time 0.011168 [TensorRT] VERBOSE: Tactic: 9 time 0.012032 [TensorRT] VERBOSE: Tactic: 28 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.010848 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019968 [TensorRT] VERBOSE: Tactic: 256 time 0.018912 [TensorRT] VERBOSE: Tactic: 512 time 0.019456 [TensorRT] VERBOSE: Tactic: -32 time 0.043104 [TensorRT] VERBOSE: Tactic: -64 time 0.026624 [TensorRT] VERBOSE: Tactic: -128 time 0.0264 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.018912 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.01568 [TensorRT] VERBOSE: Tactic: 25 time 0.014976 [TensorRT] VERBOSE: Tactic: 26 time 0.0144 [TensorRT] VERBOSE: Tactic: 27 time 0.013376 [TensorRT] VERBOSE: Tactic: 31 time 0.014272 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.013376 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022592 [TensorRT] VERBOSE: Tactic: 256 time 0.021952 [TensorRT] VERBOSE: Tactic: 512 time 0.02192 [TensorRT] VERBOSE: Tactic: -32 time 0.026624 [TensorRT] VERBOSE: Tactic: -64 time 0.029184 [TensorRT] VERBOSE: Tactic: -128 time 0.031264 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.02192 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009184 [TensorRT] VERBOSE: Tactic: 1 time 0.00768 [TensorRT] VERBOSE: Tactic: 2 time 0.00672 [TensorRT] VERBOSE: Tactic: 3 time 0.007648 [TensorRT] VERBOSE: Tactic: 4 time 0.007744 [TensorRT] VERBOSE: Tactic: 5 time 0.007904 [TensorRT] VERBOSE: Tactic: 6 time 0.007456 [TensorRT] VERBOSE: Tactic: 7 time 0.007488 [TensorRT] VERBOSE: Tactic: 8 time 0.008128 [TensorRT] VERBOSE: Tactic: 9 time 0.008256 [TensorRT] VERBOSE: Tactic: 10 time 0.01248 [TensorRT] VERBOSE: Tactic: 11 time 0.009984 [TensorRT] VERBOSE: Tactic: 12 time 0.009344 [TensorRT] VERBOSE: Tactic: 13 time 0.009472 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.008224 [TensorRT] VERBOSE: Tactic: 16 time 0.009056 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.009216 [TensorRT] VERBOSE: Tactic: 19 time 0.008608 [TensorRT] VERBOSE: Tactic: 20 time 0.018816 [TensorRT] VERBOSE: Tactic: 21 time 0.013888 [TensorRT] VERBOSE: Tactic: 22 time 0.012224 [TensorRT] VERBOSE: Tactic: 23 time 0.01024 [TensorRT] VERBOSE: Tactic: 28 time 0.010784 [TensorRT] VERBOSE: Tactic: 29 time 0.012448 [TensorRT] VERBOSE: Tactic: 30 time 0.0184 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.00672 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023264 [TensorRT] VERBOSE: Tactic: 256 time 0.021344 [TensorRT] VERBOSE: Tactic: 512 time 0.02208 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021344 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007872 [TensorRT] VERBOSE: Tactic: 11 time 0.007456 [TensorRT] VERBOSE: Tactic: 12 time 0.00832 [TensorRT] VERBOSE: Tactic: 13 time 0.010592 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.011232 [TensorRT] VERBOSE: Tactic: 16 time 0.013952 [TensorRT] VERBOSE: Tactic: 17 time 0.01376 [TensorRT] VERBOSE: Tactic: 18 time 0.0144 [TensorRT] VERBOSE: Tactic: 19 time 0.015904 [TensorRT] VERBOSE: Tactic: 20 time 0.00784 [TensorRT] VERBOSE: Tactic: 21 time 0.007072 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.010816 [TensorRT] VERBOSE: Tactic: 24 time 0.009216 [TensorRT] VERBOSE: Tactic: 25 time 0.00768 [TensorRT] VERBOSE: Tactic: 26 time 0.007616 [TensorRT] VERBOSE: Tactic: 27 time 0.007872 [TensorRT] VERBOSE: Tactic: 29 time 0.027552 [TensorRT] VERBOSE: Tactic: 30 time 0.015488 [TensorRT] VERBOSE: Tactic: 31 time 0.011072 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.007072 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_110 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_110 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_110 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_110 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_110 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0248 [TensorRT] VERBOSE: Tactic: 256 time 0.024192 [TensorRT] VERBOSE: Tactic: 512 time 0.025536 [TensorRT] VERBOSE: Tactic: -32 time 0.052896 [TensorRT] VERBOSE: Tactic: -64 time 0.033824 [TensorRT] VERBOSE: Tactic: -128 time 0.031872 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.024192 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014944 [TensorRT] VERBOSE: Tactic: 1 time 0.015296 [TensorRT] VERBOSE: Tactic: 2 time 0.01488 [TensorRT] VERBOSE: Tactic: 3 time 0.01536 [TensorRT] VERBOSE: Tactic: 4 time 0.016192 [TensorRT] VERBOSE: Tactic: 5 time 0.016192 [TensorRT] VERBOSE: Tactic: 6 time 0.015872 [TensorRT] VERBOSE: Tactic: 7 time 0.015072 [TensorRT] VERBOSE: Tactic: 8 time 0.015328 [TensorRT] VERBOSE: Tactic: 9 time 0.015712 [TensorRT] VERBOSE: Tactic: 28 time 0.014624 [TensorRT] VERBOSE: Fastest Tactic: 28 Time: 0.014624 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.025536 [TensorRT] VERBOSE: Tactic: 256 time 0.024576 [TensorRT] VERBOSE: Tactic: 512 time 0.02416 [TensorRT] VERBOSE: Tactic: -32 time 0.05264 [TensorRT] VERBOSE: Tactic: -64 time 0.033952 [TensorRT] VERBOSE: Tactic: -128 time 0.030816 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.02416 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.02272 [TensorRT] VERBOSE: Tactic: 25 time 0.022048 [TensorRT] VERBOSE: Tactic: 26 time 0.023104 [TensorRT] VERBOSE: Tactic: 27 time 0.023328 [TensorRT] VERBOSE: Tactic: 31 time 0.022528 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.022048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.026848 [TensorRT] VERBOSE: Tactic: 256 time 0.027808 [TensorRT] VERBOSE: Tactic: 512 time 0.028416 [TensorRT] VERBOSE: Tactic: -32 time 0.03616 [TensorRT] VERBOSE: Tactic: -64 time 0.039584 [TensorRT] VERBOSE: Tactic: -128 time 0.041344 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.026848 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.010336 [TensorRT] VERBOSE: Tactic: 1 time 0.010144 [TensorRT] VERBOSE: Tactic: 2 time 0.011232 [TensorRT] VERBOSE: Tactic: 3 time 0.00912 [TensorRT] VERBOSE: Tactic: 4 time 0.010208 [TensorRT] VERBOSE: Tactic: 5 time 0.013472 [TensorRT] VERBOSE: Tactic: 6 time 0.009344 [TensorRT] VERBOSE: Tactic: 7 time 0.00944 [TensorRT] VERBOSE: Tactic: 8 time 0.009888 [TensorRT] VERBOSE: Tactic: 9 time 0.016128 [TensorRT] VERBOSE: Tactic: 10 time 0.014176 [TensorRT] VERBOSE: Tactic: 11 time 0.012288 [TensorRT] VERBOSE: Tactic: 12 time 0.01168 [TensorRT] VERBOSE: Tactic: 13 time 0.010848 [TensorRT] VERBOSE: Tactic: 14 time 0.011456 [TensorRT] VERBOSE: Tactic: 15 time 0.012928 [TensorRT] VERBOSE: Tactic: 16 time 0.010656 [TensorRT] VERBOSE: Tactic: 17 time 0.010752 [TensorRT] VERBOSE: Tactic: 18 time 0.01136 [TensorRT] VERBOSE: Tactic: 19 time 0.01536 [TensorRT] VERBOSE: Tactic: 20 time 0.021696 [TensorRT] VERBOSE: Tactic: 21 time 0.017152 [TensorRT] VERBOSE: Tactic: 22 time 0.01408 [TensorRT] VERBOSE: Tactic: 23 time 0.011776 [TensorRT] VERBOSE: Tactic: 28 time 0.015744 [TensorRT] VERBOSE: Tactic: 29 time 0.01584 [TensorRT] VERBOSE: Tactic: 30 time 0.020608 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.00912 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028256 [TensorRT] VERBOSE: Tactic: 256 time 0.02672 [TensorRT] VERBOSE: Tactic: 512 time 0.02848 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.02672 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_111, Add_112) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.011136 [TensorRT] VERBOSE: Tactic: 11 time 0.011104 [TensorRT] VERBOSE: Tactic: 12 time 0.012576 [TensorRT] VERBOSE: Tactic: 13 time 0.014016 [TensorRT] VERBOSE: Tactic: 14 time 0.011584 [TensorRT] VERBOSE: Tactic: 15 time 0.016448 [TensorRT] VERBOSE: Tactic: 16 time 0.021568 [TensorRT] VERBOSE: Tactic: 17 time 0.016576 [TensorRT] VERBOSE: Tactic: 18 time 0.017472 [TensorRT] VERBOSE: Tactic: 19 time 0.023296 [TensorRT] VERBOSE: Tactic: 20 time 0.010528 [TensorRT] VERBOSE: Tactic: 21 time 0.009728 [TensorRT] VERBOSE: Tactic: 22 time 0.01072 [TensorRT] VERBOSE: Tactic: 23 time 0.014048 [TensorRT] VERBOSE: Tactic: 24 time 0.011104 [TensorRT] VERBOSE: Tactic: 25 time 0.010848 [TensorRT] VERBOSE: Tactic: 26 time 0.009504 [TensorRT] VERBOSE: Tactic: 27 time 0.012288 [TensorRT] VERBOSE: Tactic: 29 time 0.039936 [TensorRT] VERBOSE: Tactic: 30 time 0.023552 [TensorRT] VERBOSE: Tactic: 31 time 0.01632 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.009504 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_113 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019424 [TensorRT] VERBOSE: Tactic: 256 time 0.019456 [TensorRT] VERBOSE: Tactic: 512 time 0.01984 [TensorRT] VERBOSE: Tactic: -32 time 0.04432 [TensorRT] VERBOSE: Tactic: -64 time 0.026752 [TensorRT] VERBOSE: Tactic: -128 time 0.026496 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019424 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.012512 [TensorRT] VERBOSE: Tactic: 1 time 0.013344 [TensorRT] VERBOSE: Tactic: 2 time 0.011232 [TensorRT] VERBOSE: Tactic: 3 time 0.011968 [TensorRT] VERBOSE: Tactic: 4 time 0.010976 [TensorRT] VERBOSE: Tactic: 5 time 0.011552 [TensorRT] VERBOSE: Tactic: 6 time 0.013248 [TensorRT] VERBOSE: Tactic: 7 time 0.012288 [TensorRT] VERBOSE: Tactic: 8 time 0.01104 [TensorRT] VERBOSE: Tactic: 9 time 0.01168 [TensorRT] VERBOSE: Tactic: 28 time 0.013024 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.010976 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019264 [TensorRT] VERBOSE: Tactic: 256 time 0.019072 [TensorRT] VERBOSE: Tactic: 512 time 0.020064 [TensorRT] VERBOSE: Tactic: -32 time 0.04432 [TensorRT] VERBOSE: Tactic: -64 time 0.02752 [TensorRT] VERBOSE: Tactic: -128 time 0.025152 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.019072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014368 [TensorRT] VERBOSE: Tactic: 25 time 0.01536 [TensorRT] VERBOSE: Tactic: 26 time 0.013952 [TensorRT] VERBOSE: Tactic: 27 time 0.0152 [TensorRT] VERBOSE: Tactic: 31 time 0.014784 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.013952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022496 [TensorRT] VERBOSE: Tactic: 256 time 0.021312 [TensorRT] VERBOSE: Tactic: 512 time 0.021888 [TensorRT] VERBOSE: Tactic: -32 time 0.0256 [TensorRT] VERBOSE: Tactic: -64 time 0.029664 [TensorRT] VERBOSE: Tactic: -128 time 0.030944 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021312 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00912 [TensorRT] VERBOSE: Tactic: 1 time 0.00752 [TensorRT] VERBOSE: Tactic: 2 time 0.006784 [TensorRT] VERBOSE: Tactic: 3 time 0.007488 [TensorRT] VERBOSE: Tactic: 4 time 0.00784 [TensorRT] VERBOSE: Tactic: 5 time 0.007328 [TensorRT] VERBOSE: Tactic: 6 time 0.007584 [TensorRT] VERBOSE: Tactic: 7 time 0.007584 [TensorRT] VERBOSE: Tactic: 8 time 0.007776 [TensorRT] VERBOSE: Tactic: 9 time 0.008256 [TensorRT] VERBOSE: Tactic: 10 time 0.012928 [TensorRT] VERBOSE: Tactic: 11 time 0.010624 [TensorRT] VERBOSE: Tactic: 12 time 0.009472 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.008576 [TensorRT] VERBOSE: Tactic: 15 time 0.008128 [TensorRT] VERBOSE: Tactic: 16 time 0.009152 [TensorRT] VERBOSE: Tactic: 17 time 0.009248 [TensorRT] VERBOSE: Tactic: 18 time 0.00928 [TensorRT] VERBOSE: Tactic: 19 time 0.008512 [TensorRT] VERBOSE: Tactic: 20 time 0.018752 [TensorRT] VERBOSE: Tactic: 21 time 0.013888 [TensorRT] VERBOSE: Tactic: 22 time 0.010784 [TensorRT] VERBOSE: Tactic: 23 time 0.010816 [TensorRT] VERBOSE: Tactic: 28 time 0.010976 [TensorRT] VERBOSE: Tactic: 29 time 0.01264 [TensorRT] VERBOSE: Tactic: 30 time 0.018944 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006784 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023264 [TensorRT] VERBOSE: Tactic: 256 time 0.022208 [TensorRT] VERBOSE: Tactic: 512 time 0.021856 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.021856 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_114 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007808 [TensorRT] VERBOSE: Tactic: 11 time 0.007552 [TensorRT] VERBOSE: Tactic: 12 time 0.007968 [TensorRT] VERBOSE: Tactic: 13 time 0.010656 [TensorRT] VERBOSE: Tactic: 14 time 0.00944 [TensorRT] VERBOSE: Tactic: 15 time 0.0112 [TensorRT] VERBOSE: Tactic: 16 time 0.014272 [TensorRT] VERBOSE: Tactic: 17 time 0.014016 [TensorRT] VERBOSE: Tactic: 18 time 0.014336 [TensorRT] VERBOSE: Tactic: 19 time 0.015424 [TensorRT] VERBOSE: Tactic: 20 time 0.007904 [TensorRT] VERBOSE: Tactic: 21 time 0.007584 [TensorRT] VERBOSE: Tactic: 22 time 0.007648 [TensorRT] VERBOSE: Tactic: 23 time 0.009504 [TensorRT] VERBOSE: Tactic: 24 time 0.009536 [TensorRT] VERBOSE: Tactic: 25 time 0.007968 [TensorRT] VERBOSE: Tactic: 26 time 0.007616 [TensorRT] VERBOSE: Tactic: 27 time 0.008064 [TensorRT] VERBOSE: Tactic: 29 time 0.026912 [TensorRT] VERBOSE: Tactic: 30 time 0.015616 [TensorRT] VERBOSE: Tactic: 31 time 0.010976 [TensorRT] VERBOSE: Fastest Tactic: 11 Time: 0.007552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 11 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_115 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_115 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_115 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_115 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_115 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352), Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023552 [TensorRT] VERBOSE: Tactic: 256 time 0.02432 [TensorRT] VERBOSE: Tactic: 512 time 0.024576 [TensorRT] VERBOSE: Tactic: -32 time 0.052576 [TensorRT] VERBOSE: Tactic: -64 time 0.034336 [TensorRT] VERBOSE: Tactic: -128 time 0.030976 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014752 [TensorRT] VERBOSE: Tactic: 1 time 0.01536 [TensorRT] VERBOSE: Tactic: 2 time 0.014848 [TensorRT] VERBOSE: Tactic: 3 time 0.01568 [TensorRT] VERBOSE: Tactic: 4 time 0.015232 [TensorRT] VERBOSE: Tactic: 5 time 0.015328 [TensorRT] VERBOSE: Tactic: 6 time 0.016096 [TensorRT] VERBOSE: Tactic: 7 time 0.01488 [TensorRT] VERBOSE: Tactic: 8 time 0.015744 [TensorRT] VERBOSE: Tactic: 9 time 0.01536 [TensorRT] VERBOSE: Tactic: 28 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 28 Time: 0.014336 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136), Float(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023552 [TensorRT] VERBOSE: Tactic: 256 time 0.025312 [TensorRT] VERBOSE: Tactic: 512 time 0.024576 [TensorRT] VERBOSE: Tactic: -32 time 0.053248 [TensorRT] VERBOSE: Tactic: -64 time 0.03392 [TensorRT] VERBOSE: Tactic: -128 time 0.03072 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.022784 [TensorRT] VERBOSE: Tactic: 25 time 0.024864 [TensorRT] VERBOSE: Tactic: 26 time 0.023776 [TensorRT] VERBOSE: Tactic: 27 time 0.024352 [TensorRT] VERBOSE: Tactic: 31 time 0.022944 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.022784 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088), Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.028416 [TensorRT] VERBOSE: Tactic: 256 time 0.02688 [TensorRT] VERBOSE: Tactic: 512 time 0.028128 [TensorRT] VERBOSE: Tactic: -32 time 0.036096 [TensorRT] VERBOSE: Tactic: -64 time 0.039424 [TensorRT] VERBOSE: Tactic: -128 time 0.040896 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.02688 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.0104 [TensorRT] VERBOSE: Tactic: 1 time 0.01024 [TensorRT] VERBOSE: Tactic: 2 time 0.010752 [TensorRT] VERBOSE: Tactic: 3 time 0.009216 [TensorRT] VERBOSE: Tactic: 4 time 0.009696 [TensorRT] VERBOSE: Tactic: 5 time 0.012032 [TensorRT] VERBOSE: Tactic: 6 time 0.009216 [TensorRT] VERBOSE: Tactic: 7 time 0.009248 [TensorRT] VERBOSE: Tactic: 8 time 0.01024 [TensorRT] VERBOSE: Tactic: 9 time 0.015872 [TensorRT] VERBOSE: Tactic: 10 time 0.014432 [TensorRT] VERBOSE: Tactic: 11 time 0.012288 [TensorRT] VERBOSE: Tactic: 12 time 0.011616 [TensorRT] VERBOSE: Tactic: 13 time 0.010688 [TensorRT] VERBOSE: Tactic: 14 time 0.0112 [TensorRT] VERBOSE: Tactic: 15 time 0.01264 [TensorRT] VERBOSE: Tactic: 16 time 0.010752 [TensorRT] VERBOSE: Tactic: 17 time 0.01072 [TensorRT] VERBOSE: Tactic: 18 time 0.011712 [TensorRT] VERBOSE: Tactic: 19 time 0.01536 [TensorRT] VERBOSE: Tactic: 20 time 0.020672 [TensorRT] VERBOSE: Tactic: 21 time 0.017024 [TensorRT] VERBOSE: Tactic: 22 time 0.012448 [TensorRT] VERBOSE: Tactic: 23 time 0.012576 [TensorRT] VERBOSE: Tactic: 28 time 0.015264 [TensorRT] VERBOSE: Tactic: 29 time 0.015616 [TensorRT] VERBOSE: Tactic: 30 time 0.02048 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136), Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.02816 [TensorRT] VERBOSE: Tactic: 256 time 0.026912 [TensorRT] VERBOSE: Tactic: 512 time 0.02848 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.026912 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_116, Add_117) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.010848 [TensorRT] VERBOSE: Tactic: 11 time 0.011264 [TensorRT] VERBOSE: Tactic: 12 time 0.012064 [TensorRT] VERBOSE: Tactic: 13 time 0.013984 [TensorRT] VERBOSE: Tactic: 14 time 0.011552 [TensorRT] VERBOSE: Tactic: 15 time 0.016384 [TensorRT] VERBOSE: Tactic: 16 time 0.021504 [TensorRT] VERBOSE: Tactic: 17 time 0.016384 [TensorRT] VERBOSE: Tactic: 18 time 0.017728 [TensorRT] VERBOSE: Tactic: 19 time 0.023744 [TensorRT] VERBOSE: Tactic: 20 time 0.01088 [TensorRT] VERBOSE: Tactic: 21 time 0.009472 [TensorRT] VERBOSE: Tactic: 22 time 0.010784 [TensorRT] VERBOSE: Tactic: 23 time 0.01392 [TensorRT] VERBOSE: Tactic: 24 time 0.011008 [TensorRT] VERBOSE: Tactic: 25 time 0.00944 [TensorRT] VERBOSE: Tactic: 26 time 0.009248 [TensorRT] VERBOSE: Tactic: 27 time 0.012256 [TensorRT] VERBOSE: Tactic: 29 time 0.039552 [TensorRT] VERBOSE: Tactic: 30 time 0.023424 [TensorRT] VERBOSE: Tactic: 31 time 0.016384 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.009248 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Float(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_118 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.020416 [TensorRT] VERBOSE: Tactic: 0 time 0.011584 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011584 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02352 [TensorRT] VERBOSE: Tactic: 0 time 0.048032 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02352 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026912 [TensorRT] VERBOSE: Tactic: 0 time 0.015648 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015648 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02672 [TensorRT] VERBOSE: Tactic: 0 time 0.032032 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02672 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040672 [TensorRT] VERBOSE: Tactic: 0 time 0.025248 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.025248 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025088 [TensorRT] VERBOSE: Tactic: 0 time 0.011968 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011968 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027968 [TensorRT] VERBOSE: Tactic: 0 time 0.019456 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019456 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026624 [TensorRT] VERBOSE: Tactic: 0 time 0.039296 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026624 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,100352) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.021888 [TensorRT] VERBOSE: Tactic: 256 time 0.022368 [TensorRT] VERBOSE: Tactic: 512 time 0.022208 [TensorRT] VERBOSE: Tactic: -32 time 0.044288 [TensorRT] VERBOSE: Tactic: -64 time 0.026624 [TensorRT] VERBOSE: Tactic: -128 time 0.026752 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.021888 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.0136 [TensorRT] VERBOSE: Tactic: 1 time 0.012928 [TensorRT] VERBOSE: Tactic: 2 time 0.011392 [TensorRT] VERBOSE: Tactic: 3 time 0.01312 [TensorRT] VERBOSE: Tactic: 4 time 0.011936 [TensorRT] VERBOSE: Tactic: 5 time 0.011584 [TensorRT] VERBOSE: Tactic: 6 time 0.01344 [TensorRT] VERBOSE: Tactic: 7 time 0.011904 [TensorRT] VERBOSE: Tactic: 8 time 0.01136 [TensorRT] VERBOSE: Tactic: 9 time 0.012576 [TensorRT] VERBOSE: Tactic: 28 time 0.013024 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.01136 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,3136) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.021824 [TensorRT] VERBOSE: Tactic: 256 time 0.022016 [TensorRT] VERBOSE: Tactic: 512 time 0.021856 [TensorRT] VERBOSE: Tactic: -32 time 0.042016 [TensorRT] VERBOSE: Tactic: -64 time 0.027456 [TensorRT] VERBOSE: Tactic: -128 time 0.027104 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.021824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014592 [TensorRT] VERBOSE: Tactic: 25 time 0.016 [TensorRT] VERBOSE: Tactic: 26 time 0.014656 [TensorRT] VERBOSE: Tactic: 27 time 0.014784 [TensorRT] VERBOSE: Tactic: 31 time 0.015968 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.014592 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,25088) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023136 [TensorRT] VERBOSE: Tactic: 256 time 0.021504 [TensorRT] VERBOSE: Tactic: 512 time 0.02192 [TensorRT] VERBOSE: Tactic: -32 time 0.026624 [TensorRT] VERBOSE: Tactic: -64 time 0.029664 [TensorRT] VERBOSE: Tactic: -128 time 0.03168 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021504 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008928 [TensorRT] VERBOSE: Tactic: 1 time 0.007808 [TensorRT] VERBOSE: Tactic: 2 time 0.006848 [TensorRT] VERBOSE: Tactic: 3 time 0.007648 [TensorRT] VERBOSE: Tactic: 4 time 0.007488 [TensorRT] VERBOSE: Tactic: 5 time 0.007008 [TensorRT] VERBOSE: Tactic: 6 time 0.007648 [TensorRT] VERBOSE: Tactic: 7 time 0.00752 [TensorRT] VERBOSE: Tactic: 8 time 0.009248 [TensorRT] VERBOSE: Tactic: 9 time 0.008512 [TensorRT] VERBOSE: Tactic: 10 time 0.012576 [TensorRT] VERBOSE: Tactic: 11 time 0.010848 [TensorRT] VERBOSE: Tactic: 12 time 0.009856 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009472 [TensorRT] VERBOSE: Tactic: 15 time 0.008288 [TensorRT] VERBOSE: Tactic: 16 time 0.009184 [TensorRT] VERBOSE: Tactic: 17 time 0.00912 [TensorRT] VERBOSE: Tactic: 18 time 0.008864 [TensorRT] VERBOSE: Tactic: 19 time 0.008896 [TensorRT] VERBOSE: Tactic: 20 time 0.018912 [TensorRT] VERBOSE: Tactic: 21 time 0.013856 [TensorRT] VERBOSE: Tactic: 22 time 0.010752 [TensorRT] VERBOSE: Tactic: 23 time 0.010144 [TensorRT] VERBOSE: Tactic: 28 time 0.01088 [TensorRT] VERBOSE: Tactic: 29 time 0.012416 [TensorRT] VERBOSE: Tactic: 30 time 0.01856 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006848 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,3136) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023424 [TensorRT] VERBOSE: Tactic: 256 time 0.021792 [TensorRT] VERBOSE: Tactic: 512 time 0.022176 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021792 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_119 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.008096 [TensorRT] VERBOSE: Tactic: 11 time 0.007744 [TensorRT] VERBOSE: Tactic: 12 time 0.007936 [TensorRT] VERBOSE: Tactic: 13 time 0.01056 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.010464 [TensorRT] VERBOSE: Tactic: 16 time 0.013632 [TensorRT] VERBOSE: Tactic: 17 time 0.013824 [TensorRT] VERBOSE: Tactic: 18 time 0.014816 [TensorRT] VERBOSE: Tactic: 19 time 0.016288 [TensorRT] VERBOSE: Tactic: 20 time 0.007744 [TensorRT] VERBOSE: Tactic: 21 time 0.007744 [TensorRT] VERBOSE: Tactic: 22 time 0.007552 [TensorRT] VERBOSE: Tactic: 23 time 0.010784 [TensorRT] VERBOSE: Tactic: 24 time 0.009024 [TensorRT] VERBOSE: Tactic: 25 time 0.007648 [TensorRT] VERBOSE: Tactic: 26 time 0.007584 [TensorRT] VERBOSE: Tactic: 27 time 0.007744 [TensorRT] VERBOSE: Tactic: 29 time 0.026688 [TensorRT] VERBOSE: Tactic: 30 time 0.016032 [TensorRT] VERBOSE: Tactic: 31 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.007552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.023552 [TensorRT] VERBOSE: Tactic: 0 time 0.049088 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026912 [TensorRT] VERBOSE: Tactic: 0 time 0.007488 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007488 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025568 [TensorRT] VERBOSE: Tactic: 0 time 0.031552 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025568 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.03952 [TensorRT] VERBOSE: Tactic: 0 time 0.025184 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.025184 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028512 [TensorRT] VERBOSE: Tactic: 0 time 0.0208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0208 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027264 [TensorRT] VERBOSE: Tactic: 0 time 0.038976 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.027264 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02672 [TensorRT] VERBOSE: Tactic: 0 time 0.01664 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01664 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026944 [TensorRT] VERBOSE: Tactic: 0 time 0.046368 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026944 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026912 [TensorRT] VERBOSE: Tactic: 0 time 0.007712 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007712 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026272 [TensorRT] VERBOSE: Tactic: 0 time 0.016384 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016384 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025952 [TensorRT] VERBOSE: Tactic: 0 time 0.047328 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025952 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02688 [TensorRT] VERBOSE: Tactic: 0 time 0.015936 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015936 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_121 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,200704) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032928 [TensorRT] VERBOSE: Tactic: 256 time 0.034144 [TensorRT] VERBOSE: Tactic: 512 time 0.03536 [TensorRT] VERBOSE: Tactic: -32 time 0.053024 [TensorRT] VERBOSE: Tactic: -64 time 0.047168 [TensorRT] VERBOSE: Tactic: -128 time 0.04096 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.032928 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.020448 [TensorRT] VERBOSE: Tactic: 1 time 0.019584 [TensorRT] VERBOSE: Tactic: 2 time 0.01824 [TensorRT] VERBOSE: Tactic: 3 time 0.02032 [TensorRT] VERBOSE: Tactic: 4 time 0.01984 [TensorRT] VERBOSE: Tactic: 5 time 0.01792 [TensorRT] VERBOSE: Tactic: 6 time 0.019776 [TensorRT] VERBOSE: Tactic: 7 time 0.020128 [TensorRT] VERBOSE: Tactic: 8 time 0.017888 [TensorRT] VERBOSE: Tactic: 9 time 0.019744 [TensorRT] VERBOSE: Tactic: 28 time 0.020704 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.017888 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.032768 [TensorRT] VERBOSE: Tactic: 256 time 0.0328 [TensorRT] VERBOSE: Tactic: 512 time 0.034432 [TensorRT] VERBOSE: Tactic: -32 time 0.049664 [TensorRT] VERBOSE: Tactic: -64 time 0.047584 [TensorRT] VERBOSE: Tactic: -128 time 0.040192 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.032768 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.026848 [TensorRT] VERBOSE: Tactic: 25 time 0.026368 [TensorRT] VERBOSE: Tactic: 26 time 0.025952 [TensorRT] VERBOSE: Tactic: 27 time 0.025632 [TensorRT] VERBOSE: Tactic: 31 time 0.026528 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.025632 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,28,784:4,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.042336 [TensorRT] VERBOSE: Tactic: 256 time 0.036608 [TensorRT] VERBOSE: Tactic: 512 time 0.036992 [TensorRT] VERBOSE: Tactic: -32 time 0.052064 [TensorRT] VERBOSE: Tactic: -64 time 0.055168 [TensorRT] VERBOSE: Tactic: -128 time 0.054112 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.036608 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.014848 [TensorRT] VERBOSE: Tactic: 1 time 0.012288 [TensorRT] VERBOSE: Tactic: 2 time 0.012256 [TensorRT] VERBOSE: Tactic: 3 time 0.01184 [TensorRT] VERBOSE: Tactic: 4 time 0.012288 [TensorRT] VERBOSE: Tactic: 5 time 0.011936 [TensorRT] VERBOSE: Tactic: 6 time 0.010048 [TensorRT] VERBOSE: Tactic: 7 time 0.01152 [TensorRT] VERBOSE: Tactic: 8 time 0.013824 [TensorRT] VERBOSE: Tactic: 9 time 0.015008 [TensorRT] VERBOSE: Tactic: 10 time 0.021504 [TensorRT] VERBOSE: Tactic: 11 time 0.017056 [TensorRT] VERBOSE: Tactic: 12 time 0.015808 [TensorRT] VERBOSE: Tactic: 13 time 0.014944 [TensorRT] VERBOSE: Tactic: 14 time 0.014784 [TensorRT] VERBOSE: Tactic: 15 time 0.0152 [TensorRT] VERBOSE: Tactic: 16 time 0.013824 [TensorRT] VERBOSE: Tactic: 17 time 0.013632 [TensorRT] VERBOSE: Tactic: 18 time 0.01536 [TensorRT] VERBOSE: Tactic: 19 time 0.016384 [TensorRT] VERBOSE: Tactic: 20 time 0.033248 [TensorRT] VERBOSE: Tactic: 21 time 0.024064 [TensorRT] VERBOSE: Tactic: 22 time 0.018464 [TensorRT] VERBOSE: Tactic: 23 time 0.016128 [TensorRT] VERBOSE: Tactic: 28 time 0.01904 [TensorRT] VERBOSE: Tactic: 29 time 0.022496 [TensorRT] VERBOSE: Tactic: 30 time 0.032128 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.010048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Int8(1,28,784:32,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.042272 [TensorRT] VERBOSE: Tactic: 256 time 0.03632 [TensorRT] VERBOSE: Tactic: 512 time 0.0368 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.03632 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_122 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.012608 [TensorRT] VERBOSE: Tactic: 11 time 0.011552 [TensorRT] VERBOSE: Tactic: 12 time 0.01152 [TensorRT] VERBOSE: Tactic: 13 time 0.013056 [TensorRT] VERBOSE: Tactic: 14 time 0.013312 [TensorRT] VERBOSE: Tactic: 15 time 0.016128 [TensorRT] VERBOSE: Tactic: 16 time 0.016224 [TensorRT] VERBOSE: Tactic: 17 time 0.01536 [TensorRT] VERBOSE: Tactic: 18 time 0.02016 [TensorRT] VERBOSE: Tactic: 19 time 0.021664 [TensorRT] VERBOSE: Tactic: 20 time 0.011648 [TensorRT] VERBOSE: Tactic: 21 time 0.012224 [TensorRT] VERBOSE: Tactic: 22 time 0.011616 [TensorRT] VERBOSE: Tactic: 23 time 0.011424 [TensorRT] VERBOSE: Tactic: 24 time 0.014688 [TensorRT] VERBOSE: Tactic: 25 time 0.01168 [TensorRT] VERBOSE: Tactic: 26 time 0.011424 [TensorRT] VERBOSE: Tactic: 27 time 0.011104 [TensorRT] VERBOSE: Tactic: 29 time 0.047072 [TensorRT] VERBOSE: Tactic: 30 time 0.027648 [TensorRT] VERBOSE: Tactic: 31 time 0.01968 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.011104 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.523232 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.523232 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.47792 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.494432 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.47664 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.480256 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.491008 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.50848 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.544064 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.62048 [TensorRT] VERBOSE: Fastest Tactic: 3915320020053085238 Time: 0.47664 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.766624 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 1806336, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 573767680, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 10642944, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.766624 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.13056 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.189088 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.156928 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.137216 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.189248 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.168768 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.131168 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.133088 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.126752 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.130944 [TensorRT] VERBOSE: Fastest Tactic: -4973811344878172338 Time: 0.126752 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4973811344878172338 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.154976 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.154976 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.135712 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.1296 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.18304 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.125216 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.166912 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.124736 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.157696 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.126176 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.183296 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.130208 [TensorRT] VERBOSE: Fastest Tactic: -7210942453088153035 Time: 0.124736 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7210942453088153035 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:4,50176) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.18352 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.16208 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.130592 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.15296 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.129472 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.180288 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.124256 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.13312 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.123552 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.125472 [TensorRT] VERBOSE: Fastest Tactic: -2002418013575043687 Time: 0.123552 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2002418013575043687 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_123 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,28,784:32,6272) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.144896 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.144896 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CaskConvolution) [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.056256 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.060416 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.070656 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.057344 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.054272 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.059392 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.077824 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.057696 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.059264 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.05216 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.067072 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.050176 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.050176 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_123 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.024896 [TensorRT] VERBOSE: Tactic: 0 time 0.048192 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024896 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02752 [TensorRT] VERBOSE: Tactic: 0 time 0.007776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007776 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02688 [TensorRT] VERBOSE: Tactic: 0 time 0.032416 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02688 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.043328 [TensorRT] VERBOSE: Tactic: 0 time 0.023488 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023488 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028864 [TensorRT] VERBOSE: Tactic: 0 time 0.019264 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019264 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027456 [TensorRT] VERBOSE: Tactic: 0 time 0.039808 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.027456 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027328 [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009216 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027264 [TensorRT] VERBOSE: Tactic: 0 time 0.047744 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.027264 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026848 [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009216 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028384 [TensorRT] VERBOSE: Tactic: 0 time 0.015232 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015232 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028 [TensorRT] VERBOSE: Tactic: 0 time 0.047616 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.028 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028192 [TensorRT] VERBOSE: Tactic: 0 time 0.015552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015552 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019456 [TensorRT] VERBOSE: Tactic: 256 time 0.019584 [TensorRT] VERBOSE: Tactic: 512 time 0.020032 [TensorRT] VERBOSE: Tactic: -32 time 0.041632 [TensorRT] VERBOSE: Tactic: -64 time 0.028224 [TensorRT] VERBOSE: Tactic: -128 time 0.02752 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.019456 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01248 [TensorRT] VERBOSE: Tactic: 1 time 0.01184 [TensorRT] VERBOSE: Tactic: 2 time 0.011168 [TensorRT] VERBOSE: Tactic: 3 time 0.01376 [TensorRT] VERBOSE: Tactic: 4 time 0.011392 [TensorRT] VERBOSE: Tactic: 5 time 0.011616 [TensorRT] VERBOSE: Tactic: 6 time 0.013088 [TensorRT] VERBOSE: Tactic: 7 time 0.01136 [TensorRT] VERBOSE: Tactic: 8 time 0.011552 [TensorRT] VERBOSE: Tactic: 9 time 0.011776 [TensorRT] VERBOSE: Tactic: 28 time 0.014592 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.011168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.0192 [TensorRT] VERBOSE: Tactic: 256 time 0.018944 [TensorRT] VERBOSE: Tactic: 512 time 0.019936 [TensorRT] VERBOSE: Tactic: -32 time 0.041568 [TensorRT] VERBOSE: Tactic: -64 time 0.029056 [TensorRT] VERBOSE: Tactic: -128 time 0.025184 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.018944 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.014304 [TensorRT] VERBOSE: Tactic: 25 time 0.01536 [TensorRT] VERBOSE: Tactic: 26 time 0.01408 [TensorRT] VERBOSE: Tactic: 27 time 0.013408 [TensorRT] VERBOSE: Tactic: 31 time 0.015712 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.013408 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022304 [TensorRT] VERBOSE: Tactic: 256 time 0.02112 [TensorRT] VERBOSE: Tactic: 512 time 0.022432 [TensorRT] VERBOSE: Tactic: -32 time 0.02656 [TensorRT] VERBOSE: Tactic: -64 time 0.029696 [TensorRT] VERBOSE: Tactic: -128 time 0.03104 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.02112 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008992 [TensorRT] VERBOSE: Tactic: 1 time 0.008064 [TensorRT] VERBOSE: Tactic: 2 time 0.008192 [TensorRT] VERBOSE: Tactic: 3 time 0.007744 [TensorRT] VERBOSE: Tactic: 4 time 0.00784 [TensorRT] VERBOSE: Tactic: 5 time 0.006848 [TensorRT] VERBOSE: Tactic: 6 time 0.007424 [TensorRT] VERBOSE: Tactic: 7 time 0.008416 [TensorRT] VERBOSE: Tactic: 8 time 0.008128 [TensorRT] VERBOSE: Tactic: 9 time 0.009728 [TensorRT] VERBOSE: Tactic: 10 time 0.012768 [TensorRT] VERBOSE: Tactic: 11 time 0.011104 [TensorRT] VERBOSE: Tactic: 12 time 0.009696 [TensorRT] VERBOSE: Tactic: 13 time 0.010048 [TensorRT] VERBOSE: Tactic: 14 time 0.00944 [TensorRT] VERBOSE: Tactic: 15 time 0.008608 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009152 [TensorRT] VERBOSE: Tactic: 18 time 0.00928 [TensorRT] VERBOSE: Tactic: 19 time 0.008096 [TensorRT] VERBOSE: Tactic: 20 time 0.018784 [TensorRT] VERBOSE: Tactic: 21 time 0.014976 [TensorRT] VERBOSE: Tactic: 22 time 0.01216 [TensorRT] VERBOSE: Tactic: 23 time 0.010688 [TensorRT] VERBOSE: Tactic: 28 time 0.010912 [TensorRT] VERBOSE: Tactic: 29 time 0.012832 [TensorRT] VERBOSE: Tactic: 30 time 0.018944 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.006848 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023328 [TensorRT] VERBOSE: Tactic: 256 time 0.021344 [TensorRT] VERBOSE: Tactic: 512 time 0.023168 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021344 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.008096 [TensorRT] VERBOSE: Tactic: 11 time 0.007808 [TensorRT] VERBOSE: Tactic: 12 time 0.008128 [TensorRT] VERBOSE: Tactic: 13 time 0.009568 [TensorRT] VERBOSE: Tactic: 14 time 0.00944 [TensorRT] VERBOSE: Tactic: 15 time 0.010784 [TensorRT] VERBOSE: Tactic: 16 time 0.014784 [TensorRT] VERBOSE: Tactic: 17 time 0.013056 [TensorRT] VERBOSE: Tactic: 18 time 0.015424 [TensorRT] VERBOSE: Tactic: 19 time 0.016224 [TensorRT] VERBOSE: Tactic: 20 time 0.007552 [TensorRT] VERBOSE: Tactic: 21 time 0.00768 [TensorRT] VERBOSE: Tactic: 22 time 0.007488 [TensorRT] VERBOSE: Tactic: 23 time 0.009792 [TensorRT] VERBOSE: Tactic: 24 time 0.009216 [TensorRT] VERBOSE: Tactic: 25 time 0.007584 [TensorRT] VERBOSE: Tactic: 26 time 0.007744 [TensorRT] VERBOSE: Tactic: 27 time 0.007936 [TensorRT] VERBOSE: Tactic: 29 time 0.02672 [TensorRT] VERBOSE: Tactic: 30 time 0.015968 [TensorRT] VERBOSE: Tactic: 31 time 0.01104 [TensorRT] VERBOSE: Fastest Tactic: 22 Time: 0.007488 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.340512 [TensorRT] VERBOSE: Tactic: 655359 time 0.234592 [TensorRT] VERBOSE: Tactic: 786431 time 0.185216 [TensorRT] VERBOSE: Tactic: 851967 time 0.201952 [TensorRT] VERBOSE: Tactic: 1179647 time 0.20064 [TensorRT] VERBOSE: Tactic: 1310719 time 0.398176 [TensorRT] VERBOSE: Tactic: 1376255 time 0.24048 [TensorRT] VERBOSE: Tactic: 1441791 time 0.356384 [TensorRT] VERBOSE: Tactic: 1507327 time 0.238368 [TensorRT] VERBOSE: Tactic: 1638399 time 0.252352 [TensorRT] VERBOSE: Tactic: 1835007 time 0.19136 [TensorRT] VERBOSE: Tactic: 1900543 time 0.24576 [TensorRT] VERBOSE: Tactic: 2097151 time 0.218688 [TensorRT] VERBOSE: Tactic: 2162687 time 0.241696 [TensorRT] VERBOSE: Tactic: 2293759 time 0.230976 [TensorRT] VERBOSE: Tactic: 2359295 time 0.245696 [TensorRT] VERBOSE: Tactic: 2686975 time 0.23168 [TensorRT] VERBOSE: Tactic: 3080191 time 0.22624 [TensorRT] VERBOSE: Tactic: 3342335 time 0.242016 [TensorRT] VERBOSE: Tactic: 3407871 time 0.226304 [TensorRT] VERBOSE: Tactic: 3538943 time 0.188416 [TensorRT] VERBOSE: Tactic: 3670015 time 0.413344 [TensorRT] VERBOSE: Tactic: 3932159 time 0.212672 [TensorRT] VERBOSE: Tactic: 3997695 time 0.191104 [TensorRT] VERBOSE: Tactic: 4063231 time 0.195328 [TensorRT] VERBOSE: Tactic: 4194303 time 0.1744 [TensorRT] VERBOSE: Tactic: 4259839 time 0.219072 [TensorRT] VERBOSE: Tactic: 4325375 time 0.240928 [TensorRT] VERBOSE: Tactic: 4521983 time 0.22656 [TensorRT] VERBOSE: Tactic: 4587519 time 0.210496 [TensorRT] VERBOSE: Tactic: 4653055 time 0.189216 [TensorRT] VERBOSE: Tactic: 4915199 time 0.175232 [TensorRT] VERBOSE: Tactic: 4980735 time 0.228672 [TensorRT] VERBOSE: Tactic: 5177343 time 0.247808 [TensorRT] VERBOSE: Tactic: 5242879 time 0.215584 [TensorRT] VERBOSE: Tactic: 5373951 time 0.218592 [TensorRT] VERBOSE: Tactic: 5439487 time 0.223616 [TensorRT] VERBOSE: Tactic: 5570559 time 0.237856 [TensorRT] VERBOSE: Tactic: 5636095 time 0.194336 [TensorRT] VERBOSE: Tactic: 5701631 time 0.227232 [TensorRT] VERBOSE: Tactic: 5767167 time 0.403808 [TensorRT] VERBOSE: Tactic: 5832703 time 0.22624 [TensorRT] VERBOSE: Tactic: 5898239 time 0.17936 [TensorRT] VERBOSE: Tactic: 6029311 time 0.221056 [TensorRT] VERBOSE: Tactic: 6225919 time 0.167968 [TensorRT] VERBOSE: Tactic: 6291455 time 0.199872 [TensorRT] VERBOSE: Tactic: 6422527 time 0.214592 [TensorRT] VERBOSE: Tactic: 6750207 time 0.204256 [TensorRT] VERBOSE: Tactic: 6815743 time 0.220672 [TensorRT] VERBOSE: Tactic: 6946815 time 0.210016 [TensorRT] VERBOSE: Tactic: 7012351 time 0.218848 [TensorRT] VERBOSE: Tactic: 7077887 time 0.198336 [TensorRT] VERBOSE: Tactic: 7143423 time 0.28624 [TensorRT] VERBOSE: Tactic: 7208959 time 0.234496 [TensorRT] VERBOSE: Tactic: 7340031 time 0.183648 [TensorRT] VERBOSE: Tactic: 7405567 time 0.18128 [TensorRT] VERBOSE: Tactic: 7536639 time 0.208672 [TensorRT] VERBOSE: Tactic: 7602175 time 0.19248 [TensorRT] VERBOSE: Tactic: 7733247 time 0.167744 [TensorRT] VERBOSE: Tactic: 7798783 time 0.179808 [TensorRT] VERBOSE: Tactic: 8191999 time 0.401088 [TensorRT] VERBOSE: Tactic: 8257535 time 0.18944 [TensorRT] VERBOSE: Tactic: 8323071 time 0.219168 [TensorRT] VERBOSE: Tactic: 8650751 time 0.20928 [TensorRT] VERBOSE: Tactic: 8716287 time 0.169856 [TensorRT] VERBOSE: Tactic: 9109503 time 0.237536 [TensorRT] VERBOSE: Tactic: 9568255 time 0.172736 [TensorRT] VERBOSE: Tactic: 9895935 time 0.170752 [TensorRT] VERBOSE: Tactic: 10223615 time 0.229376 [TensorRT] VERBOSE: Tactic: 10354687 time 0.216192 [TensorRT] VERBOSE: Tactic: 10551295 time 0.1752 [TensorRT] VERBOSE: Tactic: 10747903 time 0.164672 [TensorRT] VERBOSE: Tactic: 10944511 time 0.22736 [TensorRT] VERBOSE: Fastest Tactic: 10747903 Time: 0.164672 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.113152 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.113216 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.141856 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.11584 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.119136 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.114176 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.121024 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.130656 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.142368 [TensorRT] VERBOSE: Fastest Tactic: 1754569683116234317 Time: 0.113152 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.1848 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 401408, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 37601280, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 1852928, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.1848 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.038016 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.052416 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.043456 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.04144 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.052832 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.045152 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.039744 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.0384 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.053088 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.036928 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.04336 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.036928 [TensorRT] VERBOSE: Fastest Tactic: -4973811344878172338 Time: 0.036928 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4973811344878172338 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.05632 [TensorRT] VERBOSE: Tactic: 655359 time 0.051552 [TensorRT] VERBOSE: Tactic: 786431 time 0.049472 [TensorRT] VERBOSE: Tactic: 851967 time 0.048224 [TensorRT] VERBOSE: Tactic: 1179647 time 0.061152 [TensorRT] VERBOSE: Tactic: 1310719 time 0.052224 [TensorRT] VERBOSE: Tactic: 1376255 time 0.069824 [TensorRT] VERBOSE: Tactic: 1441791 time 0.079232 [TensorRT] VERBOSE: Tactic: 1507327 time 0.047328 [TensorRT] VERBOSE: Tactic: 1638399 time 0.064384 [TensorRT] VERBOSE: Tactic: 1835007 time 0.0496 [TensorRT] VERBOSE: Tactic: 1900543 time 0.054272 [TensorRT] VERBOSE: Tactic: 2097151 time 0.048992 [TensorRT] VERBOSE: Tactic: 2162687 time 0.08224 [TensorRT] VERBOSE: Tactic: 2293759 time 0.069152 [TensorRT] VERBOSE: Tactic: 2359295 time 0.077408 [TensorRT] VERBOSE: Tactic: 2686975 time 0.076672 [TensorRT] VERBOSE: Tactic: 3080191 time 0.039904 [TensorRT] VERBOSE: Tactic: 3342335 time 0.048736 [TensorRT] VERBOSE: Tactic: 3407871 time 0.066624 [TensorRT] VERBOSE: Tactic: 3538943 time 0.060896 [TensorRT] VERBOSE: Tactic: 3670015 time 0.062944 [TensorRT] VERBOSE: Tactic: 3932159 time 0.054944 [TensorRT] VERBOSE: Tactic: 3997695 time 0.044288 [TensorRT] VERBOSE: Tactic: 4063231 time 0.043296 [TensorRT] VERBOSE: Tactic: 4194303 time 0.043136 [TensorRT] VERBOSE: Tactic: 4259839 time 0.05792 [TensorRT] VERBOSE: Tactic: 4325375 time 0.119936 [TensorRT] VERBOSE: Tactic: 4521983 time 0.119424 [TensorRT] VERBOSE: Tactic: 4587519 time 0.050592 [TensorRT] VERBOSE: Tactic: 4653055 time 0.068032 [TensorRT] VERBOSE: Tactic: 4915199 time 0.043008 [TensorRT] VERBOSE: Tactic: 4980735 time 0.122528 [TensorRT] VERBOSE: Tactic: 5177343 time 0.069056 [TensorRT] VERBOSE: Tactic: 5242879 time 0.055488 [TensorRT] VERBOSE: Tactic: 5373951 time 0.062944 [TensorRT] VERBOSE: Tactic: 5439487 time 0.04976 [TensorRT] VERBOSE: Tactic: 5570559 time 0.041472 [TensorRT] VERBOSE: Tactic: 5636095 time 0.042208 [TensorRT] VERBOSE: Tactic: 5701631 time 0.068032 [TensorRT] VERBOSE: Tactic: 5767167 time 0.07072 [TensorRT] VERBOSE: Tactic: 5832703 time 0.060544 [TensorRT] VERBOSE: Tactic: 5898239 time 0.0568 [TensorRT] VERBOSE: Tactic: 6029311 time 0.060832 [TensorRT] VERBOSE: Tactic: 6225919 time 0.050656 [TensorRT] VERBOSE: Tactic: 6291455 time 0.06176 [TensorRT] VERBOSE: Tactic: 6422527 time 0.040416 [TensorRT] VERBOSE: Tactic: 6750207 time 0.050176 [TensorRT] VERBOSE: Tactic: 6815743 time 0.05824 [TensorRT] VERBOSE: Tactic: 6946815 time 0.052224 [TensorRT] VERBOSE: Tactic: 7012351 time 0.0488 [TensorRT] VERBOSE: Tactic: 7077887 time 0.056544 [TensorRT] VERBOSE: Tactic: 7143423 time 0.074752 [TensorRT] VERBOSE: Tactic: 7208959 time 0.06336 [TensorRT] VERBOSE: Tactic: 7340031 time 0.057344 [TensorRT] VERBOSE: Tactic: 7405567 time 0.043136 [TensorRT] VERBOSE: Tactic: 7536639 time 0.069728 [TensorRT] VERBOSE: Tactic: 7602175 time 0.051776 [TensorRT] VERBOSE: Tactic: 7733247 time 0.054848 [TensorRT] VERBOSE: Tactic: 7798783 time 0.049728 [TensorRT] VERBOSE: Tactic: 8191999 time 0.079072 [TensorRT] VERBOSE: Tactic: 8257535 time 0.044352 [TensorRT] VERBOSE: Tactic: 8323071 time 0.047936 [TensorRT] VERBOSE: Tactic: 8650751 time 0.056768 [TensorRT] VERBOSE: Tactic: 8716287 time 0.053152 [TensorRT] VERBOSE: Tactic: 9109503 time 0.055936 [TensorRT] VERBOSE: Tactic: 9568255 time 0.04352 [TensorRT] VERBOSE: Tactic: 9895935 time 0.04352 [TensorRT] VERBOSE: Tactic: 10223615 time 0.077504 [TensorRT] VERBOSE: Tactic: 10354687 time 0.108032 [TensorRT] VERBOSE: Tactic: 10551295 time 0.0496 [TensorRT] VERBOSE: Tactic: 10747903 time 0.05376 [TensorRT] VERBOSE: Tactic: 10944511 time 0.121664 [TensorRT] VERBOSE: Fastest Tactic: 3080191 Time: 0.039904 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.034016 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.033216 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.03584 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.034688 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.048864 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.03312 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.037824 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.034784 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.032832 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.037504 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.04688 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.047136 [TensorRT] VERBOSE: Fastest Tactic: -7210942453088153035 Time: 0.032832 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7210942453088153035 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.034816 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.047104 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.037824 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.033952 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.037856 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.035136 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.034656 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.047136 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.034336 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.034272 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.0352 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.03472 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.033952 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_125 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.052224 [TensorRT] VERBOSE: Tactic: 655359 time 0.046944 [TensorRT] VERBOSE: Tactic: 786431 time 0.05696 [TensorRT] VERBOSE: Tactic: 851967 time 0.044128 [TensorRT] VERBOSE: Tactic: 1179647 time 0.06688 [TensorRT] VERBOSE: Tactic: 1310719 time 0.053056 [TensorRT] VERBOSE: Tactic: 1376255 time 0.072928 [TensorRT] VERBOSE: Tactic: 1441791 time 0.077184 [TensorRT] VERBOSE: Tactic: 1507327 time 0.047104 [TensorRT] VERBOSE: Tactic: 1638399 time 0.067584 [TensorRT] VERBOSE: Tactic: 1835007 time 0.064256 [TensorRT] VERBOSE: Tactic: 1900543 time 0.051328 [TensorRT] VERBOSE: Tactic: 2097151 time 0.060288 [TensorRT] VERBOSE: Tactic: 2162687 time 0.07952 [TensorRT] VERBOSE: Tactic: 2293759 time 0.072352 [TensorRT] VERBOSE: Tactic: 2359295 time 0.081344 [TensorRT] VERBOSE: Tactic: 2686975 time 0.079616 [TensorRT] VERBOSE: Tactic: 3080191 time 0.036192 [TensorRT] VERBOSE: Tactic: 3342335 time 0.04768 [TensorRT] VERBOSE: Tactic: 3407871 time 0.0728 [TensorRT] VERBOSE: Tactic: 3538943 time 0.068128 [TensorRT] VERBOSE: Tactic: 3670015 time 0.064608 [TensorRT] VERBOSE: Tactic: 3932159 time 0.054976 [TensorRT] VERBOSE: Tactic: 3997695 time 0.053312 [TensorRT] VERBOSE: Tactic: 4063231 time 0.039168 [TensorRT] VERBOSE: Tactic: 4194303 time 0.052384 [TensorRT] VERBOSE: Tactic: 4259839 time 0.062464 [TensorRT] VERBOSE: Tactic: 4325375 time 0.128576 [TensorRT] VERBOSE: Tactic: 4521983 time 0.127936 [TensorRT] VERBOSE: Tactic: 4587519 time 0.058208 [TensorRT] VERBOSE: Tactic: 4653055 time 0.072544 [TensorRT] VERBOSE: Tactic: 4915199 time 0.051264 [TensorRT] VERBOSE: Tactic: 4980735 time 0.130464 [TensorRT] VERBOSE: Tactic: 5177343 time 0.074048 [TensorRT] VERBOSE: Tactic: 5242879 time 0.06384 [TensorRT] VERBOSE: Tactic: 5373951 time 0.06624 [TensorRT] VERBOSE: Tactic: 5439487 time 0.063232 [TensorRT] VERBOSE: Tactic: 5570559 time 0.038624 [TensorRT] VERBOSE: Tactic: 5636095 time 0.039392 [TensorRT] VERBOSE: Tactic: 5701631 time 0.070304 [TensorRT] VERBOSE: Tactic: 5767167 time 0.09472 [TensorRT] VERBOSE: Tactic: 5832703 time 0.069248 [TensorRT] VERBOSE: Tactic: 5898239 time 0.059392 [TensorRT] VERBOSE: Tactic: 6029311 time 0.063392 [TensorRT] VERBOSE: Tactic: 6225919 time 0.059616 [TensorRT] VERBOSE: Tactic: 6291455 time 0.06576 [TensorRT] VERBOSE: Tactic: 6422527 time 0.036896 [TensorRT] VERBOSE: Tactic: 6750207 time 0.064512 [TensorRT] VERBOSE: Tactic: 6815743 time 0.063424 [TensorRT] VERBOSE: Tactic: 6946815 time 0.06592 [TensorRT] VERBOSE: Tactic: 7012351 time 0.060736 [TensorRT] VERBOSE: Tactic: 7077887 time 0.063712 [TensorRT] VERBOSE: Tactic: 7143423 time 0.104928 [TensorRT] VERBOSE: Tactic: 7208959 time 0.07568 [TensorRT] VERBOSE: Tactic: 7340031 time 0.061248 [TensorRT] VERBOSE: Tactic: 7405567 time 0.042688 [TensorRT] VERBOSE: Tactic: 7536639 time 0.078656 [TensorRT] VERBOSE: Tactic: 7602175 time 0.0616 [TensorRT] VERBOSE: Tactic: 7733247 time 0.058592 [TensorRT] VERBOSE: Tactic: 7798783 time 0.057024 [TensorRT] VERBOSE: Tactic: 8191999 time 0.09824 [TensorRT] VERBOSE: Tactic: 8257535 time 0.049312 [TensorRT] VERBOSE: Tactic: 8323071 time 0.0648 [TensorRT] VERBOSE: Tactic: 8650751 time 0.071136 [TensorRT] VERBOSE: Tactic: 8716287 time 0.058528 [TensorRT] VERBOSE: Tactic: 9109503 time 0.055328 [TensorRT] VERBOSE: Tactic: 9568255 time 0.050688 [TensorRT] VERBOSE: Tactic: 9895935 time 0.05376 [TensorRT] VERBOSE: Tactic: 10223615 time 0.07856 [TensorRT] VERBOSE: Tactic: 10354687 time 0.112928 [TensorRT] VERBOSE: Tactic: 10551295 time 0.064128 [TensorRT] VERBOSE: Tactic: 10747903 time 0.058336 [TensorRT] VERBOSE: Tactic: 10944511 time 0.13072 [TensorRT] VERBOSE: Fastest Tactic: 3080191 Time: 0.036192 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CaskConvolution) [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.016128 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.022624 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.016544 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.017408 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.022112 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.017568 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.017408 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.01744 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.017408 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.01776 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.022528 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.015584 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.015584 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_125 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019392 [TensorRT] VERBOSE: Tactic: 256 time 0.019232 [TensorRT] VERBOSE: Tactic: 512 time 0.019744 [TensorRT] VERBOSE: Tactic: -32 time 0.042272 [TensorRT] VERBOSE: Tactic: -64 time 0.02896 [TensorRT] VERBOSE: Tactic: -128 time 0.024992 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.019232 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.012896 [TensorRT] VERBOSE: Tactic: 1 time 0.012288 [TensorRT] VERBOSE: Tactic: 2 time 0.011232 [TensorRT] VERBOSE: Tactic: 3 time 0.013312 [TensorRT] VERBOSE: Tactic: 4 time 0.011232 [TensorRT] VERBOSE: Tactic: 5 time 0.011392 [TensorRT] VERBOSE: Tactic: 6 time 0.01232 [TensorRT] VERBOSE: Tactic: 7 time 0.010944 [TensorRT] VERBOSE: Tactic: 8 time 0.011456 [TensorRT] VERBOSE: Tactic: 9 time 0.012128 [TensorRT] VERBOSE: Tactic: 28 time 0.011808 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.010944 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.019648 [TensorRT] VERBOSE: Tactic: 256 time 0.0192 [TensorRT] VERBOSE: Tactic: 512 time 0.019584 [TensorRT] VERBOSE: Tactic: -32 time 0.043008 [TensorRT] VERBOSE: Tactic: -64 time 0.027072 [TensorRT] VERBOSE: Tactic: -128 time 0.025568 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.0192 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_126 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.01488 [TensorRT] VERBOSE: Tactic: 25 time 0.01456 [TensorRT] VERBOSE: Tactic: 26 time 0.014912 [TensorRT] VERBOSE: Tactic: 27 time 0.01408 [TensorRT] VERBOSE: Tactic: 31 time 0.014688 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.01408 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] WARNING: No implementation of layer LeakyRelu_126 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.024416 [TensorRT] VERBOSE: Tactic: 0 time 0.048384 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024416 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.04224 [TensorRT] VERBOSE: Tactic: 0 time 0.023488 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023488 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.008032 [TensorRT] VERBOSE: Tactic: 0 time 0.00624 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00624 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.013216 [TensorRT] VERBOSE: Tactic: 0 time 0.025376 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.013216 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016928 [TensorRT] VERBOSE: Tactic: 0 time 0.010688 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010688 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015584 [TensorRT] VERBOSE: Tactic: 0 time 0.017888 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015584 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0216 [TensorRT] VERBOSE: Tactic: 0 time 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014432 [TensorRT] VERBOSE: Tactic: 0 time 0.006208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006208 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017152 [TensorRT] VERBOSE: Tactic: 0 time 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017152 [TensorRT] VERBOSE: Tactic: 0 time 0.02224 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.017152 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017216 [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006016 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015584 [TensorRT] VERBOSE: Tactic: 0 time 0.018432 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015584 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.021344 [TensorRT] VERBOSE: Tactic: 0 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012288 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01744 [TensorRT] VERBOSE: Tactic: 0 time 0.012672 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012672 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015648 [TensorRT] VERBOSE: Tactic: 0 time 0.0224 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015648 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016096 [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006144 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016736 [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016288 [TensorRT] VERBOSE: Tactic: 0 time 0.009632 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009632 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017152 [TensorRT] VERBOSE: Tactic: 0 time 0.009184 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009184 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.166976 [TensorRT] VERBOSE: Tactic: 655359 time 0.117536 [TensorRT] VERBOSE: Tactic: 786431 time 0.058304 [TensorRT] VERBOSE: Tactic: 851967 time 0.072192 [TensorRT] VERBOSE: Tactic: 1179647 time 0.059968 [TensorRT] VERBOSE: Tactic: 1310719 time 0.125376 [TensorRT] VERBOSE: Tactic: 1376255 time 0.120352 [TensorRT] VERBOSE: Tactic: 1441791 time 0.095712 [TensorRT] VERBOSE: Tactic: 1507327 time 0.078752 [TensorRT] VERBOSE: Tactic: 1638399 time 0.076928 [TensorRT] VERBOSE: Tactic: 1835007 time 0.061184 [TensorRT] VERBOSE: Tactic: 1900543 time 0.124672 [TensorRT] VERBOSE: Tactic: 2097151 time 0.061728 [TensorRT] VERBOSE: Tactic: 2162687 time 0.121856 [TensorRT] VERBOSE: Tactic: 2293759 time 0.113312 [TensorRT] VERBOSE: Tactic: 2359295 time 0.07616 [TensorRT] VERBOSE: Tactic: 2686975 time 0.115616 [TensorRT] VERBOSE: Tactic: 3080191 time 0.072032 [TensorRT] VERBOSE: Tactic: 3342335 time 0.076128 [TensorRT] VERBOSE: Tactic: 3407871 time 0.07168 [TensorRT] VERBOSE: Tactic: 3538943 time 0.066656 [TensorRT] VERBOSE: Tactic: 3670015 time 0.203424 [TensorRT] VERBOSE: Tactic: 3932159 time 0.110336 [TensorRT] VERBOSE: Tactic: 3997695 time 0.05632 [TensorRT] VERBOSE: Tactic: 4063231 time 0.072256 [TensorRT] VERBOSE: Tactic: 4194303 time 0.057216 [TensorRT] VERBOSE: Tactic: 4259839 time 0.062368 [TensorRT] VERBOSE: Tactic: 4325375 time 0.069056 [TensorRT] VERBOSE: Tactic: 4521983 time 0.109568 [TensorRT] VERBOSE: Tactic: 4587519 time 0.056672 [TensorRT] VERBOSE: Tactic: 4653055 time 0.054336 [TensorRT] VERBOSE: Tactic: 4915199 time 0.054496 [TensorRT] VERBOSE: Tactic: 4980735 time 0.073376 [TensorRT] VERBOSE: Tactic: 5177343 time 0.067008 [TensorRT] VERBOSE: Tactic: 5242879 time 0.071104 [TensorRT] VERBOSE: Tactic: 5373951 time 0.070048 [TensorRT] VERBOSE: Tactic: 5439487 time 0.077824 [TensorRT] VERBOSE: Tactic: 5570559 time 0.073472 [TensorRT] VERBOSE: Tactic: 5636095 time 0.073632 [TensorRT] VERBOSE: Tactic: 5701631 time 0.11536 [TensorRT] VERBOSE: Tactic: 5767167 time 0.083104 [TensorRT] VERBOSE: Tactic: 5832703 time 0.074688 [TensorRT] VERBOSE: Tactic: 5898239 time 0.057408 [TensorRT] VERBOSE: Tactic: 6029311 time 0.107936 [TensorRT] VERBOSE: Tactic: 6225919 time 0.051872 [TensorRT] VERBOSE: Tactic: 6291455 time 0.059808 [TensorRT] VERBOSE: Tactic: 6422527 time 0.067584 [TensorRT] VERBOSE: Tactic: 6750207 time 0.058784 [TensorRT] VERBOSE: Tactic: 6815743 time 0.07024 [TensorRT] VERBOSE: Tactic: 6946815 time 0.06048 [TensorRT] VERBOSE: Tactic: 7012351 time 0.058848 [TensorRT] VERBOSE: Tactic: 7077887 time 0.067648 [TensorRT] VERBOSE: Tactic: 7143423 time 0.079264 [TensorRT] VERBOSE: Tactic: 7208959 time 0.073728 [TensorRT] VERBOSE: Tactic: 7340031 time 0.05568 [TensorRT] VERBOSE: Tactic: 7405567 time 0.063808 [TensorRT] VERBOSE: Tactic: 7536639 time 0.105824 [TensorRT] VERBOSE: Tactic: 7602175 time 0.058816 [TensorRT] VERBOSE: Tactic: 7733247 time 0.055584 [TensorRT] VERBOSE: Tactic: 7798783 time 0.059616 [TensorRT] VERBOSE: Tactic: 8191999 time 0.077152 [TensorRT] VERBOSE: Tactic: 8257535 time 0.056512 [TensorRT] VERBOSE: Tactic: 8323071 time 0.077632 [TensorRT] VERBOSE: Tactic: 8650751 time 0.06144 [TensorRT] VERBOSE: Tactic: 8716287 time 0.055104 [TensorRT] VERBOSE: Tactic: 9109503 time 0.062816 [TensorRT] VERBOSE: Tactic: 9568255 time 0.055104 [TensorRT] VERBOSE: Tactic: 9895935 time 0.059392 [TensorRT] VERBOSE: Tactic: 10223615 time 0.113152 [TensorRT] VERBOSE: Tactic: 10354687 time 0.062848 [TensorRT] VERBOSE: Tactic: 10551295 time 0.074304 [TensorRT] VERBOSE: Tactic: 10747903 time 0.054944 [TensorRT] VERBOSE: Tactic: 10944511 time 0.0744 [TensorRT] VERBOSE: Fastest Tactic: 6225919 Time: 0.051872 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.060448 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.060032 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.06976 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.06096 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.045376 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.045248 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.046368 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.0616 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.070496 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.045248 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.06032 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 200704, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 9887744, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.059936 [TensorRT] VERBOSE: Fastest Tactic: 57 Time: 0.059936 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.022752 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.023936 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.024576 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.017568 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.023808 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.023936 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.017152 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.017824 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.022528 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.022528 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.022528 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.022688 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.017152 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.026592 [TensorRT] VERBOSE: Tactic: 655359 time 0.023552 [TensorRT] VERBOSE: Tactic: 786431 time 0.018624 [TensorRT] VERBOSE: Tactic: 851967 time 0.01872 [TensorRT] VERBOSE: Tactic: 1179647 time 0.021952 [TensorRT] VERBOSE: Tactic: 1310719 time 0.023584 [TensorRT] VERBOSE: Tactic: 1376255 time 0.03168 [TensorRT] VERBOSE: Tactic: 1441791 time 0.026208 [TensorRT] VERBOSE: Tactic: 1507327 time 0.020416 [TensorRT] VERBOSE: Tactic: 1638399 time 0.023264 [TensorRT] VERBOSE: Tactic: 1835007 time 0.020288 [TensorRT] VERBOSE: Tactic: 1900543 time 0.026816 [TensorRT] VERBOSE: Tactic: 2097151 time 0.01872 [TensorRT] VERBOSE: Tactic: 2162687 time 0.040864 [TensorRT] VERBOSE: Tactic: 2293759 time 0.02832 [TensorRT] VERBOSE: Tactic: 2359295 time 0.03248 [TensorRT] VERBOSE: Tactic: 2686975 time 0.031584 [TensorRT] VERBOSE: Tactic: 3080191 time 0.019104 [TensorRT] VERBOSE: Tactic: 3342335 time 0.02048 [TensorRT] VERBOSE: Tactic: 3407871 time 0.023296 [TensorRT] VERBOSE: Tactic: 3538943 time 0.021792 [TensorRT] VERBOSE: Tactic: 3670015 time 0.032736 [TensorRT] VERBOSE: Tactic: 3932159 time 0.022336 [TensorRT] VERBOSE: Tactic: 3997695 time 0.01888 [TensorRT] VERBOSE: Tactic: 4063231 time 0.020224 [TensorRT] VERBOSE: Tactic: 4194303 time 0.018112 [TensorRT] VERBOSE: Tactic: 4259839 time 0.021984 [TensorRT] VERBOSE: Tactic: 4325375 time 0.036672 [TensorRT] VERBOSE: Tactic: 4521983 time 0.04096 [TensorRT] VERBOSE: Tactic: 4587519 time 0.018944 [TensorRT] VERBOSE: Tactic: 4653055 time 0.023552 [TensorRT] VERBOSE: Tactic: 4915199 time 0.017184 [TensorRT] VERBOSE: Tactic: 4980735 time 0.04112 [TensorRT] VERBOSE: Tactic: 5177343 time 0.023584 [TensorRT] VERBOSE: Tactic: 5242879 time 0.020512 [TensorRT] VERBOSE: Tactic: 5373951 time 0.021856 [TensorRT] VERBOSE: Tactic: 5439487 time 0.018752 [TensorRT] VERBOSE: Tactic: 5570559 time 0.017184 [TensorRT] VERBOSE: Tactic: 5636095 time 0.019296 [TensorRT] VERBOSE: Tactic: 5701631 time 0.027744 [TensorRT] VERBOSE: Tactic: 5767167 time 0.02288 [TensorRT] VERBOSE: Tactic: 5832703 time 0.021952 [TensorRT] VERBOSE: Tactic: 5898239 time 0.021152 [TensorRT] VERBOSE: Tactic: 6029311 time 0.024256 [TensorRT] VERBOSE: Tactic: 6225919 time 0.018752 [TensorRT] VERBOSE: Tactic: 6291455 time 0.02208 [TensorRT] VERBOSE: Tactic: 6422527 time 0.017408 [TensorRT] VERBOSE: Tactic: 6750207 time 0.018816 [TensorRT] VERBOSE: Tactic: 6815743 time 0.021856 [TensorRT] VERBOSE: Tactic: 6946815 time 0.019008 [TensorRT] VERBOSE: Tactic: 7012351 time 0.019008 [TensorRT] VERBOSE: Tactic: 7077887 time 0.020288 [TensorRT] VERBOSE: Tactic: 7143423 time 0.024608 [TensorRT] VERBOSE: Tactic: 7208959 time 0.022496 [TensorRT] VERBOSE: Tactic: 7340031 time 0.021984 [TensorRT] VERBOSE: Tactic: 7405567 time 0.017088 [TensorRT] VERBOSE: Tactic: 7536639 time 0.026496 [TensorRT] VERBOSE: Tactic: 7602175 time 0.019104 [TensorRT] VERBOSE: Tactic: 7733247 time 0.020256 [TensorRT] VERBOSE: Tactic: 7798783 time 0.01888 [TensorRT] VERBOSE: Tactic: 8191999 time 0.025248 [TensorRT] VERBOSE: Tactic: 8257535 time 0.01728 [TensorRT] VERBOSE: Tactic: 8323071 time 0.018624 [TensorRT] VERBOSE: Tactic: 8650751 time 0.020672 [TensorRT] VERBOSE: Tactic: 8716287 time 0.018752 [TensorRT] VERBOSE: Tactic: 9109503 time 0.021856 [TensorRT] VERBOSE: Tactic: 9568255 time 0.017184 [TensorRT] VERBOSE: Tactic: 9895935 time 0.01888 [TensorRT] VERBOSE: Tactic: 10223615 time 0.030976 [TensorRT] VERBOSE: Tactic: 10354687 time 0.03408 [TensorRT] VERBOSE: Tactic: 10551295 time 0.020576 [TensorRT] VERBOSE: Tactic: 10747903 time 0.02048 [TensorRT] VERBOSE: Tactic: 10944511 time 0.040736 [TensorRT] VERBOSE: Fastest Tactic: 7405567 Time: 0.017088 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.014336 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.020352 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.015584 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.015488 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.021088 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.020352 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.022272 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.0208 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.020544 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.020704 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.021792 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.020576 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3145259992339075399 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.020672 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.021536 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.021632 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.01456 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.020768 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.015584 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.02048 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.020544 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.020928 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.02064 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.015776 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.020384 [TensorRT] VERBOSE: Fastest Tactic: 2339361327868109050 Time: 0.01456 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2339361327868109050 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_140 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.022112 [TensorRT] VERBOSE: Tactic: 655359 time 0.021888 [TensorRT] VERBOSE: Tactic: 786431 time 0.018848 [TensorRT] VERBOSE: Tactic: 851967 time 0.017408 [TensorRT] VERBOSE: Tactic: 1179647 time 0.022368 [TensorRT] VERBOSE: Tactic: 1310719 time 0.02192 [TensorRT] VERBOSE: Tactic: 1376255 time 0.033184 [TensorRT] VERBOSE: Tactic: 1441791 time 0.026656 [TensorRT] VERBOSE: Tactic: 1507327 time 0.019008 [TensorRT] VERBOSE: Tactic: 1638399 time 0.023712 [TensorRT] VERBOSE: Tactic: 1835007 time 0.020256 [TensorRT] VERBOSE: Tactic: 1900543 time 0.023968 [TensorRT] VERBOSE: Tactic: 2097151 time 0.022336 [TensorRT] VERBOSE: Tactic: 2162687 time 0.037088 [TensorRT] VERBOSE: Tactic: 2293759 time 0.026816 [TensorRT] VERBOSE: Tactic: 2359295 time 0.02896 [TensorRT] VERBOSE: Tactic: 2686975 time 0.029024 [TensorRT] VERBOSE: Tactic: 3080191 time 0.015712 [TensorRT] VERBOSE: Tactic: 3342335 time 0.018784 [TensorRT] VERBOSE: Tactic: 3407871 time 0.024 [TensorRT] VERBOSE: Tactic: 3538943 time 0.023552 [TensorRT] VERBOSE: Tactic: 3670015 time 0.029664 [TensorRT] VERBOSE: Tactic: 3932159 time 0.020352 [TensorRT] VERBOSE: Tactic: 3997695 time 0.01888 [TensorRT] VERBOSE: Tactic: 4063231 time 0.018688 [TensorRT] VERBOSE: Tactic: 4194303 time 0.020416 [TensorRT] VERBOSE: Tactic: 4259839 time 0.023008 [TensorRT] VERBOSE: Tactic: 4325375 time 0.03904 [TensorRT] VERBOSE: Tactic: 4521983 time 0.042528 [TensorRT] VERBOSE: Tactic: 4587519 time 0.020768 [TensorRT] VERBOSE: Tactic: 4653055 time 0.02528 [TensorRT] VERBOSE: Tactic: 4915199 time 0.018848 [TensorRT] VERBOSE: Tactic: 4980735 time 0.04288 [TensorRT] VERBOSE: Tactic: 5177343 time 0.024704 [TensorRT] VERBOSE: Tactic: 5242879 time 0.021824 [TensorRT] VERBOSE: Tactic: 5373951 time 0.022112 [TensorRT] VERBOSE: Tactic: 5439487 time 0.0208 [TensorRT] VERBOSE: Tactic: 5570559 time 0.015456 [TensorRT] VERBOSE: Tactic: 5636095 time 0.017344 [TensorRT] VERBOSE: Tactic: 5701631 time 0.02544 [TensorRT] VERBOSE: Tactic: 5767167 time 0.028064 [TensorRT] VERBOSE: Tactic: 5832703 time 0.02336 [TensorRT] VERBOSE: Tactic: 5898239 time 0.021312 [TensorRT] VERBOSE: Tactic: 6029311 time 0.023424 [TensorRT] VERBOSE: Tactic: 6225919 time 0.020352 [TensorRT] VERBOSE: Tactic: 6291455 time 0.02352 [TensorRT] VERBOSE: Tactic: 6422527 time 0.015552 [TensorRT] VERBOSE: Tactic: 6750207 time 0.021184 [TensorRT] VERBOSE: Tactic: 6815743 time 0.021504 [TensorRT] VERBOSE: Tactic: 6946815 time 0.021952 [TensorRT] VERBOSE: Tactic: 7012351 time 0.021984 [TensorRT] VERBOSE: Tactic: 7077887 time 0.021632 [TensorRT] VERBOSE: Tactic: 7143423 time 0.03152 [TensorRT] VERBOSE: Tactic: 7208959 time 0.025728 [TensorRT] VERBOSE: Tactic: 7340031 time 0.021152 [TensorRT] VERBOSE: Tactic: 7405567 time 0.016224 [TensorRT] VERBOSE: Tactic: 7536639 time 0.027712 [TensorRT] VERBOSE: Tactic: 7602175 time 0.021984 [TensorRT] VERBOSE: Tactic: 7733247 time 0.020288 [TensorRT] VERBOSE: Tactic: 7798783 time 0.020256 [TensorRT] VERBOSE: Tactic: 8191999 time 0.031104 [TensorRT] VERBOSE: Tactic: 8257535 time 0.018496 [TensorRT] VERBOSE: Tactic: 8323071 time 0.022368 [TensorRT] VERBOSE: Tactic: 8650751 time 0.023616 [TensorRT] VERBOSE: Tactic: 8716287 time 0.02048 [TensorRT] VERBOSE: Tactic: 9109503 time 0.020416 [TensorRT] VERBOSE: Tactic: 9568255 time 0.018656 [TensorRT] VERBOSE: Tactic: 9895935 time 0.020448 [TensorRT] VERBOSE: Tactic: 10223615 time 0.02944 [TensorRT] VERBOSE: Tactic: 10354687 time 0.034528 [TensorRT] VERBOSE: Tactic: 10551295 time 0.022016 [TensorRT] VERBOSE: Tactic: 10747903 time 0.020512 [TensorRT] VERBOSE: Tactic: 10944511 time 0.044224 [TensorRT] VERBOSE: Fastest Tactic: 5570559 Time: 0.015456 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CaskConvolution) [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.012576 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.015552 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.012352 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.01248 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.015584 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.012352 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.012352 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.012 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.012288 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.01264 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.01568 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.012 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_140 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014336 [TensorRT] VERBOSE: Tactic: 0 time 0.025184 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016352 [TensorRT] VERBOSE: Tactic: 0 time 0.025536 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016352 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015936 [TensorRT] VERBOSE: Tactic: 0 time 0.025696 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015936 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 256 time 0.01136 [TensorRT] VERBOSE: Tactic: 512 time 0.011232 [TensorRT] VERBOSE: Tactic: -32 time 0.028672 [TensorRT] VERBOSE: Tactic: -64 time 0.017664 [TensorRT] VERBOSE: Tactic: -128 time 0.014272 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.011232 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006368 [TensorRT] VERBOSE: Tactic: 1 time 0.006368 [TensorRT] VERBOSE: Tactic: 2 time 0.005728 [TensorRT] VERBOSE: Tactic: 3 time 0.006464 [TensorRT] VERBOSE: Tactic: 4 time 0.006464 [TensorRT] VERBOSE: Tactic: 5 time 0.006432 [TensorRT] VERBOSE: Tactic: 6 time 0.006336 [TensorRT] VERBOSE: Tactic: 7 time 0.006272 [TensorRT] VERBOSE: Tactic: 8 time 0.006368 [TensorRT] VERBOSE: Tactic: 9 time 0.0064 [TensorRT] VERBOSE: Tactic: 28 time 0.006208 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.005728 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011168 [TensorRT] VERBOSE: Tactic: 256 time 0.011168 [TensorRT] VERBOSE: Tactic: 512 time 0.011136 [TensorRT] VERBOSE: Tactic: -32 time 0.027264 [TensorRT] VERBOSE: Tactic: -64 time 0.017344 [TensorRT] VERBOSE: Tactic: -128 time 0.0144 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.011136 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009216 [TensorRT] VERBOSE: Tactic: 25 time 0.009216 [TensorRT] VERBOSE: Tactic: 26 time 0.008256 [TensorRT] VERBOSE: Tactic: 27 time 0.008128 [TensorRT] VERBOSE: Tactic: 31 time 0.009184 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.008128 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013792 [TensorRT] VERBOSE: Tactic: 256 time 0.013856 [TensorRT] VERBOSE: Tactic: 512 time 0.013792 [TensorRT] VERBOSE: Tactic: -32 time 0.024896 [TensorRT] VERBOSE: Tactic: -64 time 0.018496 [TensorRT] VERBOSE: Tactic: -128 time 0.01712 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013792 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006272 [TensorRT] VERBOSE: Tactic: 1 time 0.00608 [TensorRT] VERBOSE: Tactic: 2 time 0.006176 [TensorRT] VERBOSE: Tactic: 3 time 0.005984 [TensorRT] VERBOSE: Tactic: 4 time 0.006048 [TensorRT] VERBOSE: Tactic: 5 time 0.006048 [TensorRT] VERBOSE: Tactic: 6 time 0.006144 [TensorRT] VERBOSE: Tactic: 7 time 0.007552 [TensorRT] VERBOSE: Tactic: 8 time 0.00752 [TensorRT] VERBOSE: Tactic: 9 time 0.007616 [TensorRT] VERBOSE: Tactic: 10 time 0.007616 [TensorRT] VERBOSE: Tactic: 11 time 0.007552 [TensorRT] VERBOSE: Tactic: 12 time 0.00752 [TensorRT] VERBOSE: Tactic: 13 time 0.007328 [TensorRT] VERBOSE: Tactic: 14 time 0.007552 [TensorRT] VERBOSE: Tactic: 15 time 0.007648 [TensorRT] VERBOSE: Tactic: 16 time 0.00736 [TensorRT] VERBOSE: Tactic: 17 time 0.007584 [TensorRT] VERBOSE: Tactic: 18 time 0.007328 [TensorRT] VERBOSE: Tactic: 19 time 0.007552 [TensorRT] VERBOSE: Tactic: 20 time 0.012288 [TensorRT] VERBOSE: Tactic: 21 time 0.009472 [TensorRT] VERBOSE: Tactic: 22 time 0.007936 [TensorRT] VERBOSE: Tactic: 23 time 0.007488 [TensorRT] VERBOSE: Tactic: 28 time 0.00752 [TensorRT] VERBOSE: Tactic: 29 time 0.00928 [TensorRT] VERBOSE: Tactic: 30 time 0.010688 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01408 [TensorRT] VERBOSE: Tactic: 256 time 0.014048 [TensorRT] VERBOSE: Tactic: 512 time 0.01376 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.01376 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_141 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006016 [TensorRT] VERBOSE: Tactic: 11 time 0.00752 [TensorRT] VERBOSE: Tactic: 12 time 0.006496 [TensorRT] VERBOSE: Tactic: 13 time 0.00896 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.009312 [TensorRT] VERBOSE: Tactic: 16 time 0.013824 [TensorRT] VERBOSE: Tactic: 17 time 0.013184 [TensorRT] VERBOSE: Tactic: 18 time 0.013792 [TensorRT] VERBOSE: Tactic: 19 time 0.01536 [TensorRT] VERBOSE: Tactic: 20 time 0.006016 [TensorRT] VERBOSE: Tactic: 21 time 0.006048 [TensorRT] VERBOSE: Tactic: 22 time 0.007392 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 24 time 0.006016 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.005984 [TensorRT] VERBOSE: Tactic: 27 time 0.007424 [TensorRT] VERBOSE: Tactic: 29 time 0.01536 [TensorRT] VERBOSE: Tactic: 30 time 0.01072 [TensorRT] VERBOSE: Tactic: 31 time 0.00768 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.2816 [TensorRT] VERBOSE: Tactic: 720895 time 0.342368 [TensorRT] VERBOSE: Tactic: 983039 time 0.223872 [TensorRT] VERBOSE: Tactic: 1048575 time 0.317312 [TensorRT] VERBOSE: Tactic: 1703935 time 0.26976 [TensorRT] VERBOSE: Tactic: 1769471 time 0.24144 [TensorRT] VERBOSE: Tactic: 1966079 time 0.39856 [TensorRT] VERBOSE: Tactic: 2031615 time 0.44672 [TensorRT] VERBOSE: Tactic: 2228223 time 0.363616 [TensorRT] VERBOSE: Tactic: 2424831 time 0.291744 [TensorRT] VERBOSE: Tactic: 2621439 time 0.263136 [TensorRT] VERBOSE: Tactic: 2752511 time 0.291328 [TensorRT] VERBOSE: Tactic: 2818047 time 0.274368 [TensorRT] VERBOSE: Tactic: 2883583 time 0.476096 [TensorRT] VERBOSE: Tactic: 3014655 time 0.224896 [TensorRT] VERBOSE: Tactic: 3145727 time 0.20992 [TensorRT] VERBOSE: Tactic: 3473407 time 0.324 [TensorRT] VERBOSE: Tactic: 3604479 time 0.22512 [TensorRT] VERBOSE: Tactic: 3735551 time 0.265696 [TensorRT] VERBOSE: Tactic: 4390911 time 0.421824 [TensorRT] VERBOSE: Tactic: 5046271 time 0.282592 [TensorRT] VERBOSE: Tactic: 5963775 time 0.376288 [TensorRT] VERBOSE: Tactic: 6160383 time 0.26624 [TensorRT] VERBOSE: Tactic: 6488063 time 0.236544 [TensorRT] VERBOSE: Tactic: 6881279 time 0.36528 [TensorRT] VERBOSE: Tactic: 7274495 time 0.245312 [TensorRT] VERBOSE: Tactic: 7864319 time 0.264384 [TensorRT] VERBOSE: Tactic: 7995391 time 0.274272 [TensorRT] VERBOSE: Tactic: 8585215 time 0.305184 [TensorRT] VERBOSE: Tactic: 8847359 time 0.258432 [TensorRT] VERBOSE: Tactic: 8978431 time 0.373824 [TensorRT] VERBOSE: Tactic: 9043967 time 0.204832 [TensorRT] VERBOSE: Tactic: 9175039 time 0.223744 [TensorRT] VERBOSE: Tactic: 9502719 time 0.42032 [TensorRT] VERBOSE: Tactic: 9830399 time 0.25664 [TensorRT] VERBOSE: Tactic: 9961471 time 0.259744 [TensorRT] VERBOSE: Tactic: 10027007 time 0.273248 [TensorRT] VERBOSE: Tactic: 10092543 time 0.423232 [TensorRT] VERBOSE: Tactic: 10289151 time 0.398656 [TensorRT] VERBOSE: Tactic: 10485759 time 0.215744 [TensorRT] VERBOSE: Tactic: 10682367 time 0.248576 [TensorRT] VERBOSE: Tactic: 10813439 time 0.246016 [TensorRT] VERBOSE: Fastest Tactic: 9043967 Time: 0.204832 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.469056 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.121728 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.376992 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.459552 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.475648 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.336896 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.374624 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.44656 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.54208 [TensorRT] VERBOSE: Fastest Tactic: 2775507031594384867 Time: 0.121728 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.379296 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 1806336, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 287440896, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 6554624, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 5121536, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.379296 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.124512 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.132096 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.144 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.098784 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.127232 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.158688 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.099328 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.08704 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.12352 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.126624 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.08704 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.07632 [TensorRT] VERBOSE: Tactic: 720895 time 0.098944 [TensorRT] VERBOSE: Tactic: 983039 time 0.064512 [TensorRT] VERBOSE: Tactic: 1048575 time 0.09456 [TensorRT] VERBOSE: Tactic: 1703935 time 0.079584 [TensorRT] VERBOSE: Tactic: 1769471 time 0.073856 [TensorRT] VERBOSE: Tactic: 1966079 time 0.10656 [TensorRT] VERBOSE: Tactic: 2031615 time 0.11984 [TensorRT] VERBOSE: Tactic: 2228223 time 0.160768 [TensorRT] VERBOSE: Tactic: 2424831 time 0.13312 [TensorRT] VERBOSE: Tactic: 2621439 time 0.08016 [TensorRT] VERBOSE: Tactic: 2752511 time 0.088224 [TensorRT] VERBOSE: Tactic: 2818047 time 0.077344 [TensorRT] VERBOSE: Tactic: 2883583 time 0.134432 [TensorRT] VERBOSE: Tactic: 3014655 time 0.0832 [TensorRT] VERBOSE: Tactic: 3145727 time 0.062208 [TensorRT] VERBOSE: Tactic: 3473407 time 0.09168 [TensorRT] VERBOSE: Tactic: 3604479 time 0.062784 [TensorRT] VERBOSE: Tactic: 3735551 time 0.080832 [TensorRT] VERBOSE: Tactic: 4390911 time 0.12432 [TensorRT] VERBOSE: Tactic: 5046271 time 0.085024 [TensorRT] VERBOSE: Tactic: 5963775 time 0.105888 [TensorRT] VERBOSE: Tactic: 6160383 time 0.137504 [TensorRT] VERBOSE: Tactic: 6488063 time 0.087584 [TensorRT] VERBOSE: Tactic: 6881279 time 0.10624 [TensorRT] VERBOSE: Tactic: 7274495 time 0.065472 [TensorRT] VERBOSE: Tactic: 7864319 time 0.083456 [TensorRT] VERBOSE: Tactic: 7995391 time 0.09792 [TensorRT] VERBOSE: Tactic: 8585215 time 0.106304 [TensorRT] VERBOSE: Tactic: 8847359 time 0.063232 [TensorRT] VERBOSE: Tactic: 8978431 time 0.099488 [TensorRT] VERBOSE: Tactic: 9043967 time 0.06288 [TensorRT] VERBOSE: Tactic: 9175039 time 0.064512 [TensorRT] VERBOSE: Tactic: 9502719 time 0.135072 [TensorRT] VERBOSE: Tactic: 9830399 time 0.088544 [TensorRT] VERBOSE: Tactic: 9961471 time 0.097952 [TensorRT] VERBOSE: Tactic: 10027007 time 0.08208 [TensorRT] VERBOSE: Tactic: 10092543 time 0.125088 [TensorRT] VERBOSE: Tactic: 10289151 time 0.106816 [TensorRT] VERBOSE: Tactic: 10485759 time 0.068416 [TensorRT] VERBOSE: Tactic: 10682367 time 0.072032 [TensorRT] VERBOSE: Tactic: 10813439 time 0.072288 [TensorRT] VERBOSE: Fastest Tactic: 3145727 Time: 0.062208 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.094144 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.081632 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.134592 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.122208 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.153248 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.119616 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.138624 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.122944 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.125088 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.094656 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.081632 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 3145727 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.1352 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.155104 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.093728 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.137472 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.082944 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.127552 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.11968 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.09664 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.121824 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.122304 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.082944 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_142 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.078144 [TensorRT] VERBOSE: Tactic: 720895 time 0.100352 [TensorRT] VERBOSE: Tactic: 983039 time 0.063744 [TensorRT] VERBOSE: Tactic: 1048575 time 0.091744 [TensorRT] VERBOSE: Tactic: 1703935 time 0.079168 [TensorRT] VERBOSE: Tactic: 1769471 time 0.073184 [TensorRT] VERBOSE: Tactic: 1966079 time 0.103456 [TensorRT] VERBOSE: Tactic: 2031615 time 0.116288 [TensorRT] VERBOSE: Tactic: 2228223 time 0.169824 [TensorRT] VERBOSE: Tactic: 2424831 time 0.144096 [TensorRT] VERBOSE: Tactic: 2621439 time 0.075424 [TensorRT] VERBOSE: Tactic: 2752511 time 0.085376 [TensorRT] VERBOSE: Tactic: 2818047 time 0.07712 [TensorRT] VERBOSE: Tactic: 2883583 time 0.133792 [TensorRT] VERBOSE: Tactic: 3014655 time 0.085376 [TensorRT] VERBOSE: Tactic: 3145727 time 0.063104 [TensorRT] VERBOSE: Tactic: 3473407 time 0.089696 [TensorRT] VERBOSE: Tactic: 3604479 time 0.062752 [TensorRT] VERBOSE: Tactic: 3735551 time 0.081376 [TensorRT] VERBOSE: Tactic: 4390911 time 0.125504 [TensorRT] VERBOSE: Tactic: 5046271 time 0.08704 [TensorRT] VERBOSE: Tactic: 5963775 time 0.099328 [TensorRT] VERBOSE: Tactic: 6160383 time 0.142944 [TensorRT] VERBOSE: Tactic: 6488063 time 0.08656 [TensorRT] VERBOSE: Tactic: 6881279 time 0.105088 [TensorRT] VERBOSE: Tactic: 7274495 time 0.06656 [TensorRT] VERBOSE: Tactic: 7864319 time 0.083744 [TensorRT] VERBOSE: Tactic: 7995391 time 0.07328 [TensorRT] VERBOSE: Tactic: 8585215 time 0.099168 [TensorRT] VERBOSE: Tactic: 8847359 time 0.064864 [TensorRT] VERBOSE: Tactic: 8978431 time 0.097248 [TensorRT] VERBOSE: Tactic: 9043967 time 0.0648 [TensorRT] VERBOSE: Tactic: 9175039 time 0.065536 [TensorRT] VERBOSE: Tactic: 9502719 time 0.13904 [TensorRT] VERBOSE: Tactic: 9830399 time 0.069792 [TensorRT] VERBOSE: Tactic: 9961471 time 0.116736 [TensorRT] VERBOSE: Tactic: 10027007 time 0.084096 [TensorRT] VERBOSE: Tactic: 10092543 time 0.124896 [TensorRT] VERBOSE: Tactic: 10289151 time 0.104224 [TensorRT] VERBOSE: Tactic: 10485759 time 0.068704 [TensorRT] VERBOSE: Tactic: 10682367 time 0.072192 [TensorRT] VERBOSE: Tactic: 10813439 time 0.068992 [TensorRT] VERBOSE: Fastest Tactic: 3604479 Time: 0.062752 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CaskConvolution) [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.053184 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.058048 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.068544 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.051872 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.051904 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.058848 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.075648 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.053248 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.05728 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.048672 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.066496 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.046784 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.046784 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_142 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013888 [TensorRT] VERBOSE: Tactic: 256 time 0.01456 [TensorRT] VERBOSE: Tactic: 512 time 0.014688 [TensorRT] VERBOSE: Tactic: -32 time 0.050112 [TensorRT] VERBOSE: Tactic: -64 time 0.028448 [TensorRT] VERBOSE: Tactic: -128 time 0.01984 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013888 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01024 [TensorRT] VERBOSE: Tactic: 1 time 0.009856 [TensorRT] VERBOSE: Tactic: 2 time 0.008992 [TensorRT] VERBOSE: Tactic: 3 time 0.009632 [TensorRT] VERBOSE: Tactic: 4 time 0.009984 [TensorRT] VERBOSE: Tactic: 5 time 0.01024 [TensorRT] VERBOSE: Tactic: 6 time 0.010336 [TensorRT] VERBOSE: Tactic: 7 time 0.009376 [TensorRT] VERBOSE: Tactic: 8 time 0.009312 [TensorRT] VERBOSE: Tactic: 9 time 0.009632 [TensorRT] VERBOSE: Tactic: 28 time 0.009568 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.008992 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014336 [TensorRT] VERBOSE: Tactic: 256 time 0.014624 [TensorRT] VERBOSE: Tactic: 512 time 0.015072 [TensorRT] VERBOSE: Tactic: -32 time 0.048512 [TensorRT] VERBOSE: Tactic: -64 time 0.027744 [TensorRT] VERBOSE: Tactic: -128 time 0.020416 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013216 [TensorRT] VERBOSE: Tactic: 25 time 0.01376 [TensorRT] VERBOSE: Tactic: 26 time 0.014336 [TensorRT] VERBOSE: Tactic: 27 time 0.01552 [TensorRT] VERBOSE: Tactic: 31 time 0.0128 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.0128 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017248 [TensorRT] VERBOSE: Tactic: 256 time 0.016928 [TensorRT] VERBOSE: Tactic: 512 time 0.017376 [TensorRT] VERBOSE: Tactic: -32 time 0.033088 [TensorRT] VERBOSE: Tactic: -64 time 0.02352 [TensorRT] VERBOSE: Tactic: -128 time 0.023552 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.016928 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008 [TensorRT] VERBOSE: Tactic: 1 time 0.007648 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.007584 [TensorRT] VERBOSE: Tactic: 4 time 0.007392 [TensorRT] VERBOSE: Tactic: 5 time 0.007584 [TensorRT] VERBOSE: Tactic: 6 time 0.009152 [TensorRT] VERBOSE: Tactic: 7 time 0.009088 [TensorRT] VERBOSE: Tactic: 8 time 0.009184 [TensorRT] VERBOSE: Tactic: 9 time 0.009568 [TensorRT] VERBOSE: Tactic: 10 time 0.009312 [TensorRT] VERBOSE: Tactic: 11 time 0.009184 [TensorRT] VERBOSE: Tactic: 12 time 0.007904 [TensorRT] VERBOSE: Tactic: 13 time 0.00912 [TensorRT] VERBOSE: Tactic: 14 time 0.007616 [TensorRT] VERBOSE: Tactic: 15 time 0.007744 [TensorRT] VERBOSE: Tactic: 16 time 0.009152 [TensorRT] VERBOSE: Tactic: 17 time 0.008768 [TensorRT] VERBOSE: Tactic: 18 time 0.009312 [TensorRT] VERBOSE: Tactic: 19 time 0.009472 [TensorRT] VERBOSE: Tactic: 20 time 0.012384 [TensorRT] VERBOSE: Tactic: 21 time 0.010752 [TensorRT] VERBOSE: Tactic: 22 time 0.00912 [TensorRT] VERBOSE: Tactic: 23 time 0.009408 [TensorRT] VERBOSE: Tactic: 28 time 0.010784 [TensorRT] VERBOSE: Tactic: 29 time 0.009216 [TensorRT] VERBOSE: Tactic: 30 time 0.01232 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016992 [TensorRT] VERBOSE: Tactic: 256 time 0.017088 [TensorRT] VERBOSE: Tactic: 512 time 0.016928 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.016928 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_143, Add_144) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00736 [TensorRT] VERBOSE: Tactic: 11 time 0.009152 [TensorRT] VERBOSE: Tactic: 12 time 0.007936 [TensorRT] VERBOSE: Tactic: 13 time 0.012288 [TensorRT] VERBOSE: Tactic: 14 time 0.01072 [TensorRT] VERBOSE: Tactic: 15 time 0.01056 [TensorRT] VERBOSE: Tactic: 16 time 0.020448 [TensorRT] VERBOSE: Tactic: 17 time 0.015712 [TensorRT] VERBOSE: Tactic: 18 time 0.01616 [TensorRT] VERBOSE: Tactic: 19 time 0.017088 [TensorRT] VERBOSE: Tactic: 20 time 0.007808 [TensorRT] VERBOSE: Tactic: 21 time 0.007392 [TensorRT] VERBOSE: Tactic: 22 time 0.009184 [TensorRT] VERBOSE: Tactic: 23 time 0.013888 [TensorRT] VERBOSE: Tactic: 24 time 0.00768 [TensorRT] VERBOSE: Tactic: 25 time 0.007456 [TensorRT] VERBOSE: Tactic: 26 time 0.009216 [TensorRT] VERBOSE: Tactic: 27 time 0.01232 [TensorRT] VERBOSE: Tactic: 29 time 0.024928 [TensorRT] VERBOSE: Tactic: 30 time 0.014144 [TensorRT] VERBOSE: Tactic: 31 time 0.010656 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.00736 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014464 [TensorRT] VERBOSE: Tactic: 0 time 0.025344 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.014464 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016256 [TensorRT] VERBOSE: Tactic: 0 time 0.006048 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006048 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015616 [TensorRT] VERBOSE: Tactic: 0 time 0.01936 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015616 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022176 [TensorRT] VERBOSE: Tactic: 0 time 0.012 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017312 [TensorRT] VERBOSE: Tactic: 0 time 0.01232 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01232 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016128 [TensorRT] VERBOSE: Tactic: 0 time 0.022048 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016128 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017184 [TensorRT] VERBOSE: Tactic: 0 time 0.006464 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006464 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015904 [TensorRT] VERBOSE: Tactic: 0 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015904 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015904 [TensorRT] VERBOSE: Tactic: 0 time 0.005728 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005728 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015936 [TensorRT] VERBOSE: Tactic: 0 time 0.009696 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009696 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01584 [TensorRT] VERBOSE: Tactic: 0 time 0.025952 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01584 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015872 [TensorRT] VERBOSE: Tactic: 0 time 0.009184 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009184 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_145 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011136 [TensorRT] VERBOSE: Tactic: 256 time 0.011136 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.026912 [TensorRT] VERBOSE: Tactic: -64 time 0.017472 [TensorRT] VERBOSE: Tactic: -128 time 0.014368 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011136 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006208 [TensorRT] VERBOSE: Tactic: 1 time 0.006304 [TensorRT] VERBOSE: Tactic: 2 time 0.006272 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.006432 [TensorRT] VERBOSE: Tactic: 5 time 0.006176 [TensorRT] VERBOSE: Tactic: 6 time 0.0064 [TensorRT] VERBOSE: Tactic: 7 time 0.006496 [TensorRT] VERBOSE: Tactic: 8 time 0.006304 [TensorRT] VERBOSE: Tactic: 9 time 0.00768 [TensorRT] VERBOSE: Tactic: 28 time 0.006304 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 256 time 0.011168 [TensorRT] VERBOSE: Tactic: 512 time 0.011328 [TensorRT] VERBOSE: Tactic: -32 time 0.02752 [TensorRT] VERBOSE: Tactic: -64 time 0.0176 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.011168 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009152 [TensorRT] VERBOSE: Tactic: 25 time 0.008608 [TensorRT] VERBOSE: Tactic: 26 time 0.008192 [TensorRT] VERBOSE: Tactic: 27 time 0.007744 [TensorRT] VERBOSE: Tactic: 31 time 0.009184 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.007744 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014112 [TensorRT] VERBOSE: Tactic: 256 time 0.014112 [TensorRT] VERBOSE: Tactic: 512 time 0.013824 [TensorRT] VERBOSE: Tactic: -32 time 0.024128 [TensorRT] VERBOSE: Tactic: -64 time 0.0176 [TensorRT] VERBOSE: Tactic: -128 time 0.017152 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.013824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00736 [TensorRT] VERBOSE: Tactic: 1 time 0.006112 [TensorRT] VERBOSE: Tactic: 2 time 0.00592 [TensorRT] VERBOSE: Tactic: 3 time 0.005952 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.00752 [TensorRT] VERBOSE: Tactic: 7 time 0.007328 [TensorRT] VERBOSE: Tactic: 8 time 0.007552 [TensorRT] VERBOSE: Tactic: 9 time 0.007616 [TensorRT] VERBOSE: Tactic: 10 time 0.00896 [TensorRT] VERBOSE: Tactic: 11 time 0.007744 [TensorRT] VERBOSE: Tactic: 12 time 0.007552 [TensorRT] VERBOSE: Tactic: 13 time 0.007552 [TensorRT] VERBOSE: Tactic: 14 time 0.007424 [TensorRT] VERBOSE: Tactic: 15 time 0.0064 [TensorRT] VERBOSE: Tactic: 16 time 0.00672 [TensorRT] VERBOSE: Tactic: 17 time 0.007392 [TensorRT] VERBOSE: Tactic: 18 time 0.007584 [TensorRT] VERBOSE: Tactic: 19 time 0.007808 [TensorRT] VERBOSE: Tactic: 20 time 0.012288 [TensorRT] VERBOSE: Tactic: 21 time 0.009248 [TensorRT] VERBOSE: Tactic: 22 time 0.007648 [TensorRT] VERBOSE: Tactic: 23 time 0.007552 [TensorRT] VERBOSE: Tactic: 28 time 0.007808 [TensorRT] VERBOSE: Tactic: 29 time 0.009216 [TensorRT] VERBOSE: Tactic: 30 time 0.011136 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.00592 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013888 [TensorRT] VERBOSE: Tactic: 256 time 0.013696 [TensorRT] VERBOSE: Tactic: 512 time 0.014208 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013696 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_146 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.005984 [TensorRT] VERBOSE: Tactic: 11 time 0.007584 [TensorRT] VERBOSE: Tactic: 12 time 0.00752 [TensorRT] VERBOSE: Tactic: 13 time 0.009024 [TensorRT] VERBOSE: Tactic: 14 time 0.00912 [TensorRT] VERBOSE: Tactic: 15 time 0.00944 [TensorRT] VERBOSE: Tactic: 16 time 0.013824 [TensorRT] VERBOSE: Tactic: 17 time 0.013664 [TensorRT] VERBOSE: Tactic: 18 time 0.013632 [TensorRT] VERBOSE: Tactic: 19 time 0.015296 [TensorRT] VERBOSE: Tactic: 20 time 0.00608 [TensorRT] VERBOSE: Tactic: 21 time 0.006048 [TensorRT] VERBOSE: Tactic: 22 time 0.007072 [TensorRT] VERBOSE: Tactic: 23 time 0.00912 [TensorRT] VERBOSE: Tactic: 24 time 0.006048 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.006016 [TensorRT] VERBOSE: Tactic: 27 time 0.007456 [TensorRT] VERBOSE: Tactic: 29 time 0.015392 [TensorRT] VERBOSE: Tactic: 30 time 0.010752 [TensorRT] VERBOSE: Tactic: 31 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_147 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_147 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_147 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_147 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_147 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014304 [TensorRT] VERBOSE: Tactic: 256 time 0.014784 [TensorRT] VERBOSE: Tactic: 512 time 0.016096 [TensorRT] VERBOSE: Tactic: -32 time 0.048736 [TensorRT] VERBOSE: Tactic: -64 time 0.028864 [TensorRT] VERBOSE: Tactic: -128 time 0.01984 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014304 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01008 [TensorRT] VERBOSE: Tactic: 1 time 0.009952 [TensorRT] VERBOSE: Tactic: 2 time 0.010144 [TensorRT] VERBOSE: Tactic: 3 time 0.009632 [TensorRT] VERBOSE: Tactic: 4 time 0.008864 [TensorRT] VERBOSE: Tactic: 5 time 0.01024 [TensorRT] VERBOSE: Tactic: 6 time 0.011808 [TensorRT] VERBOSE: Tactic: 7 time 0.009248 [TensorRT] VERBOSE: Tactic: 8 time 0.01024 [TensorRT] VERBOSE: Tactic: 9 time 0.01024 [TensorRT] VERBOSE: Tactic: 28 time 0.010112 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.008864 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014912 [TensorRT] VERBOSE: Tactic: 256 time 0.015008 [TensorRT] VERBOSE: Tactic: 512 time 0.014592 [TensorRT] VERBOSE: Tactic: -32 time 0.048416 [TensorRT] VERBOSE: Tactic: -64 time 0.027488 [TensorRT] VERBOSE: Tactic: -128 time 0.01984 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.014592 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013344 [TensorRT] VERBOSE: Tactic: 25 time 0.013472 [TensorRT] VERBOSE: Tactic: 26 time 0.014112 [TensorRT] VERBOSE: Tactic: 27 time 0.01552 [TensorRT] VERBOSE: Tactic: 31 time 0.01312 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.01312 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016032 [TensorRT] VERBOSE: Tactic: 256 time 0.01696 [TensorRT] VERBOSE: Tactic: 512 time 0.017216 [TensorRT] VERBOSE: Tactic: -32 time 0.032672 [TensorRT] VERBOSE: Tactic: -64 time 0.023552 [TensorRT] VERBOSE: Tactic: -128 time 0.023232 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.016032 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007904 [TensorRT] VERBOSE: Tactic: 1 time 0.007648 [TensorRT] VERBOSE: Tactic: 2 time 0.006272 [TensorRT] VERBOSE: Tactic: 3 time 0.007488 [TensorRT] VERBOSE: Tactic: 4 time 0.007872 [TensorRT] VERBOSE: Tactic: 5 time 0.008 [TensorRT] VERBOSE: Tactic: 6 time 0.009184 [TensorRT] VERBOSE: Tactic: 7 time 0.00784 [TensorRT] VERBOSE: Tactic: 8 time 0.009152 [TensorRT] VERBOSE: Tactic: 9 time 0.009568 [TensorRT] VERBOSE: Tactic: 10 time 0.009376 [TensorRT] VERBOSE: Tactic: 11 time 0.009248 [TensorRT] VERBOSE: Tactic: 12 time 0.007808 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.007712 [TensorRT] VERBOSE: Tactic: 15 time 0.007872 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.00832 [TensorRT] VERBOSE: Tactic: 18 time 0.00784 [TensorRT] VERBOSE: Tactic: 19 time 0.009312 [TensorRT] VERBOSE: Tactic: 20 time 0.012288 [TensorRT] VERBOSE: Tactic: 21 time 0.010912 [TensorRT] VERBOSE: Tactic: 22 time 0.00912 [TensorRT] VERBOSE: Tactic: 23 time 0.009248 [TensorRT] VERBOSE: Tactic: 28 time 0.009728 [TensorRT] VERBOSE: Tactic: 29 time 0.009696 [TensorRT] VERBOSE: Tactic: 30 time 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006272 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016416 [TensorRT] VERBOSE: Tactic: 256 time 0.016832 [TensorRT] VERBOSE: Tactic: 512 time 0.016768 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.016416 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_148, Add_149) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00784 [TensorRT] VERBOSE: Tactic: 11 time 0.009568 [TensorRT] VERBOSE: Tactic: 12 time 0.007872 [TensorRT] VERBOSE: Tactic: 13 time 0.012448 [TensorRT] VERBOSE: Tactic: 14 time 0.010752 [TensorRT] VERBOSE: Tactic: 15 time 0.011232 [TensorRT] VERBOSE: Tactic: 16 time 0.02144 [TensorRT] VERBOSE: Tactic: 17 time 0.015776 [TensorRT] VERBOSE: Tactic: 18 time 0.015488 [TensorRT] VERBOSE: Tactic: 19 time 0.017664 [TensorRT] VERBOSE: Tactic: 20 time 0.00784 [TensorRT] VERBOSE: Tactic: 21 time 0.007296 [TensorRT] VERBOSE: Tactic: 22 time 0.009152 [TensorRT] VERBOSE: Tactic: 23 time 0.013888 [TensorRT] VERBOSE: Tactic: 24 time 0.00752 [TensorRT] VERBOSE: Tactic: 25 time 0.007168 [TensorRT] VERBOSE: Tactic: 26 time 0.009152 [TensorRT] VERBOSE: Tactic: 27 time 0.011264 [TensorRT] VERBOSE: Tactic: 29 time 0.024832 [TensorRT] VERBOSE: Tactic: 30 time 0.01408 [TensorRT] VERBOSE: Tactic: 31 time 0.010304 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.007168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_150 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011488 [TensorRT] VERBOSE: Tactic: 256 time 0.01184 [TensorRT] VERBOSE: Tactic: 512 time 0.010848 [TensorRT] VERBOSE: Tactic: -32 time 0.028128 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.010848 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.006432 [TensorRT] VERBOSE: Tactic: 6 time 0.006496 [TensorRT] VERBOSE: Tactic: 7 time 0.006624 [TensorRT] VERBOSE: Tactic: 8 time 0.006528 [TensorRT] VERBOSE: Tactic: 9 time 0.006432 [TensorRT] VERBOSE: Tactic: 28 time 0.006592 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011392 [TensorRT] VERBOSE: Tactic: 256 time 0.01072 [TensorRT] VERBOSE: Tactic: 512 time 0.011168 [TensorRT] VERBOSE: Tactic: -32 time 0.02832 [TensorRT] VERBOSE: Tactic: -64 time 0.017856 [TensorRT] VERBOSE: Tactic: -128 time 0.014624 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.01072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.008672 [TensorRT] VERBOSE: Tactic: 25 time 0.009088 [TensorRT] VERBOSE: Tactic: 26 time 0.008128 [TensorRT] VERBOSE: Tactic: 27 time 0.00832 [TensorRT] VERBOSE: Tactic: 31 time 0.009504 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.008128 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014176 [TensorRT] VERBOSE: Tactic: 256 time 0.01408 [TensorRT] VERBOSE: Tactic: 512 time 0.013856 [TensorRT] VERBOSE: Tactic: -32 time 0.02448 [TensorRT] VERBOSE: Tactic: -64 time 0.018624 [TensorRT] VERBOSE: Tactic: -128 time 0.017216 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.013856 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Tactic: 1 time 0.00608 [TensorRT] VERBOSE: Tactic: 2 time 0.006048 [TensorRT] VERBOSE: Tactic: 3 time 0.00608 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.006048 [TensorRT] VERBOSE: Tactic: 6 time 0.007648 [TensorRT] VERBOSE: Tactic: 7 time 0.007168 [TensorRT] VERBOSE: Tactic: 8 time 0.007584 [TensorRT] VERBOSE: Tactic: 9 time 0.007456 [TensorRT] VERBOSE: Tactic: 10 time 0.008192 [TensorRT] VERBOSE: Tactic: 11 time 0.007584 [TensorRT] VERBOSE: Tactic: 12 time 0.007648 [TensorRT] VERBOSE: Tactic: 13 time 0.007648 [TensorRT] VERBOSE: Tactic: 14 time 0.00752 [TensorRT] VERBOSE: Tactic: 15 time 0.007552 [TensorRT] VERBOSE: Tactic: 16 time 0.007424 [TensorRT] VERBOSE: Tactic: 17 time 0.007584 [TensorRT] VERBOSE: Tactic: 18 time 0.007584 [TensorRT] VERBOSE: Tactic: 19 time 0.007072 [TensorRT] VERBOSE: Tactic: 20 time 0.012288 [TensorRT] VERBOSE: Tactic: 21 time 0.009312 [TensorRT] VERBOSE: Tactic: 22 time 0.007456 [TensorRT] VERBOSE: Tactic: 23 time 0.007712 [TensorRT] VERBOSE: Tactic: 28 time 0.007776 [TensorRT] VERBOSE: Tactic: 29 time 0.009216 [TensorRT] VERBOSE: Tactic: 30 time 0.010592 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013184 [TensorRT] VERBOSE: Tactic: 256 time 0.013856 [TensorRT] VERBOSE: Tactic: 512 time 0.013824 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013184 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_151 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006208 [TensorRT] VERBOSE: Tactic: 11 time 0.00736 [TensorRT] VERBOSE: Tactic: 12 time 0.007584 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009088 [TensorRT] VERBOSE: Tactic: 15 time 0.01072 [TensorRT] VERBOSE: Tactic: 16 time 0.013792 [TensorRT] VERBOSE: Tactic: 17 time 0.013952 [TensorRT] VERBOSE: Tactic: 18 time 0.014016 [TensorRT] VERBOSE: Tactic: 19 time 0.015648 [TensorRT] VERBOSE: Tactic: 20 time 0.006144 [TensorRT] VERBOSE: Tactic: 21 time 0.006048 [TensorRT] VERBOSE: Tactic: 22 time 0.00704 [TensorRT] VERBOSE: Tactic: 23 time 0.009152 [TensorRT] VERBOSE: Tactic: 24 time 0.006016 [TensorRT] VERBOSE: Tactic: 25 time 0.006048 [TensorRT] VERBOSE: Tactic: 26 time 0.006144 [TensorRT] VERBOSE: Tactic: 27 time 0.007392 [TensorRT] VERBOSE: Tactic: 29 time 0.01584 [TensorRT] VERBOSE: Tactic: 30 time 0.010592 [TensorRT] VERBOSE: Tactic: 31 time 0.007776 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_152 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_152 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_152 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_152 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_152 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014816 [TensorRT] VERBOSE: Tactic: 256 time 0.014336 [TensorRT] VERBOSE: Tactic: 512 time 0.015008 [TensorRT] VERBOSE: Tactic: -32 time 0.047488 [TensorRT] VERBOSE: Tactic: -64 time 0.027744 [TensorRT] VERBOSE: Tactic: -128 time 0.019456 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.010624 [TensorRT] VERBOSE: Tactic: 1 time 0.00976 [TensorRT] VERBOSE: Tactic: 2 time 0.009216 [TensorRT] VERBOSE: Tactic: 3 time 0.010688 [TensorRT] VERBOSE: Tactic: 4 time 0.01024 [TensorRT] VERBOSE: Tactic: 5 time 0.009312 [TensorRT] VERBOSE: Tactic: 6 time 0.011168 [TensorRT] VERBOSE: Tactic: 7 time 0.009216 [TensorRT] VERBOSE: Tactic: 8 time 0.010176 [TensorRT] VERBOSE: Tactic: 9 time 0.009248 [TensorRT] VERBOSE: Tactic: 28 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01472 [TensorRT] VERBOSE: Tactic: 256 time 0.014464 [TensorRT] VERBOSE: Tactic: 512 time 0.01488 [TensorRT] VERBOSE: Tactic: -32 time 0.048544 [TensorRT] VERBOSE: Tactic: -64 time 0.027648 [TensorRT] VERBOSE: Tactic: -128 time 0.019872 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014464 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013248 [TensorRT] VERBOSE: Tactic: 25 time 0.014048 [TensorRT] VERBOSE: Tactic: 26 time 0.01408 [TensorRT] VERBOSE: Tactic: 27 time 0.016256 [TensorRT] VERBOSE: Tactic: 31 time 0.01312 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.01312 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016992 [TensorRT] VERBOSE: Tactic: 256 time 0.017056 [TensorRT] VERBOSE: Tactic: 512 time 0.016896 [TensorRT] VERBOSE: Tactic: -32 time 0.032832 [TensorRT] VERBOSE: Tactic: -64 time 0.023552 [TensorRT] VERBOSE: Tactic: -128 time 0.022432 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.016896 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00768 [TensorRT] VERBOSE: Tactic: 1 time 0.007776 [TensorRT] VERBOSE: Tactic: 2 time 0.006752 [TensorRT] VERBOSE: Tactic: 3 time 0.007744 [TensorRT] VERBOSE: Tactic: 4 time 0.007552 [TensorRT] VERBOSE: Tactic: 5 time 0.00784 [TensorRT] VERBOSE: Tactic: 6 time 0.009088 [TensorRT] VERBOSE: Tactic: 7 time 0.007616 [TensorRT] VERBOSE: Tactic: 8 time 0.00912 [TensorRT] VERBOSE: Tactic: 9 time 0.009696 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.00912 [TensorRT] VERBOSE: Tactic: 12 time 0.007936 [TensorRT] VERBOSE: Tactic: 13 time 0.008192 [TensorRT] VERBOSE: Tactic: 14 time 0.00768 [TensorRT] VERBOSE: Tactic: 15 time 0.007392 [TensorRT] VERBOSE: Tactic: 16 time 0.009152 [TensorRT] VERBOSE: Tactic: 17 time 0.009056 [TensorRT] VERBOSE: Tactic: 18 time 0.009216 [TensorRT] VERBOSE: Tactic: 19 time 0.009664 [TensorRT] VERBOSE: Tactic: 20 time 0.01264 [TensorRT] VERBOSE: Tactic: 21 time 0.010752 [TensorRT] VERBOSE: Tactic: 22 time 0.009536 [TensorRT] VERBOSE: Tactic: 23 time 0.009184 [TensorRT] VERBOSE: Tactic: 28 time 0.010784 [TensorRT] VERBOSE: Tactic: 29 time 0.009216 [TensorRT] VERBOSE: Tactic: 30 time 0.012224 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006752 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016992 [TensorRT] VERBOSE: Tactic: 256 time 0.017056 [TensorRT] VERBOSE: Tactic: 512 time 0.017152 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.016992 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_153, Add_154) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007552 [TensorRT] VERBOSE: Tactic: 11 time 0.009088 [TensorRT] VERBOSE: Tactic: 12 time 0.007904 [TensorRT] VERBOSE: Tactic: 13 time 0.012288 [TensorRT] VERBOSE: Tactic: 14 time 0.010816 [TensorRT] VERBOSE: Tactic: 15 time 0.01088 [TensorRT] VERBOSE: Tactic: 16 time 0.021472 [TensorRT] VERBOSE: Tactic: 17 time 0.01536 [TensorRT] VERBOSE: Tactic: 18 time 0.017248 [TensorRT] VERBOSE: Tactic: 19 time 0.017216 [TensorRT] VERBOSE: Tactic: 20 time 0.00768 [TensorRT] VERBOSE: Tactic: 21 time 0.007552 [TensorRT] VERBOSE: Tactic: 22 time 0.009216 [TensorRT] VERBOSE: Tactic: 23 time 0.01376 [TensorRT] VERBOSE: Tactic: 24 time 0.007712 [TensorRT] VERBOSE: Tactic: 25 time 0.007712 [TensorRT] VERBOSE: Tactic: 26 time 0.009248 [TensorRT] VERBOSE: Tactic: 27 time 0.011136 [TensorRT] VERBOSE: Tactic: 29 time 0.024928 [TensorRT] VERBOSE: Tactic: 30 time 0.014112 [TensorRT] VERBOSE: Tactic: 31 time 0.01072 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.007552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_155 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011328 [TensorRT] VERBOSE: Tactic: 256 time 0.011264 [TensorRT] VERBOSE: Tactic: 512 time 0.011584 [TensorRT] VERBOSE: Tactic: -32 time 0.02768 [TensorRT] VERBOSE: Tactic: -64 time 0.017664 [TensorRT] VERBOSE: Tactic: -128 time 0.014496 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006464 [TensorRT] VERBOSE: Tactic: 1 time 0.0064 [TensorRT] VERBOSE: Tactic: 2 time 0.006208 [TensorRT] VERBOSE: Tactic: 3 time 0.006368 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.00624 [TensorRT] VERBOSE: Tactic: 6 time 0.006432 [TensorRT] VERBOSE: Tactic: 7 time 0.006048 [TensorRT] VERBOSE: Tactic: 8 time 0.006496 [TensorRT] VERBOSE: Tactic: 9 time 0.006688 [TensorRT] VERBOSE: Tactic: 28 time 0.006464 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.006048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 256 time 0.011232 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.028224 [TensorRT] VERBOSE: Tactic: -64 time 0.01776 [TensorRT] VERBOSE: Tactic: -128 time 0.014368 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.011232 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009728 [TensorRT] VERBOSE: Tactic: 25 time 0.009856 [TensorRT] VERBOSE: Tactic: 26 time 0.008256 [TensorRT] VERBOSE: Tactic: 27 time 0.00784 [TensorRT] VERBOSE: Tactic: 31 time 0.009472 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.00784 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01392 [TensorRT] VERBOSE: Tactic: 256 time 0.013824 [TensorRT] VERBOSE: Tactic: 512 time 0.014208 [TensorRT] VERBOSE: Tactic: -32 time 0.024704 [TensorRT] VERBOSE: Tactic: -64 time 0.017984 [TensorRT] VERBOSE: Tactic: -128 time 0.016928 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007552 [TensorRT] VERBOSE: Tactic: 1 time 0.006112 [TensorRT] VERBOSE: Tactic: 2 time 0.006112 [TensorRT] VERBOSE: Tactic: 3 time 0.00608 [TensorRT] VERBOSE: Tactic: 4 time 0.00608 [TensorRT] VERBOSE: Tactic: 5 time 0.006048 [TensorRT] VERBOSE: Tactic: 6 time 0.006368 [TensorRT] VERBOSE: Tactic: 7 time 0.007744 [TensorRT] VERBOSE: Tactic: 8 time 0.007648 [TensorRT] VERBOSE: Tactic: 9 time 0.007488 [TensorRT] VERBOSE: Tactic: 10 time 0.007712 [TensorRT] VERBOSE: Tactic: 11 time 0.007872 [TensorRT] VERBOSE: Tactic: 12 time 0.007552 [TensorRT] VERBOSE: Tactic: 13 time 0.007424 [TensorRT] VERBOSE: Tactic: 14 time 0.007424 [TensorRT] VERBOSE: Tactic: 15 time 0.00752 [TensorRT] VERBOSE: Tactic: 16 time 0.007552 [TensorRT] VERBOSE: Tactic: 17 time 0.007648 [TensorRT] VERBOSE: Tactic: 18 time 0.00736 [TensorRT] VERBOSE: Tactic: 19 time 0.007136 [TensorRT] VERBOSE: Tactic: 20 time 0.012512 [TensorRT] VERBOSE: Tactic: 21 time 0.009312 [TensorRT] VERBOSE: Tactic: 22 time 0.007648 [TensorRT] VERBOSE: Tactic: 23 time 0.00784 [TensorRT] VERBOSE: Tactic: 28 time 0.007328 [TensorRT] VERBOSE: Tactic: 29 time 0.00896 [TensorRT] VERBOSE: Tactic: 30 time 0.010752 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.006048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013952 [TensorRT] VERBOSE: Tactic: 256 time 0.013664 [TensorRT] VERBOSE: Tactic: 512 time 0.01408 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013664 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_156 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006016 [TensorRT] VERBOSE: Tactic: 11 time 0.007712 [TensorRT] VERBOSE: Tactic: 12 time 0.00768 [TensorRT] VERBOSE: Tactic: 13 time 0.009088 [TensorRT] VERBOSE: Tactic: 14 time 0.009088 [TensorRT] VERBOSE: Tactic: 15 time 0.010656 [TensorRT] VERBOSE: Tactic: 16 time 0.013856 [TensorRT] VERBOSE: Tactic: 17 time 0.012768 [TensorRT] VERBOSE: Tactic: 18 time 0.013856 [TensorRT] VERBOSE: Tactic: 19 time 0.01536 [TensorRT] VERBOSE: Tactic: 20 time 0.00608 [TensorRT] VERBOSE: Tactic: 21 time 0.006016 [TensorRT] VERBOSE: Tactic: 22 time 0.00768 [TensorRT] VERBOSE: Tactic: 23 time 0.009184 [TensorRT] VERBOSE: Tactic: 24 time 0.006112 [TensorRT] VERBOSE: Tactic: 25 time 0.005952 [TensorRT] VERBOSE: Tactic: 26 time 0.005984 [TensorRT] VERBOSE: Tactic: 27 time 0.00752 [TensorRT] VERBOSE: Tactic: 29 time 0.01536 [TensorRT] VERBOSE: Tactic: 30 time 0.010752 [TensorRT] VERBOSE: Tactic: 31 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_157 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_157 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_157 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_157 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_157 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014528 [TensorRT] VERBOSE: Tactic: 256 time 0.014752 [TensorRT] VERBOSE: Tactic: 512 time 0.015904 [TensorRT] VERBOSE: Tactic: -32 time 0.048128 [TensorRT] VERBOSE: Tactic: -64 time 0.02784 [TensorRT] VERBOSE: Tactic: -128 time 0.019744 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014528 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.010176 [TensorRT] VERBOSE: Tactic: 1 time 0.009856 [TensorRT] VERBOSE: Tactic: 2 time 0.009728 [TensorRT] VERBOSE: Tactic: 3 time 0.009216 [TensorRT] VERBOSE: Tactic: 4 time 0.009952 [TensorRT] VERBOSE: Tactic: 5 time 0.009696 [TensorRT] VERBOSE: Tactic: 6 time 0.011104 [TensorRT] VERBOSE: Tactic: 7 time 0.009984 [TensorRT] VERBOSE: Tactic: 8 time 0.010208 [TensorRT] VERBOSE: Tactic: 9 time 0.009376 [TensorRT] VERBOSE: Tactic: 28 time 0.009632 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014336 [TensorRT] VERBOSE: Tactic: 256 time 0.015872 [TensorRT] VERBOSE: Tactic: 512 time 0.014848 [TensorRT] VERBOSE: Tactic: -32 time 0.047552 [TensorRT] VERBOSE: Tactic: -64 time 0.028672 [TensorRT] VERBOSE: Tactic: -128 time 0.019904 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013312 [TensorRT] VERBOSE: Tactic: 25 time 0.01392 [TensorRT] VERBOSE: Tactic: 26 time 0.014336 [TensorRT] VERBOSE: Tactic: 27 time 0.016224 [TensorRT] VERBOSE: Tactic: 31 time 0.013728 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.013312 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016384 [TensorRT] VERBOSE: Tactic: 256 time 0.017312 [TensorRT] VERBOSE: Tactic: 512 time 0.017248 [TensorRT] VERBOSE: Tactic: -32 time 0.033408 [TensorRT] VERBOSE: Tactic: -64 time 0.02336 [TensorRT] VERBOSE: Tactic: -128 time 0.023552 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.016384 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007904 [TensorRT] VERBOSE: Tactic: 1 time 0.00768 [TensorRT] VERBOSE: Tactic: 2 time 0.006208 [TensorRT] VERBOSE: Tactic: 3 time 0.007776 [TensorRT] VERBOSE: Tactic: 4 time 0.007584 [TensorRT] VERBOSE: Tactic: 5 time 0.007808 [TensorRT] VERBOSE: Tactic: 6 time 0.009216 [TensorRT] VERBOSE: Tactic: 7 time 0.009216 [TensorRT] VERBOSE: Tactic: 8 time 0.009248 [TensorRT] VERBOSE: Tactic: 9 time 0.009472 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.009248 [TensorRT] VERBOSE: Tactic: 12 time 0.007936 [TensorRT] VERBOSE: Tactic: 13 time 0.00784 [TensorRT] VERBOSE: Tactic: 14 time 0.007488 [TensorRT] VERBOSE: Tactic: 15 time 0.007936 [TensorRT] VERBOSE: Tactic: 16 time 0.009248 [TensorRT] VERBOSE: Tactic: 17 time 0.00752 [TensorRT] VERBOSE: Tactic: 18 time 0.009216 [TensorRT] VERBOSE: Tactic: 19 time 0.009216 [TensorRT] VERBOSE: Tactic: 20 time 0.01232 [TensorRT] VERBOSE: Tactic: 21 time 0.010368 [TensorRT] VERBOSE: Tactic: 22 time 0.009184 [TensorRT] VERBOSE: Tactic: 23 time 0.009184 [TensorRT] VERBOSE: Tactic: 28 time 0.010688 [TensorRT] VERBOSE: Tactic: 29 time 0.009504 [TensorRT] VERBOSE: Tactic: 30 time 0.012352 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006208 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017152 [TensorRT] VERBOSE: Tactic: 256 time 0.017088 [TensorRT] VERBOSE: Tactic: 512 time 0.017536 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.017088 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_158, Add_159) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007776 [TensorRT] VERBOSE: Tactic: 11 time 0.009376 [TensorRT] VERBOSE: Tactic: 12 time 0.007712 [TensorRT] VERBOSE: Tactic: 13 time 0.012704 [TensorRT] VERBOSE: Tactic: 14 time 0.010336 [TensorRT] VERBOSE: Tactic: 15 time 0.010976 [TensorRT] VERBOSE: Tactic: 16 time 0.02048 [TensorRT] VERBOSE: Tactic: 17 time 0.01536 [TensorRT] VERBOSE: Tactic: 18 time 0.017376 [TensorRT] VERBOSE: Tactic: 19 time 0.016896 [TensorRT] VERBOSE: Tactic: 20 time 0.007744 [TensorRT] VERBOSE: Tactic: 21 time 0.00752 [TensorRT] VERBOSE: Tactic: 22 time 0.009216 [TensorRT] VERBOSE: Tactic: 23 time 0.013664 [TensorRT] VERBOSE: Tactic: 24 time 0.007776 [TensorRT] VERBOSE: Tactic: 25 time 0.007328 [TensorRT] VERBOSE: Tactic: 26 time 0.009216 [TensorRT] VERBOSE: Tactic: 27 time 0.012256 [TensorRT] VERBOSE: Tactic: 29 time 0.024576 [TensorRT] VERBOSE: Tactic: 30 time 0.013984 [TensorRT] VERBOSE: Tactic: 31 time 0.009664 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.007328 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_160 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 256 time 0.011072 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.027552 [TensorRT] VERBOSE: Tactic: -64 time 0.01776 [TensorRT] VERBOSE: Tactic: -128 time 0.014112 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.011072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00672 [TensorRT] VERBOSE: Tactic: 1 time 0.006272 [TensorRT] VERBOSE: Tactic: 2 time 0.00656 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.006272 [TensorRT] VERBOSE: Tactic: 5 time 0.006784 [TensorRT] VERBOSE: Tactic: 6 time 0.006496 [TensorRT] VERBOSE: Tactic: 7 time 0.006144 [TensorRT] VERBOSE: Tactic: 8 time 0.0064 [TensorRT] VERBOSE: Tactic: 9 time 0.00672 [TensorRT] VERBOSE: Tactic: 28 time 0.006496 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 256 time 0.011168 [TensorRT] VERBOSE: Tactic: 512 time 0.011136 [TensorRT] VERBOSE: Tactic: -32 time 0.028352 [TensorRT] VERBOSE: Tactic: -64 time 0.017856 [TensorRT] VERBOSE: Tactic: -128 time 0.014272 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.011136 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009536 [TensorRT] VERBOSE: Tactic: 25 time 0.008128 [TensorRT] VERBOSE: Tactic: 26 time 0.008192 [TensorRT] VERBOSE: Tactic: 27 time 0.008416 [TensorRT] VERBOSE: Tactic: 31 time 0.009632 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.008128 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013888 [TensorRT] VERBOSE: Tactic: 256 time 0.013824 [TensorRT] VERBOSE: Tactic: 512 time 0.014336 [TensorRT] VERBOSE: Tactic: -32 time 0.024896 [TensorRT] VERBOSE: Tactic: -64 time 0.018752 [TensorRT] VERBOSE: Tactic: -128 time 0.01728 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006816 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.006016 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.006112 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.007616 [TensorRT] VERBOSE: Tactic: 7 time 0.007328 [TensorRT] VERBOSE: Tactic: 8 time 0.00768 [TensorRT] VERBOSE: Tactic: 9 time 0.007936 [TensorRT] VERBOSE: Tactic: 10 time 0.009152 [TensorRT] VERBOSE: Tactic: 11 time 0.007648 [TensorRT] VERBOSE: Tactic: 12 time 0.007616 [TensorRT] VERBOSE: Tactic: 13 time 0.007584 [TensorRT] VERBOSE: Tactic: 14 time 0.007872 [TensorRT] VERBOSE: Tactic: 15 time 0.006144 [TensorRT] VERBOSE: Tactic: 16 time 0.007648 [TensorRT] VERBOSE: Tactic: 17 time 0.007456 [TensorRT] VERBOSE: Tactic: 18 time 0.007616 [TensorRT] VERBOSE: Tactic: 19 time 0.007648 [TensorRT] VERBOSE: Tactic: 20 time 0.011488 [TensorRT] VERBOSE: Tactic: 21 time 0.009344 [TensorRT] VERBOSE: Tactic: 22 time 0.007808 [TensorRT] VERBOSE: Tactic: 23 time 0.007488 [TensorRT] VERBOSE: Tactic: 28 time 0.00752 [TensorRT] VERBOSE: Tactic: 29 time 0.008608 [TensorRT] VERBOSE: Tactic: 30 time 0.01072 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013696 [TensorRT] VERBOSE: Tactic: 256 time 0.013856 [TensorRT] VERBOSE: Tactic: 512 time 0.014016 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013696 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_161 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.005984 [TensorRT] VERBOSE: Tactic: 11 time 0.007584 [TensorRT] VERBOSE: Tactic: 12 time 0.007424 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.01008 [TensorRT] VERBOSE: Tactic: 16 time 0.013568 [TensorRT] VERBOSE: Tactic: 17 time 0.01392 [TensorRT] VERBOSE: Tactic: 18 time 0.013824 [TensorRT] VERBOSE: Tactic: 19 time 0.01536 [TensorRT] VERBOSE: Tactic: 20 time 0.006048 [TensorRT] VERBOSE: Tactic: 21 time 0.006016 [TensorRT] VERBOSE: Tactic: 22 time 0.007552 [TensorRT] VERBOSE: Tactic: 23 time 0.009152 [TensorRT] VERBOSE: Tactic: 24 time 0.006048 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.006112 [TensorRT] VERBOSE: Tactic: 27 time 0.00752 [TensorRT] VERBOSE: Tactic: 29 time 0.015648 [TensorRT] VERBOSE: Tactic: 30 time 0.010912 [TensorRT] VERBOSE: Tactic: 31 time 0.007584 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_162 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_162 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_162 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_162 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_162 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014752 [TensorRT] VERBOSE: Tactic: 256 time 0.0144 [TensorRT] VERBOSE: Tactic: 512 time 0.015168 [TensorRT] VERBOSE: Tactic: -32 time 0.048128 [TensorRT] VERBOSE: Tactic: -64 time 0.027744 [TensorRT] VERBOSE: Tactic: -128 time 0.018784 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.0144 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.010144 [TensorRT] VERBOSE: Tactic: 1 time 0.01008 [TensorRT] VERBOSE: Tactic: 2 time 0.010208 [TensorRT] VERBOSE: Tactic: 3 time 0.0096 [TensorRT] VERBOSE: Tactic: 4 time 0.0096 [TensorRT] VERBOSE: Tactic: 5 time 0.009312 [TensorRT] VERBOSE: Tactic: 6 time 0.011232 [TensorRT] VERBOSE: Tactic: 7 time 0.00944 [TensorRT] VERBOSE: Tactic: 8 time 0.00992 [TensorRT] VERBOSE: Tactic: 9 time 0.009568 [TensorRT] VERBOSE: Tactic: 28 time 0.009856 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.009312 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014336 [TensorRT] VERBOSE: Tactic: 256 time 0.015072 [TensorRT] VERBOSE: Tactic: 512 time 0.015008 [TensorRT] VERBOSE: Tactic: -32 time 0.04784 [TensorRT] VERBOSE: Tactic: -64 time 0.027584 [TensorRT] VERBOSE: Tactic: -128 time 0.019904 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013344 [TensorRT] VERBOSE: Tactic: 25 time 0.014336 [TensorRT] VERBOSE: Tactic: 26 time 0.014336 [TensorRT] VERBOSE: Tactic: 27 time 0.016448 [TensorRT] VERBOSE: Tactic: 31 time 0.013184 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.013184 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017088 [TensorRT] VERBOSE: Tactic: 256 time 0.017152 [TensorRT] VERBOSE: Tactic: 512 time 0.017216 [TensorRT] VERBOSE: Tactic: -32 time 0.032448 [TensorRT] VERBOSE: Tactic: -64 time 0.023552 [TensorRT] VERBOSE: Tactic: -128 time 0.02336 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.017088 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007872 [TensorRT] VERBOSE: Tactic: 1 time 0.007584 [TensorRT] VERBOSE: Tactic: 2 time 0.006496 [TensorRT] VERBOSE: Tactic: 3 time 0.00752 [TensorRT] VERBOSE: Tactic: 4 time 0.007552 [TensorRT] VERBOSE: Tactic: 5 time 0.007776 [TensorRT] VERBOSE: Tactic: 6 time 0.00912 [TensorRT] VERBOSE: Tactic: 7 time 0.00768 [TensorRT] VERBOSE: Tactic: 8 time 0.009152 [TensorRT] VERBOSE: Tactic: 9 time 0.00944 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.009216 [TensorRT] VERBOSE: Tactic: 12 time 0.007872 [TensorRT] VERBOSE: Tactic: 13 time 0.009088 [TensorRT] VERBOSE: Tactic: 14 time 0.00736 [TensorRT] VERBOSE: Tactic: 15 time 0.007872 [TensorRT] VERBOSE: Tactic: 16 time 0.009152 [TensorRT] VERBOSE: Tactic: 17 time 0.00816 [TensorRT] VERBOSE: Tactic: 18 time 0.009088 [TensorRT] VERBOSE: Tactic: 19 time 0.009216 [TensorRT] VERBOSE: Tactic: 20 time 0.012768 [TensorRT] VERBOSE: Tactic: 21 time 0.011008 [TensorRT] VERBOSE: Tactic: 22 time 0.009152 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 28 time 0.009216 [TensorRT] VERBOSE: Tactic: 29 time 0.009472 [TensorRT] VERBOSE: Tactic: 30 time 0.01264 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006496 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017024 [TensorRT] VERBOSE: Tactic: 256 time 0.016896 [TensorRT] VERBOSE: Tactic: 512 time 0.017184 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.016896 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_163, Add_164) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00768 [TensorRT] VERBOSE: Tactic: 11 time 0.009184 [TensorRT] VERBOSE: Tactic: 12 time 0.007712 [TensorRT] VERBOSE: Tactic: 13 time 0.012192 [TensorRT] VERBOSE: Tactic: 14 time 0.010848 [TensorRT] VERBOSE: Tactic: 15 time 0.01104 [TensorRT] VERBOSE: Tactic: 16 time 0.020256 [TensorRT] VERBOSE: Tactic: 17 time 0.015424 [TensorRT] VERBOSE: Tactic: 18 time 0.016896 [TensorRT] VERBOSE: Tactic: 19 time 0.01728 [TensorRT] VERBOSE: Tactic: 20 time 0.007808 [TensorRT] VERBOSE: Tactic: 21 time 0.007456 [TensorRT] VERBOSE: Tactic: 22 time 0.009152 [TensorRT] VERBOSE: Tactic: 23 time 0.013888 [TensorRT] VERBOSE: Tactic: 24 time 0.007712 [TensorRT] VERBOSE: Tactic: 25 time 0.007552 [TensorRT] VERBOSE: Tactic: 26 time 0.00912 [TensorRT] VERBOSE: Tactic: 27 time 0.012288 [TensorRT] VERBOSE: Tactic: 29 time 0.0248 [TensorRT] VERBOSE: Tactic: 30 time 0.01408 [TensorRT] VERBOSE: Tactic: 31 time 0.010912 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.007456 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_165 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011232 [TensorRT] VERBOSE: Tactic: 256 time 0.0112 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.02832 [TensorRT] VERBOSE: Tactic: -64 time 0.017344 [TensorRT] VERBOSE: Tactic: -128 time 0.014592 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.0112 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.0064 [TensorRT] VERBOSE: Tactic: 1 time 0.006304 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.006112 [TensorRT] VERBOSE: Tactic: 6 time 0.006208 [TensorRT] VERBOSE: Tactic: 7 time 0.006464 [TensorRT] VERBOSE: Tactic: 8 time 0.006432 [TensorRT] VERBOSE: Tactic: 9 time 0.006368 [TensorRT] VERBOSE: Tactic: 28 time 0.007008 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.006112 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011168 [TensorRT] VERBOSE: Tactic: 256 time 0.01104 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.027456 [TensorRT] VERBOSE: Tactic: -64 time 0.017664 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.01104 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.01024 [TensorRT] VERBOSE: Tactic: 25 time 0.009024 [TensorRT] VERBOSE: Tactic: 26 time 0.007072 [TensorRT] VERBOSE: Tactic: 27 time 0.008256 [TensorRT] VERBOSE: Tactic: 31 time 0.009472 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.007072 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014176 [TensorRT] VERBOSE: Tactic: 256 time 0.013856 [TensorRT] VERBOSE: Tactic: 512 time 0.014176 [TensorRT] VERBOSE: Tactic: -32 time 0.024384 [TensorRT] VERBOSE: Tactic: -64 time 0.018784 [TensorRT] VERBOSE: Tactic: -128 time 0.01728 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013856 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006112 [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 2 time 0.005952 [TensorRT] VERBOSE: Tactic: 3 time 0.005984 [TensorRT] VERBOSE: Tactic: 4 time 0.00608 [TensorRT] VERBOSE: Tactic: 5 time 0.006208 [TensorRT] VERBOSE: Tactic: 6 time 0.007616 [TensorRT] VERBOSE: Tactic: 7 time 0.00752 [TensorRT] VERBOSE: Tactic: 8 time 0.007456 [TensorRT] VERBOSE: Tactic: 9 time 0.007424 [TensorRT] VERBOSE: Tactic: 10 time 0.008 [TensorRT] VERBOSE: Tactic: 11 time 0.007584 [TensorRT] VERBOSE: Tactic: 12 time 0.00752 [TensorRT] VERBOSE: Tactic: 13 time 0.007552 [TensorRT] VERBOSE: Tactic: 14 time 0.007168 [TensorRT] VERBOSE: Tactic: 15 time 0.007584 [TensorRT] VERBOSE: Tactic: 16 time 0.007552 [TensorRT] VERBOSE: Tactic: 17 time 0.007488 [TensorRT] VERBOSE: Tactic: 18 time 0.007552 [TensorRT] VERBOSE: Tactic: 19 time 0.007616 [TensorRT] VERBOSE: Tactic: 20 time 0.012288 [TensorRT] VERBOSE: Tactic: 21 time 0.009344 [TensorRT] VERBOSE: Tactic: 22 time 0.007712 [TensorRT] VERBOSE: Tactic: 23 time 0.007936 [TensorRT] VERBOSE: Tactic: 28 time 0.007648 [TensorRT] VERBOSE: Tactic: 29 time 0.00928 [TensorRT] VERBOSE: Tactic: 30 time 0.011136 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01392 [TensorRT] VERBOSE: Tactic: 256 time 0.013856 [TensorRT] VERBOSE: Tactic: 512 time 0.01408 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013856 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_166 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006016 [TensorRT] VERBOSE: Tactic: 11 time 0.007552 [TensorRT] VERBOSE: Tactic: 12 time 0.007424 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009152 [TensorRT] VERBOSE: Tactic: 15 time 0.009568 [TensorRT] VERBOSE: Tactic: 16 time 0.01408 [TensorRT] VERBOSE: Tactic: 17 time 0.012576 [TensorRT] VERBOSE: Tactic: 18 time 0.01376 [TensorRT] VERBOSE: Tactic: 19 time 0.015328 [TensorRT] VERBOSE: Tactic: 20 time 0.005952 [TensorRT] VERBOSE: Tactic: 21 time 0.005952 [TensorRT] VERBOSE: Tactic: 22 time 0.007648 [TensorRT] VERBOSE: Tactic: 23 time 0.00912 [TensorRT] VERBOSE: Tactic: 24 time 0.005984 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.006016 [TensorRT] VERBOSE: Tactic: 27 time 0.007616 [TensorRT] VERBOSE: Tactic: 29 time 0.015552 [TensorRT] VERBOSE: Tactic: 30 time 0.010432 [TensorRT] VERBOSE: Tactic: 31 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_167 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_167 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_167 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_167 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_167 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014432 [TensorRT] VERBOSE: Tactic: 256 time 0.014784 [TensorRT] VERBOSE: Tactic: 512 time 0.014976 [TensorRT] VERBOSE: Tactic: -32 time 0.04944 [TensorRT] VERBOSE: Tactic: -64 time 0.027552 [TensorRT] VERBOSE: Tactic: -128 time 0.019744 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014432 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.01024 [TensorRT] VERBOSE: Tactic: 1 time 0.010144 [TensorRT] VERBOSE: Tactic: 2 time 0.009216 [TensorRT] VERBOSE: Tactic: 3 time 0.0096 [TensorRT] VERBOSE: Tactic: 4 time 0.009952 [TensorRT] VERBOSE: Tactic: 5 time 0.01024 [TensorRT] VERBOSE: Tactic: 6 time 0.011936 [TensorRT] VERBOSE: Tactic: 7 time 0.009504 [TensorRT] VERBOSE: Tactic: 8 time 0.009856 [TensorRT] VERBOSE: Tactic: 9 time 0.009696 [TensorRT] VERBOSE: Tactic: 28 time 0.009824 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.009216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014336 [TensorRT] VERBOSE: Tactic: 256 time 0.014272 [TensorRT] VERBOSE: Tactic: 512 time 0.014752 [TensorRT] VERBOSE: Tactic: -32 time 0.047872 [TensorRT] VERBOSE: Tactic: -64 time 0.027648 [TensorRT] VERBOSE: Tactic: -128 time 0.020096 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014272 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013376 [TensorRT] VERBOSE: Tactic: 25 time 0.013568 [TensorRT] VERBOSE: Tactic: 26 time 0.014784 [TensorRT] VERBOSE: Tactic: 27 time 0.016352 [TensorRT] VERBOSE: Tactic: 31 time 0.012832 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.012832 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017184 [TensorRT] VERBOSE: Tactic: 256 time 0.016896 [TensorRT] VERBOSE: Tactic: 512 time 0.017184 [TensorRT] VERBOSE: Tactic: -32 time 0.032768 [TensorRT] VERBOSE: Tactic: -64 time 0.02368 [TensorRT] VERBOSE: Tactic: -128 time 0.023296 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.016896 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007168 [TensorRT] VERBOSE: Tactic: 1 time 0.007552 [TensorRT] VERBOSE: Tactic: 2 time 0.00656 [TensorRT] VERBOSE: Tactic: 3 time 0.007584 [TensorRT] VERBOSE: Tactic: 4 time 0.007488 [TensorRT] VERBOSE: Tactic: 5 time 0.007712 [TensorRT] VERBOSE: Tactic: 6 time 0.009088 [TensorRT] VERBOSE: Tactic: 7 time 0.007936 [TensorRT] VERBOSE: Tactic: 8 time 0.009216 [TensorRT] VERBOSE: Tactic: 9 time 0.009312 [TensorRT] VERBOSE: Tactic: 10 time 0.009184 [TensorRT] VERBOSE: Tactic: 11 time 0.008896 [TensorRT] VERBOSE: Tactic: 12 time 0.00816 [TensorRT] VERBOSE: Tactic: 13 time 0.008 [TensorRT] VERBOSE: Tactic: 14 time 0.007744 [TensorRT] VERBOSE: Tactic: 15 time 0.008192 [TensorRT] VERBOSE: Tactic: 16 time 0.009248 [TensorRT] VERBOSE: Tactic: 17 time 0.007744 [TensorRT] VERBOSE: Tactic: 18 time 0.008192 [TensorRT] VERBOSE: Tactic: 19 time 0.00928 [TensorRT] VERBOSE: Tactic: 20 time 0.012384 [TensorRT] VERBOSE: Tactic: 21 time 0.01088 [TensorRT] VERBOSE: Tactic: 22 time 0.00928 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 28 time 0.009504 [TensorRT] VERBOSE: Tactic: 29 time 0.009248 [TensorRT] VERBOSE: Tactic: 30 time 0.012704 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.00656 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.017024 [TensorRT] VERBOSE: Tactic: 256 time 0.01696 [TensorRT] VERBOSE: Tactic: 512 time 0.016256 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.016256 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_168, Add_169) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007424 [TensorRT] VERBOSE: Tactic: 11 time 0.009152 [TensorRT] VERBOSE: Tactic: 12 time 0.007936 [TensorRT] VERBOSE: Tactic: 13 time 0.012288 [TensorRT] VERBOSE: Tactic: 14 time 0.010464 [TensorRT] VERBOSE: Tactic: 15 time 0.010752 [TensorRT] VERBOSE: Tactic: 16 time 0.02048 [TensorRT] VERBOSE: Tactic: 17 time 0.015488 [TensorRT] VERBOSE: Tactic: 18 time 0.01712 [TensorRT] VERBOSE: Tactic: 19 time 0.017408 [TensorRT] VERBOSE: Tactic: 20 time 0.007648 [TensorRT] VERBOSE: Tactic: 21 time 0.007424 [TensorRT] VERBOSE: Tactic: 22 time 0.009152 [TensorRT] VERBOSE: Tactic: 23 time 0.013856 [TensorRT] VERBOSE: Tactic: 24 time 0.00784 [TensorRT] VERBOSE: Tactic: 25 time 0.007488 [TensorRT] VERBOSE: Tactic: 26 time 0.009184 [TensorRT] VERBOSE: Tactic: 27 time 0.01104 [TensorRT] VERBOSE: Tactic: 29 time 0.02512 [TensorRT] VERBOSE: Tactic: 30 time 0.014432 [TensorRT] VERBOSE: Tactic: 31 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.007424 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_170 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011168 [TensorRT] VERBOSE: Tactic: 256 time 0.011168 [TensorRT] VERBOSE: Tactic: 512 time 0.0112 [TensorRT] VERBOSE: Tactic: -32 time 0.02752 [TensorRT] VERBOSE: Tactic: -64 time 0.017536 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011168 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006208 [TensorRT] VERBOSE: Tactic: 1 time 0.006208 [TensorRT] VERBOSE: Tactic: 2 time 0.006304 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.00624 [TensorRT] VERBOSE: Tactic: 5 time 0.00624 [TensorRT] VERBOSE: Tactic: 6 time 0.006304 [TensorRT] VERBOSE: Tactic: 7 time 0.006208 [TensorRT] VERBOSE: Tactic: 8 time 0.006304 [TensorRT] VERBOSE: Tactic: 9 time 0.007968 [TensorRT] VERBOSE: Tactic: 28 time 0.006304 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01168 [TensorRT] VERBOSE: Tactic: 256 time 0.011232 [TensorRT] VERBOSE: Tactic: 512 time 0.011168 [TensorRT] VERBOSE: Tactic: -32 time 0.027232 [TensorRT] VERBOSE: Tactic: -64 time 0.01744 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.011168 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.0096 [TensorRT] VERBOSE: Tactic: 25 time 0.009056 [TensorRT] VERBOSE: Tactic: 26 time 0.008352 [TensorRT] VERBOSE: Tactic: 27 time 0.008224 [TensorRT] VERBOSE: Tactic: 31 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.008224 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014112 [TensorRT] VERBOSE: Tactic: 256 time 0.014048 [TensorRT] VERBOSE: Tactic: 512 time 0.014048 [TensorRT] VERBOSE: Tactic: -32 time 0.024192 [TensorRT] VERBOSE: Tactic: -64 time 0.018624 [TensorRT] VERBOSE: Tactic: -128 time 0.017184 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014048 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.005984 [TensorRT] VERBOSE: Tactic: 2 time 0.006144 [TensorRT] VERBOSE: Tactic: 3 time 0.006016 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.005888 [TensorRT] VERBOSE: Tactic: 6 time 0.0064 [TensorRT] VERBOSE: Tactic: 7 time 0.007552 [TensorRT] VERBOSE: Tactic: 8 time 0.007392 [TensorRT] VERBOSE: Tactic: 9 time 0.007552 [TensorRT] VERBOSE: Tactic: 10 time 0.007968 [TensorRT] VERBOSE: Tactic: 11 time 0.007552 [TensorRT] VERBOSE: Tactic: 12 time 0.007648 [TensorRT] VERBOSE: Tactic: 13 time 0.007744 [TensorRT] VERBOSE: Tactic: 14 time 0.007616 [TensorRT] VERBOSE: Tactic: 15 time 0.006528 [TensorRT] VERBOSE: Tactic: 16 time 0.007392 [TensorRT] VERBOSE: Tactic: 17 time 0.007552 [TensorRT] VERBOSE: Tactic: 18 time 0.00768 [TensorRT] VERBOSE: Tactic: 19 time 0.007584 [TensorRT] VERBOSE: Tactic: 20 time 0.012384 [TensorRT] VERBOSE: Tactic: 21 time 0.009152 [TensorRT] VERBOSE: Tactic: 22 time 0.007968 [TensorRT] VERBOSE: Tactic: 23 time 0.007808 [TensorRT] VERBOSE: Tactic: 28 time 0.00752 [TensorRT] VERBOSE: Tactic: 29 time 0.009344 [TensorRT] VERBOSE: Tactic: 30 time 0.010656 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.005888 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013824 [TensorRT] VERBOSE: Tactic: 256 time 0.013312 [TensorRT] VERBOSE: Tactic: 512 time 0.01392 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013312 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_171 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.005984 [TensorRT] VERBOSE: Tactic: 11 time 0.007424 [TensorRT] VERBOSE: Tactic: 12 time 0.007584 [TensorRT] VERBOSE: Tactic: 13 time 0.00944 [TensorRT] VERBOSE: Tactic: 14 time 0.008928 [TensorRT] VERBOSE: Tactic: 15 time 0.010816 [TensorRT] VERBOSE: Tactic: 16 time 0.014048 [TensorRT] VERBOSE: Tactic: 17 time 0.012384 [TensorRT] VERBOSE: Tactic: 18 time 0.013888 [TensorRT] VERBOSE: Tactic: 19 time 0.015328 [TensorRT] VERBOSE: Tactic: 20 time 0.005984 [TensorRT] VERBOSE: Tactic: 21 time 0.00592 [TensorRT] VERBOSE: Tactic: 22 time 0.007648 [TensorRT] VERBOSE: Tactic: 23 time 0.009408 [TensorRT] VERBOSE: Tactic: 24 time 0.006016 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.006112 [TensorRT] VERBOSE: Tactic: 27 time 0.007648 [TensorRT] VERBOSE: Tactic: 29 time 0.01536 [TensorRT] VERBOSE: Tactic: 30 time 0.010848 [TensorRT] VERBOSE: Tactic: 31 time 0.00784 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.00592 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_172 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_172 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_172 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_172 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_172 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.015616 [TensorRT] VERBOSE: Tactic: 256 time 0.014336 [TensorRT] VERBOSE: Tactic: 512 time 0.015104 [TensorRT] VERBOSE: Tactic: -32 time 0.048128 [TensorRT] VERBOSE: Tactic: -64 time 0.028832 [TensorRT] VERBOSE: Tactic: -128 time 0.018432 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009984 [TensorRT] VERBOSE: Tactic: 1 time 0.010208 [TensorRT] VERBOSE: Tactic: 2 time 0.009824 [TensorRT] VERBOSE: Tactic: 3 time 0.0096 [TensorRT] VERBOSE: Tactic: 4 time 0.009984 [TensorRT] VERBOSE: Tactic: 5 time 0.009536 [TensorRT] VERBOSE: Tactic: 6 time 0.010752 [TensorRT] VERBOSE: Tactic: 7 time 0.009664 [TensorRT] VERBOSE: Tactic: 8 time 0.009728 [TensorRT] VERBOSE: Tactic: 9 time 0.008992 [TensorRT] VERBOSE: Tactic: 28 time 0.009824 [TensorRT] VERBOSE: Fastest Tactic: 9 Time: 0.008992 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014624 [TensorRT] VERBOSE: Tactic: 256 time 0.014848 [TensorRT] VERBOSE: Tactic: 512 time 0.014976 [TensorRT] VERBOSE: Tactic: -32 time 0.047008 [TensorRT] VERBOSE: Tactic: -64 time 0.027808 [TensorRT] VERBOSE: Tactic: -128 time 0.018944 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014624 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.01344 [TensorRT] VERBOSE: Tactic: 25 time 0.01424 [TensorRT] VERBOSE: Tactic: 26 time 0.013856 [TensorRT] VERBOSE: Tactic: 27 time 0.015616 [TensorRT] VERBOSE: Tactic: 31 time 0.013216 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.013216 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016896 [TensorRT] VERBOSE: Tactic: 256 time 0.016864 [TensorRT] VERBOSE: Tactic: 512 time 0.017216 [TensorRT] VERBOSE: Tactic: -32 time 0.03296 [TensorRT] VERBOSE: Tactic: -64 time 0.02368 [TensorRT] VERBOSE: Tactic: -128 time 0.023232 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.016864 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00768 [TensorRT] VERBOSE: Tactic: 1 time 0.007552 [TensorRT] VERBOSE: Tactic: 2 time 0.00672 [TensorRT] VERBOSE: Tactic: 3 time 0.007392 [TensorRT] VERBOSE: Tactic: 4 time 0.007584 [TensorRT] VERBOSE: Tactic: 5 time 0.00784 [TensorRT] VERBOSE: Tactic: 6 time 0.008736 [TensorRT] VERBOSE: Tactic: 7 time 0.007648 [TensorRT] VERBOSE: Tactic: 8 time 0.009216 [TensorRT] VERBOSE: Tactic: 9 time 0.009408 [TensorRT] VERBOSE: Tactic: 10 time 0.009184 [TensorRT] VERBOSE: Tactic: 11 time 0.008192 [TensorRT] VERBOSE: Tactic: 12 time 0.007776 [TensorRT] VERBOSE: Tactic: 13 time 0.009088 [TensorRT] VERBOSE: Tactic: 14 time 0.008096 [TensorRT] VERBOSE: Tactic: 15 time 0.007936 [TensorRT] VERBOSE: Tactic: 16 time 0.009152 [TensorRT] VERBOSE: Tactic: 17 time 0.009184 [TensorRT] VERBOSE: Tactic: 18 time 0.00912 [TensorRT] VERBOSE: Tactic: 19 time 0.008 [TensorRT] VERBOSE: Tactic: 20 time 0.012384 [TensorRT] VERBOSE: Tactic: 21 time 0.010816 [TensorRT] VERBOSE: Tactic: 22 time 0.009152 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 28 time 0.009376 [TensorRT] VERBOSE: Tactic: 29 time 0.009408 [TensorRT] VERBOSE: Tactic: 30 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.00672 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016992 [TensorRT] VERBOSE: Tactic: 256 time 0.01728 [TensorRT] VERBOSE: Tactic: 512 time 0.017056 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.016992 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_173, Add_174) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007968 [TensorRT] VERBOSE: Tactic: 11 time 0.009216 [TensorRT] VERBOSE: Tactic: 12 time 0.007936 [TensorRT] VERBOSE: Tactic: 13 time 0.01232 [TensorRT] VERBOSE: Tactic: 14 time 0.010688 [TensorRT] VERBOSE: Tactic: 15 time 0.010688 [TensorRT] VERBOSE: Tactic: 16 time 0.020448 [TensorRT] VERBOSE: Tactic: 17 time 0.015392 [TensorRT] VERBOSE: Tactic: 18 time 0.01568 [TensorRT] VERBOSE: Tactic: 19 time 0.017248 [TensorRT] VERBOSE: Tactic: 20 time 0.007936 [TensorRT] VERBOSE: Tactic: 21 time 0.00768 [TensorRT] VERBOSE: Tactic: 22 time 0.009152 [TensorRT] VERBOSE: Tactic: 23 time 0.014016 [TensorRT] VERBOSE: Tactic: 24 time 0.007744 [TensorRT] VERBOSE: Tactic: 25 time 0.007488 [TensorRT] VERBOSE: Tactic: 26 time 0.009216 [TensorRT] VERBOSE: Tactic: 27 time 0.010976 [TensorRT] VERBOSE: Tactic: 29 time 0.025056 [TensorRT] VERBOSE: Tactic: 30 time 0.014144 [TensorRT] VERBOSE: Tactic: 31 time 0.010624 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.007488 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_175 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010624 [TensorRT] VERBOSE: Tactic: 256 time 0.0112 [TensorRT] VERBOSE: Tactic: 512 time 0.011648 [TensorRT] VERBOSE: Tactic: -32 time 0.028256 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.010624 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006208 [TensorRT] VERBOSE: Tactic: 1 time 0.006464 [TensorRT] VERBOSE: Tactic: 2 time 0.006176 [TensorRT] VERBOSE: Tactic: 3 time 0.006464 [TensorRT] VERBOSE: Tactic: 4 time 0.006304 [TensorRT] VERBOSE: Tactic: 5 time 0.006272 [TensorRT] VERBOSE: Tactic: 6 time 0.006336 [TensorRT] VERBOSE: Tactic: 7 time 0.006208 [TensorRT] VERBOSE: Tactic: 8 time 0.006432 [TensorRT] VERBOSE: Tactic: 9 time 0.007712 [TensorRT] VERBOSE: Tactic: 28 time 0.006272 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006176 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011072 [TensorRT] VERBOSE: Tactic: 256 time 0.011168 [TensorRT] VERBOSE: Tactic: 512 time 0.0112 [TensorRT] VERBOSE: Tactic: -32 time 0.027808 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.01424 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.01008 [TensorRT] VERBOSE: Tactic: 25 time 0.009184 [TensorRT] VERBOSE: Tactic: 26 time 0.00688 [TensorRT] VERBOSE: Tactic: 27 time 0.008032 [TensorRT] VERBOSE: Tactic: 31 time 0.009024 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.00688 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014176 [TensorRT] VERBOSE: Tactic: 256 time 0.013856 [TensorRT] VERBOSE: Tactic: 512 time 0.013824 [TensorRT] VERBOSE: Tactic: -32 time 0.024896 [TensorRT] VERBOSE: Tactic: -64 time 0.017152 [TensorRT] VERBOSE: Tactic: -128 time 0.017792 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.013824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.006016 [TensorRT] VERBOSE: Tactic: 2 time 0.005952 [TensorRT] VERBOSE: Tactic: 3 time 0.005728 [TensorRT] VERBOSE: Tactic: 4 time 0.00592 [TensorRT] VERBOSE: Tactic: 5 time 0.006016 [TensorRT] VERBOSE: Tactic: 6 time 0.007328 [TensorRT] VERBOSE: Tactic: 7 time 0.007552 [TensorRT] VERBOSE: Tactic: 8 time 0.00752 [TensorRT] VERBOSE: Tactic: 9 time 0.00752 [TensorRT] VERBOSE: Tactic: 10 time 0.009312 [TensorRT] VERBOSE: Tactic: 11 time 0.00752 [TensorRT] VERBOSE: Tactic: 12 time 0.007648 [TensorRT] VERBOSE: Tactic: 13 time 0.007328 [TensorRT] VERBOSE: Tactic: 14 time 0.007616 [TensorRT] VERBOSE: Tactic: 15 time 0.006208 [TensorRT] VERBOSE: Tactic: 16 time 0.007584 [TensorRT] VERBOSE: Tactic: 17 time 0.007584 [TensorRT] VERBOSE: Tactic: 18 time 0.007424 [TensorRT] VERBOSE: Tactic: 19 time 0.007584 [TensorRT] VERBOSE: Tactic: 20 time 0.012288 [TensorRT] VERBOSE: Tactic: 21 time 0.009152 [TensorRT] VERBOSE: Tactic: 22 time 0.007744 [TensorRT] VERBOSE: Tactic: 23 time 0.007392 [TensorRT] VERBOSE: Tactic: 28 time 0.007616 [TensorRT] VERBOSE: Tactic: 29 time 0.009184 [TensorRT] VERBOSE: Tactic: 30 time 0.010752 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.005728 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014048 [TensorRT] VERBOSE: Tactic: 256 time 0.013856 [TensorRT] VERBOSE: Tactic: 512 time 0.013824 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.013824 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_176 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006048 [TensorRT] VERBOSE: Tactic: 11 time 0.007648 [TensorRT] VERBOSE: Tactic: 12 time 0.007552 [TensorRT] VERBOSE: Tactic: 13 time 0.00912 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.010784 [TensorRT] VERBOSE: Tactic: 16 time 0.01408 [TensorRT] VERBOSE: Tactic: 17 time 0.01376 [TensorRT] VERBOSE: Tactic: 18 time 0.013984 [TensorRT] VERBOSE: Tactic: 19 time 0.015328 [TensorRT] VERBOSE: Tactic: 20 time 0.006048 [TensorRT] VERBOSE: Tactic: 21 time 0.006016 [TensorRT] VERBOSE: Tactic: 22 time 0.007648 [TensorRT] VERBOSE: Tactic: 23 time 0.009056 [TensorRT] VERBOSE: Tactic: 24 time 0.00608 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.006144 [TensorRT] VERBOSE: Tactic: 27 time 0.007584 [TensorRT] VERBOSE: Tactic: 29 time 0.015136 [TensorRT] VERBOSE: Tactic: 30 time 0.01072 [TensorRT] VERBOSE: Tactic: 31 time 0.007584 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_177 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_177 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_177 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_177 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_177 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176), Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014272 [TensorRT] VERBOSE: Tactic: 256 time 0.014464 [TensorRT] VERBOSE: Tactic: 512 time 0.01504 [TensorRT] VERBOSE: Tactic: -32 time 0.047968 [TensorRT] VERBOSE: Tactic: -64 time 0.027936 [TensorRT] VERBOSE: Tactic: -128 time 0.019872 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.014272 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Tactic: 1 time 0.010176 [TensorRT] VERBOSE: Tactic: 2 time 0.010176 [TensorRT] VERBOSE: Tactic: 3 time 0.009312 [TensorRT] VERBOSE: Tactic: 4 time 0.009824 [TensorRT] VERBOSE: Tactic: 5 time 0.009696 [TensorRT] VERBOSE: Tactic: 6 time 0.011264 [TensorRT] VERBOSE: Tactic: 7 time 0.009472 [TensorRT] VERBOSE: Tactic: 8 time 0.01008 [TensorRT] VERBOSE: Tactic: 9 time 0.009312 [TensorRT] VERBOSE: Tactic: 28 time 0.008992 [TensorRT] VERBOSE: Fastest Tactic: 28 Time: 0.008992 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014464 [TensorRT] VERBOSE: Tactic: 256 time 0.014336 [TensorRT] VERBOSE: Tactic: 512 time 0.015424 [TensorRT] VERBOSE: Tactic: -32 time 0.048256 [TensorRT] VERBOSE: Tactic: -64 time 0.027712 [TensorRT] VERBOSE: Tactic: -128 time 0.02048 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.014336 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.013312 [TensorRT] VERBOSE: Tactic: 25 time 0.013536 [TensorRT] VERBOSE: Tactic: 26 time 0.01424 [TensorRT] VERBOSE: Tactic: 27 time 0.016384 [TensorRT] VERBOSE: Tactic: 31 time 0.013184 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.013184 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544), Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.016768 [TensorRT] VERBOSE: Tactic: 256 time 0.017184 [TensorRT] VERBOSE: Tactic: 512 time 0.017184 [TensorRT] VERBOSE: Tactic: -32 time 0.033152 [TensorRT] VERBOSE: Tactic: -64 time 0.02384 [TensorRT] VERBOSE: Tactic: -128 time 0.023424 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.016768 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008032 [TensorRT] VERBOSE: Tactic: 1 time 0.00752 [TensorRT] VERBOSE: Tactic: 2 time 0.006208 [TensorRT] VERBOSE: Tactic: 3 time 0.007424 [TensorRT] VERBOSE: Tactic: 4 time 0.007552 [TensorRT] VERBOSE: Tactic: 5 time 0.007872 [TensorRT] VERBOSE: Tactic: 6 time 0.009216 [TensorRT] VERBOSE: Tactic: 7 time 0.009088 [TensorRT] VERBOSE: Tactic: 8 time 0.00912 [TensorRT] VERBOSE: Tactic: 9 time 0.009728 [TensorRT] VERBOSE: Tactic: 10 time 0.009152 [TensorRT] VERBOSE: Tactic: 11 time 0.00912 [TensorRT] VERBOSE: Tactic: 12 time 0.007968 [TensorRT] VERBOSE: Tactic: 13 time 0.009088 [TensorRT] VERBOSE: Tactic: 14 time 0.00752 [TensorRT] VERBOSE: Tactic: 15 time 0.008 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.00912 [TensorRT] VERBOSE: Tactic: 18 time 0.009152 [TensorRT] VERBOSE: Tactic: 19 time 0.009344 [TensorRT] VERBOSE: Tactic: 20 time 0.01248 [TensorRT] VERBOSE: Tactic: 21 time 0.011008 [TensorRT] VERBOSE: Tactic: 22 time 0.009216 [TensorRT] VERBOSE: Tactic: 23 time 0.009184 [TensorRT] VERBOSE: Tactic: 28 time 0.009408 [TensorRT] VERBOSE: Tactic: 29 time 0.009184 [TensorRT] VERBOSE: Tactic: 30 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006208 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568), Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.015808 [TensorRT] VERBOSE: Tactic: 256 time 0.016992 [TensorRT] VERBOSE: Tactic: 512 time 0.01728 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.015808 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_178, Add_179) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007584 [TensorRT] VERBOSE: Tactic: 11 time 0.009216 [TensorRT] VERBOSE: Tactic: 12 time 0.007904 [TensorRT] VERBOSE: Tactic: 13 time 0.01248 [TensorRT] VERBOSE: Tactic: 14 time 0.010656 [TensorRT] VERBOSE: Tactic: 15 time 0.01088 [TensorRT] VERBOSE: Tactic: 16 time 0.020288 [TensorRT] VERBOSE: Tactic: 17 time 0.015456 [TensorRT] VERBOSE: Tactic: 18 time 0.016896 [TensorRT] VERBOSE: Tactic: 19 time 0.017024 [TensorRT] VERBOSE: Tactic: 20 time 0.007744 [TensorRT] VERBOSE: Tactic: 21 time 0.007616 [TensorRT] VERBOSE: Tactic: 22 time 0.009184 [TensorRT] VERBOSE: Tactic: 23 time 0.013664 [TensorRT] VERBOSE: Tactic: 24 time 0.007648 [TensorRT] VERBOSE: Tactic: 25 time 0.007552 [TensorRT] VERBOSE: Tactic: 26 time 0.00912 [TensorRT] VERBOSE: Tactic: 27 time 0.012288 [TensorRT] VERBOSE: Tactic: 29 time 0.02528 [TensorRT] VERBOSE: Tactic: 30 time 0.01408 [TensorRT] VERBOSE: Tactic: 31 time 0.010112 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.007552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_180 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.008224 [TensorRT] VERBOSE: Tactic: 0 time 0.006304 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006304 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.013856 [TensorRT] VERBOSE: Tactic: 0 time 0.025376 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.013856 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016096 [TensorRT] VERBOSE: Tactic: 0 time 0.009664 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009664 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015648 [TensorRT] VERBOSE: Tactic: 0 time 0.01888 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015648 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022464 [TensorRT] VERBOSE: Tactic: 0 time 0.013024 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013024 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0152 [TensorRT] VERBOSE: Tactic: 0 time 0.006528 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006528 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017376 [TensorRT] VERBOSE: Tactic: 0 time 0.012736 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012736 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015712 [TensorRT] VERBOSE: Tactic: 0 time 0.021952 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015712 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,50176) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.012736 [TensorRT] VERBOSE: Tactic: 256 time 0.012512 [TensorRT] VERBOSE: Tactic: 512 time 0.0128 [TensorRT] VERBOSE: Tactic: -32 time 0.027296 [TensorRT] VERBOSE: Tactic: -64 time 0.01888 [TensorRT] VERBOSE: Tactic: -128 time 0.015968 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.012512 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.008096 [TensorRT] VERBOSE: Tactic: 1 time 0.006336 [TensorRT] VERBOSE: Tactic: 2 time 0.006752 [TensorRT] VERBOSE: Tactic: 3 time 0.006176 [TensorRT] VERBOSE: Tactic: 4 time 0.006432 [TensorRT] VERBOSE: Tactic: 5 time 0.006272 [TensorRT] VERBOSE: Tactic: 6 time 0.006528 [TensorRT] VERBOSE: Tactic: 7 time 0.006304 [TensorRT] VERBOSE: Tactic: 8 time 0.006496 [TensorRT] VERBOSE: Tactic: 9 time 0.006464 [TensorRT] VERBOSE: Tactic: 28 time 0.00784 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.006176 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.012864 [TensorRT] VERBOSE: Tactic: 256 time 0.012704 [TensorRT] VERBOSE: Tactic: 512 time 0.013248 [TensorRT] VERBOSE: Tactic: -32 time 0.027648 [TensorRT] VERBOSE: Tactic: -64 time 0.018784 [TensorRT] VERBOSE: Tactic: -128 time 0.015136 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.012704 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.00976 [TensorRT] VERBOSE: Tactic: 25 time 0.009056 [TensorRT] VERBOSE: Tactic: 26 time 0.008192 [TensorRT] VERBOSE: Tactic: 27 time 0.008096 [TensorRT] VERBOSE: Tactic: 31 time 0.009344 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.008096 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,12544) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013984 [TensorRT] VERBOSE: Tactic: 256 time 0.014048 [TensorRT] VERBOSE: Tactic: 512 time 0.013984 [TensorRT] VERBOSE: Tactic: -32 time 0.02496 [TensorRT] VERBOSE: Tactic: -64 time 0.018656 [TensorRT] VERBOSE: Tactic: -128 time 0.017152 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013984 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005984 [TensorRT] VERBOSE: Tactic: 1 time 0.006144 [TensorRT] VERBOSE: Tactic: 2 time 0.006336 [TensorRT] VERBOSE: Tactic: 3 time 0.006112 [TensorRT] VERBOSE: Tactic: 4 time 0.006048 [TensorRT] VERBOSE: Tactic: 5 time 0.006016 [TensorRT] VERBOSE: Tactic: 6 time 0.007616 [TensorRT] VERBOSE: Tactic: 7 time 0.007552 [TensorRT] VERBOSE: Tactic: 8 time 0.007552 [TensorRT] VERBOSE: Tactic: 9 time 0.007584 [TensorRT] VERBOSE: Tactic: 10 time 0.007936 [TensorRT] VERBOSE: Tactic: 11 time 0.007616 [TensorRT] VERBOSE: Tactic: 12 time 0.007424 [TensorRT] VERBOSE: Tactic: 13 time 0.007424 [TensorRT] VERBOSE: Tactic: 14 time 0.007584 [TensorRT] VERBOSE: Tactic: 15 time 0.007584 [TensorRT] VERBOSE: Tactic: 16 time 0.007456 [TensorRT] VERBOSE: Tactic: 17 time 0.007616 [TensorRT] VERBOSE: Tactic: 18 time 0.00752 [TensorRT] VERBOSE: Tactic: 19 time 0.007552 [TensorRT] VERBOSE: Tactic: 20 time 0.012512 [TensorRT] VERBOSE: Tactic: 21 time 0.009088 [TensorRT] VERBOSE: Tactic: 22 time 0.00784 [TensorRT] VERBOSE: Tactic: 23 time 0.007584 [TensorRT] VERBOSE: Tactic: 28 time 0.007616 [TensorRT] VERBOSE: Tactic: 29 time 0.009216 [TensorRT] VERBOSE: Tactic: 30 time 0.01072 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,1568) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014016 [TensorRT] VERBOSE: Tactic: 256 time 0.01392 [TensorRT] VERBOSE: Tactic: 512 time 0.01312 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.01312 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_181 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006016 [TensorRT] VERBOSE: Tactic: 11 time 0.007424 [TensorRT] VERBOSE: Tactic: 12 time 0.007488 [TensorRT] VERBOSE: Tactic: 13 time 0.009152 [TensorRT] VERBOSE: Tactic: 14 time 0.009152 [TensorRT] VERBOSE: Tactic: 15 time 0.00944 [TensorRT] VERBOSE: Tactic: 16 time 0.013568 [TensorRT] VERBOSE: Tactic: 17 time 0.013728 [TensorRT] VERBOSE: Tactic: 18 time 0.013824 [TensorRT] VERBOSE: Tactic: 19 time 0.015168 [TensorRT] VERBOSE: Tactic: 20 time 0.006048 [TensorRT] VERBOSE: Tactic: 21 time 0.006432 [TensorRT] VERBOSE: Tactic: 22 time 0.007392 [TensorRT] VERBOSE: Tactic: 23 time 0.009088 [TensorRT] VERBOSE: Tactic: 24 time 0.006144 [TensorRT] VERBOSE: Tactic: 25 time 0.006016 [TensorRT] VERBOSE: Tactic: 26 time 0.006048 [TensorRT] VERBOSE: Tactic: 27 time 0.007488 [TensorRT] VERBOSE: Tactic: 29 time 0.01536 [TensorRT] VERBOSE: Tactic: 30 time 0.010688 [TensorRT] VERBOSE: Tactic: 31 time 0.007584 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01328 [TensorRT] VERBOSE: Tactic: 0 time 0.025376 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01328 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015808 [TensorRT] VERBOSE: Tactic: 0 time 0.006112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006112 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01552 [TensorRT] VERBOSE: Tactic: 0 time 0.018848 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01552 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.022496 [TensorRT] VERBOSE: Tactic: 0 time 0.012576 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012576 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017088 [TensorRT] VERBOSE: Tactic: 0 time 0.012256 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012256 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015392 [TensorRT] VERBOSE: Tactic: 0 time 0.021984 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015392 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016448 [TensorRT] VERBOSE: Tactic: 0 time 0.009504 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009504 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016032 [TensorRT] VERBOSE: Tactic: 0 time 0.0256 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016032 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015936 [TensorRT] VERBOSE: Tactic: 0 time 0.005984 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005984 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016384 [TensorRT] VERBOSE: Tactic: 0 time 0.009504 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009504 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015936 [TensorRT] VERBOSE: Tactic: 0 time 0.02592 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015936 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017344 [TensorRT] VERBOSE: Tactic: 0 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009216 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_183 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,100352) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01952 [TensorRT] VERBOSE: Tactic: 256 time 0.019712 [TensorRT] VERBOSE: Tactic: 512 time 0.019712 [TensorRT] VERBOSE: Tactic: -32 time 0.042656 [TensorRT] VERBOSE: Tactic: -64 time 0.027264 [TensorRT] VERBOSE: Tactic: -128 time 0.025312 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01952 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.012192 [TensorRT] VERBOSE: Tactic: 1 time 0.011968 [TensorRT] VERBOSE: Tactic: 2 time 0.011168 [TensorRT] VERBOSE: Tactic: 3 time 0.01328 [TensorRT] VERBOSE: Tactic: 4 time 0.011424 [TensorRT] VERBOSE: Tactic: 5 time 0.012672 [TensorRT] VERBOSE: Tactic: 6 time 0.013152 [TensorRT] VERBOSE: Tactic: 7 time 0.012992 [TensorRT] VERBOSE: Tactic: 8 time 0.011296 [TensorRT] VERBOSE: Tactic: 9 time 0.011488 [TensorRT] VERBOSE: Tactic: 28 time 0.013472 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.011168 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196:32,3136) -> Float(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01904 [TensorRT] VERBOSE: Tactic: 256 time 0.0192 [TensorRT] VERBOSE: Tactic: 512 time 0.021984 [TensorRT] VERBOSE: Tactic: -32 time 0.042464 [TensorRT] VERBOSE: Tactic: -64 time 0.026688 [TensorRT] VERBOSE: Tactic: -128 time 0.0272 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01904 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.01568 [TensorRT] VERBOSE: Tactic: 25 time 0.014752 [TensorRT] VERBOSE: Tactic: 26 time 0.014048 [TensorRT] VERBOSE: Tactic: 27 time 0.01328 [TensorRT] VERBOSE: Tactic: 31 time 0.014688 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.01328 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,14,196:4,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.023328 [TensorRT] VERBOSE: Tactic: 256 time 0.021888 [TensorRT] VERBOSE: Tactic: 512 time 0.022048 [TensorRT] VERBOSE: Tactic: -32 time 0.026432 [TensorRT] VERBOSE: Tactic: -64 time 0.029568 [TensorRT] VERBOSE: Tactic: -128 time 0.03136 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.021888 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.009408 [TensorRT] VERBOSE: Tactic: 1 time 0.008672 [TensorRT] VERBOSE: Tactic: 2 time 0.008032 [TensorRT] VERBOSE: Tactic: 3 time 0.007712 [TensorRT] VERBOSE: Tactic: 4 time 0.007712 [TensorRT] VERBOSE: Tactic: 5 time 0.008128 [TensorRT] VERBOSE: Tactic: 6 time 0.007584 [TensorRT] VERBOSE: Tactic: 7 time 0.007584 [TensorRT] VERBOSE: Tactic: 8 time 0.008288 [TensorRT] VERBOSE: Tactic: 9 time 0.009952 [TensorRT] VERBOSE: Tactic: 10 time 0.013312 [TensorRT] VERBOSE: Tactic: 11 time 0.011264 [TensorRT] VERBOSE: Tactic: 12 time 0.011136 [TensorRT] VERBOSE: Tactic: 13 time 0.009504 [TensorRT] VERBOSE: Tactic: 14 time 0.00944 [TensorRT] VERBOSE: Tactic: 15 time 0.008512 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.009184 [TensorRT] VERBOSE: Tactic: 18 time 0.00944 [TensorRT] VERBOSE: Tactic: 19 time 0.00912 [TensorRT] VERBOSE: Tactic: 20 time 0.018784 [TensorRT] VERBOSE: Tactic: 21 time 0.01552 [TensorRT] VERBOSE: Tactic: 22 time 0.01232 [TensorRT] VERBOSE: Tactic: 23 time 0.010944 [TensorRT] VERBOSE: Tactic: 28 time 0.010848 [TensorRT] VERBOSE: Tactic: 29 time 0.012832 [TensorRT] VERBOSE: Tactic: 30 time 0.01872 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.007584 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Int8(1,14,196:32,3136) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.022336 [TensorRT] VERBOSE: Tactic: 256 time 0.02176 [TensorRT] VERBOSE: Tactic: 512 time 0.021952 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.02176 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_184 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007904 [TensorRT] VERBOSE: Tactic: 11 time 0.007584 [TensorRT] VERBOSE: Tactic: 12 time 0.007904 [TensorRT] VERBOSE: Tactic: 13 time 0.009184 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.010368 [TensorRT] VERBOSE: Tactic: 16 time 0.013824 [TensorRT] VERBOSE: Tactic: 17 time 0.013728 [TensorRT] VERBOSE: Tactic: 18 time 0.015648 [TensorRT] VERBOSE: Tactic: 19 time 0.016032 [TensorRT] VERBOSE: Tactic: 20 time 0.008096 [TensorRT] VERBOSE: Tactic: 21 time 0.007488 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.010464 [TensorRT] VERBOSE: Tactic: 24 time 0.009248 [TensorRT] VERBOSE: Tactic: 25 time 0.00784 [TensorRT] VERBOSE: Tactic: 26 time 0.007584 [TensorRT] VERBOSE: Tactic: 27 time 0.00768 [TensorRT] VERBOSE: Tactic: 29 time 0.028256 [TensorRT] VERBOSE: Tactic: 30 time 0.016576 [TensorRT] VERBOSE: Tactic: 31 time 0.010912 [TensorRT] VERBOSE: Fastest Tactic: 21 Time: 0.007488 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.720832 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.720832 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.919008 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.971008 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.924128 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.933472 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.963936 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.996608 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 1.08544 [TensorRT] VERBOSE: Conv_185 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 1.26026 [TensorRT] VERBOSE: Fastest Tactic: 1825138533642645384 Time: 0.919008 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.783296 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 903168, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 2288386048, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 38351360, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.783296 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.247392 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.367168 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.316512 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.263712 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.369056 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.338496 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.259808 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.257152 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.244896 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.246432 [TensorRT] VERBOSE: Fastest Tactic: -4973811344878172338 Time: 0.244896 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4973811344878172338 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.31088 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.31088 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.258784 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.249376 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.360384 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.24256 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.337472 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.23968 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.319008 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.2432 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.360512 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.254688 [TensorRT] VERBOSE: Fastest Tactic: -7210942453088153035 Time: 0.23968 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7210942453088153035 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:4,25088) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.365504 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.33168 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.257056 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.319488 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.253888 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.364544 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.243584 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.262944 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.24384 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.245152 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.243584 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_185 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,14,196:32,3136) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 458751 time 0.186496 [TensorRT] VERBOSE: Fastest Tactic: 458751 Time: 0.186496 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CaskConvolution) [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.103232 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.13856 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.132128 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.127456 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.127872 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.113408 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.145216 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.132544 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.137216 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.1248 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.12736 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.08944 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.08944 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_185 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016352 [TensorRT] VERBOSE: Tactic: 0 time 0.024416 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016352 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018752 [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00608 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018784 [TensorRT] VERBOSE: Tactic: 0 time 0.018624 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.018624 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0496 [TensorRT] VERBOSE: Tactic: 0 time 0.010528 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010528 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0192 [TensorRT] VERBOSE: Tactic: 0 time 0.011264 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018784 [TensorRT] VERBOSE: Tactic: 0 time 0.02032 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.018784 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017728 [TensorRT] VERBOSE: Tactic: 0 time 0.00624 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00624 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018912 [TensorRT] VERBOSE: Tactic: 0 time 0.024576 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.018912 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018656 [TensorRT] VERBOSE: Tactic: 0 time 0.006048 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006048 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.018112 [TensorRT] VERBOSE: Tactic: 0 time 0.009248 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009248 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01888 [TensorRT] VERBOSE: Tactic: 0 time 0.02432 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01888 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0192 [TensorRT] VERBOSE: Tactic: 0 time 0.009152 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009152 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 256 time 0.011392 [TensorRT] VERBOSE: Tactic: 512 time 0.011424 [TensorRT] VERBOSE: Tactic: -32 time 0.027136 [TensorRT] VERBOSE: Tactic: -64 time 0.017632 [TensorRT] VERBOSE: Tactic: -128 time 0.014592 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006432 [TensorRT] VERBOSE: Tactic: 1 time 0.006208 [TensorRT] VERBOSE: Tactic: 2 time 0.006272 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.006144 [TensorRT] VERBOSE: Tactic: 7 time 0.006656 [TensorRT] VERBOSE: Tactic: 8 time 0.00656 [TensorRT] VERBOSE: Tactic: 9 time 0.0064 [TensorRT] VERBOSE: Tactic: 28 time 0.00624 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011456 [TensorRT] VERBOSE: Tactic: 256 time 0.011264 [TensorRT] VERBOSE: Tactic: 512 time 0.011072 [TensorRT] VERBOSE: Tactic: -32 time 0.027648 [TensorRT] VERBOSE: Tactic: -64 time 0.017568 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.011072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.00912 [TensorRT] VERBOSE: Tactic: 25 time 0.008992 [TensorRT] VERBOSE: Tactic: 26 time 0.008128 [TensorRT] VERBOSE: Tactic: 27 time 0.00848 [TensorRT] VERBOSE: Tactic: 31 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.008128 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01376 [TensorRT] VERBOSE: Tactic: 256 time 0.013728 [TensorRT] VERBOSE: Tactic: 512 time 0.013856 [TensorRT] VERBOSE: Tactic: -32 time 0.018432 [TensorRT] VERBOSE: Tactic: -64 time 0.020256 [TensorRT] VERBOSE: Tactic: -128 time 0.020224 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013728 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 2 time 0.006016 [TensorRT] VERBOSE: Tactic: 3 time 0.007392 [TensorRT] VERBOSE: Tactic: 4 time 0.006112 [TensorRT] VERBOSE: Tactic: 5 time 0.00608 [TensorRT] VERBOSE: Tactic: 6 time 0.009216 [TensorRT] VERBOSE: Tactic: 7 time 0.007456 [TensorRT] VERBOSE: Tactic: 8 time 0.007616 [TensorRT] VERBOSE: Tactic: 9 time 0.006016 [TensorRT] VERBOSE: Tactic: 10 time 0.009216 [TensorRT] VERBOSE: Tactic: 11 time 0.007872 [TensorRT] VERBOSE: Tactic: 12 time 0.007392 [TensorRT] VERBOSE: Tactic: 13 time 0.007648 [TensorRT] VERBOSE: Tactic: 14 time 0.007872 [TensorRT] VERBOSE: Tactic: 15 time 0.007104 [TensorRT] VERBOSE: Tactic: 16 time 0.009088 [TensorRT] VERBOSE: Tactic: 17 time 0.00736 [TensorRT] VERBOSE: Tactic: 18 time 0.007648 [TensorRT] VERBOSE: Tactic: 19 time 0.007712 [TensorRT] VERBOSE: Tactic: 20 time 0.012512 [TensorRT] VERBOSE: Tactic: 21 time 0.010752 [TensorRT] VERBOSE: Tactic: 22 time 0.009664 [TensorRT] VERBOSE: Tactic: 23 time 0.007584 [TensorRT] VERBOSE: Tactic: 28 time 0.007488 [TensorRT] VERBOSE: Tactic: 29 time 0.009152 [TensorRT] VERBOSE: Tactic: 30 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.013344 [TensorRT] VERBOSE: Tactic: 256 time 0.01376 [TensorRT] VERBOSE: Tactic: 512 time 0.013504 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.013344 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_186 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.005952 [TensorRT] VERBOSE: Tactic: 11 time 0.006848 [TensorRT] VERBOSE: Tactic: 12 time 0.007392 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009184 [TensorRT] VERBOSE: Tactic: 15 time 0.0096 [TensorRT] VERBOSE: Tactic: 16 time 0.013312 [TensorRT] VERBOSE: Tactic: 17 time 0.009856 [TensorRT] VERBOSE: Tactic: 18 time 0.01056 [TensorRT] VERBOSE: Tactic: 19 time 0.012224 [TensorRT] VERBOSE: Tactic: 20 time 0.006048 [TensorRT] VERBOSE: Tactic: 21 time 0.006112 [TensorRT] VERBOSE: Tactic: 22 time 0.007616 [TensorRT] VERBOSE: Tactic: 23 time 0.009248 [TensorRT] VERBOSE: Tactic: 24 time 0.006016 [TensorRT] VERBOSE: Tactic: 25 time 0.005984 [TensorRT] VERBOSE: Tactic: 26 time 0.00608 [TensorRT] VERBOSE: Tactic: 27 time 0.007584 [TensorRT] VERBOSE: Tactic: 29 time 0.01536 [TensorRT] VERBOSE: Tactic: 30 time 0.010144 [TensorRT] VERBOSE: Tactic: 31 time 0.007936 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.607552 [TensorRT] VERBOSE: Tactic: 655359 time 0.392416 [TensorRT] VERBOSE: Tactic: 786431 time 0.29136 [TensorRT] VERBOSE: Tactic: 851967 time 0.23568 [TensorRT] VERBOSE: Tactic: 1179647 time 0.220096 [TensorRT] VERBOSE: Tactic: 1310719 time 0.417792 [TensorRT] VERBOSE: Tactic: 1376255 time 0.399872 [TensorRT] VERBOSE: Tactic: 1441791 time 0.387104 [TensorRT] VERBOSE: Tactic: 1507327 time 0.222208 [TensorRT] VERBOSE: Tactic: 1638399 time 0.296224 [TensorRT] VERBOSE: Tactic: 1835007 time 0.2816 [TensorRT] VERBOSE: Tactic: 1900543 time 0.413952 [TensorRT] VERBOSE: Tactic: 2097151 time 0.18432 [TensorRT] VERBOSE: Tactic: 2162687 time 0.408576 [TensorRT] VERBOSE: Tactic: 2293759 time 0.387392 [TensorRT] VERBOSE: Tactic: 2359295 time 0.258688 [TensorRT] VERBOSE: Tactic: 2686975 time 0.387392 [TensorRT] VERBOSE: Tactic: 3080191 time 0.208352 [TensorRT] VERBOSE: Tactic: 3342335 time 0.416256 [TensorRT] VERBOSE: Tactic: 3407871 time 0.21536 [TensorRT] VERBOSE: Tactic: 3538943 time 0.222752 [TensorRT] VERBOSE: Tactic: 3670015 time 0.748896 [TensorRT] VERBOSE: Tactic: 3932159 time 0.34448 [TensorRT] VERBOSE: Tactic: 3997695 time 0.297056 [TensorRT] VERBOSE: Tactic: 4063231 time 0.229888 [TensorRT] VERBOSE: Tactic: 4194303 time 0.1536 [TensorRT] VERBOSE: Tactic: 4259839 time 0.19008 [TensorRT] VERBOSE: Tactic: 4325375 time 0.248 [TensorRT] VERBOSE: Tactic: 4521983 time 0.36752 [TensorRT] VERBOSE: Tactic: 4587519 time 0.209344 [TensorRT] VERBOSE: Tactic: 4653055 time 0.193184 [TensorRT] VERBOSE: Tactic: 4915199 time 0.1656 [TensorRT] VERBOSE: Tactic: 4980735 time 0.228416 [TensorRT] VERBOSE: Tactic: 5177343 time 0.22272 [TensorRT] VERBOSE: Tactic: 5242879 time 0.20192 [TensorRT] VERBOSE: Tactic: 5373951 time 0.22736 [TensorRT] VERBOSE: Tactic: 5439487 time 0.258464 [TensorRT] VERBOSE: Tactic: 5570559 time 0.217472 [TensorRT] VERBOSE: Tactic: 5636095 time 0.231264 [TensorRT] VERBOSE: Tactic: 5701631 time 0.378272 [TensorRT] VERBOSE: Tactic: 5767167 time 0.244576 [TensorRT] VERBOSE: Tactic: 5832703 time 0.21808 [TensorRT] VERBOSE: Tactic: 5898239 time 0.1616 [TensorRT] VERBOSE: Tactic: 6029311 time 0.370496 [TensorRT] VERBOSE: Tactic: 6225919 time 0.215904 [TensorRT] VERBOSE: Tactic: 6291455 time 0.223392 [TensorRT] VERBOSE: Tactic: 6422527 time 0.197248 [TensorRT] VERBOSE: Tactic: 6750207 time 0.244032 [TensorRT] VERBOSE: Tactic: 6815743 time 0.202688 [TensorRT] VERBOSE: Tactic: 6946815 time 0.212608 [TensorRT] VERBOSE: Tactic: 7012351 time 0.18096 [TensorRT] VERBOSE: Tactic: 7077887 time 0.237536 [TensorRT] VERBOSE: Tactic: 7143423 time 0.244736 [TensorRT] VERBOSE: Tactic: 7208959 time 0.217024 [TensorRT] VERBOSE: Tactic: 7340031 time 0.163136 [TensorRT] VERBOSE: Tactic: 7405567 time 0.212768 [TensorRT] VERBOSE: Tactic: 7536639 time 0.332288 [TensorRT] VERBOSE: Tactic: 7602175 time 0.203296 [TensorRT] VERBOSE: Tactic: 7733247 time 0.1504 [TensorRT] VERBOSE: Tactic: 7798783 time 0.286656 [TensorRT] VERBOSE: Tactic: 8191999 time 0.411936 [TensorRT] VERBOSE: Tactic: 8257535 time 0.173824 [TensorRT] VERBOSE: Tactic: 8323071 time 0.253952 [TensorRT] VERBOSE: Tactic: 8650751 time 0.1992 [TensorRT] VERBOSE: Tactic: 8716287 time 0.226656 [TensorRT] VERBOSE: Tactic: 9109503 time 0.185344 [TensorRT] VERBOSE: Tactic: 9568255 time 0.167456 [TensorRT] VERBOSE: Tactic: 9895935 time 0.160384 [TensorRT] VERBOSE: Tactic: 10223615 time 0.38832 [TensorRT] VERBOSE: Tactic: 10354687 time 0.204608 [TensorRT] VERBOSE: Tactic: 10551295 time 0.218144 [TensorRT] VERBOSE: Tactic: 10747903 time 0.146752 [TensorRT] VERBOSE: Tactic: 10944511 time 0.231904 [TensorRT] VERBOSE: Fastest Tactic: 10747903 Time: 0.146752 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.213984 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.218304 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.27216 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.217664 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.22768 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.216832 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.233856 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.248224 [TensorRT] VERBOSE: Conv_187 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.288576 [TensorRT] VERBOSE: Fastest Tactic: 1754569683116234317 Time: 0.213984 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.187712 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 200704, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 144556032, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 4596224, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.187712 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10747903 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.064128 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.092736 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.080544 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.066048 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.094976 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.084448 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.067488 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.063488 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.091424 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.063584 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.077184 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.063104 [TensorRT] VERBOSE: Fastest Tactic: -1765942417666394360 Time: 0.063104 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1765942417666394360 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.167072 [TensorRT] VERBOSE: Tactic: 655359 time 0.107584 [TensorRT] VERBOSE: Tactic: 786431 time 0.0776 [TensorRT] VERBOSE: Tactic: 851967 time 0.068768 [TensorRT] VERBOSE: Tactic: 1179647 time 0.07088 [TensorRT] VERBOSE: Tactic: 1310719 time 0.103744 [TensorRT] VERBOSE: Tactic: 1376255 time 0.130816 [TensorRT] VERBOSE: Tactic: 1441791 time 0.092928 [TensorRT] VERBOSE: Tactic: 1507327 time 0.065536 [TensorRT] VERBOSE: Tactic: 1638399 time 0.08592 [TensorRT] VERBOSE: Tactic: 1835007 time 0.074432 [TensorRT] VERBOSE: Tactic: 1900543 time 0.11104 [TensorRT] VERBOSE: Tactic: 2097151 time 0.052576 [TensorRT] VERBOSE: Tactic: 2162687 time 0.225216 [TensorRT] VERBOSE: Tactic: 2293759 time 0.1248 [TensorRT] VERBOSE: Tactic: 2359295 time 0.14496 [TensorRT] VERBOSE: Tactic: 2686975 time 0.190592 [TensorRT] VERBOSE: Tactic: 3080191 time 0.058368 [TensorRT] VERBOSE: Tactic: 3342335 time 0.117088 [TensorRT] VERBOSE: Tactic: 3407871 time 0.075808 [TensorRT] VERBOSE: Tactic: 3538943 time 0.071168 [TensorRT] VERBOSE: Tactic: 3670015 time 0.195424 [TensorRT] VERBOSE: Tactic: 3932159 time 0.09456 [TensorRT] VERBOSE: Tactic: 3997695 time 0.080736 [TensorRT] VERBOSE: Tactic: 4063231 time 0.067008 [TensorRT] VERBOSE: Tactic: 4194303 time 0.056416 [TensorRT] VERBOSE: Tactic: 4259839 time 0.063968 [TensorRT] VERBOSE: Tactic: 4325375 time 0.147584 [TensorRT] VERBOSE: Tactic: 4521983 time 0.149728 [TensorRT] VERBOSE: Tactic: 4587519 time 0.067264 [TensorRT] VERBOSE: Tactic: 4653055 time 0.080448 [TensorRT] VERBOSE: Tactic: 4915199 time 0.044224 [TensorRT] VERBOSE: Tactic: 4980735 time 0.149376 [TensorRT] VERBOSE: Tactic: 5177343 time 0.070784 [TensorRT] VERBOSE: Tactic: 5242879 time 0.067584 [TensorRT] VERBOSE: Tactic: 5373951 time 0.072064 [TensorRT] VERBOSE: Tactic: 5439487 time 0.056992 [TensorRT] VERBOSE: Tactic: 5570559 time 0.062336 [TensorRT] VERBOSE: Tactic: 5636095 time 0.064 [TensorRT] VERBOSE: Tactic: 5701631 time 0.12192 [TensorRT] VERBOSE: Tactic: 5767167 time 0.077344 [TensorRT] VERBOSE: Tactic: 5832703 time 0.071936 [TensorRT] VERBOSE: Tactic: 5898239 time 0.058656 [TensorRT] VERBOSE: Tactic: 6029311 time 0.11088 [TensorRT] VERBOSE: Tactic: 6225919 time 0.059904 [TensorRT] VERBOSE: Tactic: 6291455 time 0.073536 [TensorRT] VERBOSE: Tactic: 6422527 time 0.057312 [TensorRT] VERBOSE: Tactic: 6750207 time 0.078304 [TensorRT] VERBOSE: Tactic: 6815743 time 0.075168 [TensorRT] VERBOSE: Tactic: 6946815 time 0.065632 [TensorRT] VERBOSE: Tactic: 7012351 time 0.055936 [TensorRT] VERBOSE: Tactic: 7077887 time 0.067936 [TensorRT] VERBOSE: Tactic: 7143423 time 0.081152 [TensorRT] VERBOSE: Tactic: 7208959 time 0.072544 [TensorRT] VERBOSE: Tactic: 7340031 time 0.060448 [TensorRT] VERBOSE: Tactic: 7405567 time 0.058176 [TensorRT] VERBOSE: Tactic: 7536639 time 0.100352 [TensorRT] VERBOSE: Tactic: 7602175 time 0.066528 [TensorRT] VERBOSE: Tactic: 7733247 time 0.055296 [TensorRT] VERBOSE: Tactic: 7798783 time 0.076544 [TensorRT] VERBOSE: Tactic: 8191999 time 0.096448 [TensorRT] VERBOSE: Tactic: 8257535 time 0.059392 [TensorRT] VERBOSE: Tactic: 8323071 time 0.062464 [TensorRT] VERBOSE: Tactic: 8650751 time 0.067648 [TensorRT] VERBOSE: Tactic: 8716287 time 0.0624 [TensorRT] VERBOSE: Tactic: 9109503 time 0.064512 [TensorRT] VERBOSE: Tactic: 9568255 time 0.044704 [TensorRT] VERBOSE: Tactic: 9895935 time 0.056128 [TensorRT] VERBOSE: Tactic: 10223615 time 0.191968 [TensorRT] VERBOSE: Tactic: 10354687 time 0.109728 [TensorRT] VERBOSE: Tactic: 10551295 time 0.06592 [TensorRT] VERBOSE: Tactic: 10747903 time 0.055776 [TensorRT] VERBOSE: Tactic: 10944511 time 0.159744 [TensorRT] VERBOSE: Fastest Tactic: 4915199 Time: 0.044224 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.061504 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.059712 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.065856 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.063232 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.089568 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.060032 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.079264 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.07248 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.060864 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.076 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.091904 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.086272 [TensorRT] VERBOSE: Fastest Tactic: 4000990898022781625 Time: 0.059712 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4915199 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.060672 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.090016 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.080736 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.060704 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.072544 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.06304 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.084512 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.086496 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.059328 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.071072 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.064512 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.06016 [TensorRT] VERBOSE: Fastest Tactic: -4573925292554651334 Time: 0.059328 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4573925292554651334 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_187 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.148416 [TensorRT] VERBOSE: Tactic: 655359 time 0.101984 [TensorRT] VERBOSE: Tactic: 786431 time 0.08896 [TensorRT] VERBOSE: Tactic: 851967 time 0.064672 [TensorRT] VERBOSE: Tactic: 1179647 time 0.072032 [TensorRT] VERBOSE: Tactic: 1310719 time 0.090176 [TensorRT] VERBOSE: Tactic: 1376255 time 0.161984 [TensorRT] VERBOSE: Tactic: 1441791 time 0.090336 [TensorRT] VERBOSE: Tactic: 1507327 time 0.06064 [TensorRT] VERBOSE: Tactic: 1638399 time 0.086112 [TensorRT] VERBOSE: Tactic: 1835007 time 0.074624 [TensorRT] VERBOSE: Tactic: 1900543 time 0.106496 [TensorRT] VERBOSE: Tactic: 2097151 time 0.064736 [TensorRT] VERBOSE: Tactic: 2162687 time 0.188832 [TensorRT] VERBOSE: Tactic: 2293759 time 0.140512 [TensorRT] VERBOSE: Tactic: 2359295 time 0.12032 [TensorRT] VERBOSE: Tactic: 2686975 time 0.156704 [TensorRT] VERBOSE: Tactic: 3080191 time 0.0544 [TensorRT] VERBOSE: Tactic: 3342335 time 0.11264 [TensorRT] VERBOSE: Tactic: 3407871 time 0.085088 [TensorRT] VERBOSE: Tactic: 3538943 time 0.078912 [TensorRT] VERBOSE: Tactic: 3670015 time 0.193824 [TensorRT] VERBOSE: Tactic: 3932159 time 0.089088 [TensorRT] VERBOSE: Tactic: 3997695 time 0.085376 [TensorRT] VERBOSE: Tactic: 4063231 time 0.062464 [TensorRT] VERBOSE: Tactic: 4194303 time 0.05904 [TensorRT] VERBOSE: Tactic: 4259839 time 0.06784 [TensorRT] VERBOSE: Tactic: 4325375 time 0.15472 [TensorRT] VERBOSE: Tactic: 4521983 time 0.15584 [TensorRT] VERBOSE: Tactic: 4587519 time 0.070144 [TensorRT] VERBOSE: Tactic: 4653055 time 0.082944 [TensorRT] VERBOSE: Tactic: 4915199 time 0.062336 [TensorRT] VERBOSE: Tactic: 4980735 time 0.169536 [TensorRT] VERBOSE: Tactic: 5177343 time 0.072992 [TensorRT] VERBOSE: Tactic: 5242879 time 0.080128 [TensorRT] VERBOSE: Tactic: 5373951 time 0.073088 [TensorRT] VERBOSE: Tactic: 5439487 time 0.068992 [TensorRT] VERBOSE: Tactic: 5570559 time 0.05712 [TensorRT] VERBOSE: Tactic: 5636095 time 0.061984 [TensorRT] VERBOSE: Tactic: 5701631 time 0.116256 [TensorRT] VERBOSE: Tactic: 5767167 time 0.088896 [TensorRT] VERBOSE: Tactic: 5832703 time 0.087264 [TensorRT] VERBOSE: Tactic: 5898239 time 0.069856 [TensorRT] VERBOSE: Tactic: 6029311 time 0.108384 [TensorRT] VERBOSE: Tactic: 6225919 time 0.068128 [TensorRT] VERBOSE: Tactic: 6291455 time 0.073344 [TensorRT] VERBOSE: Tactic: 6422527 time 0.052768 [TensorRT] VERBOSE: Tactic: 6750207 time 0.086016 [TensorRT] VERBOSE: Tactic: 6815743 time 0.079904 [TensorRT] VERBOSE: Tactic: 6946815 time 0.072576 [TensorRT] VERBOSE: Tactic: 7012351 time 0.062528 [TensorRT] VERBOSE: Tactic: 7077887 time 0.074976 [TensorRT] VERBOSE: Tactic: 7143423 time 0.095296 [TensorRT] VERBOSE: Tactic: 7208959 time 0.088448 [TensorRT] VERBOSE: Tactic: 7340031 time 0.069504 [TensorRT] VERBOSE: Tactic: 7405567 time 0.061024 [TensorRT] VERBOSE: Tactic: 7536639 time 0.095584 [TensorRT] VERBOSE: Tactic: 7602175 time 0.073728 [TensorRT] VERBOSE: Tactic: 7733247 time 0.063264 [TensorRT] VERBOSE: Tactic: 7798783 time 0.089568 [TensorRT] VERBOSE: Tactic: 8191999 time 0.110592 [TensorRT] VERBOSE: Tactic: 8257535 time 0.054016 [TensorRT] VERBOSE: Tactic: 8323071 time 0.072704 [TensorRT] VERBOSE: Tactic: 8650751 time 0.074368 [TensorRT] VERBOSE: Tactic: 8716287 time 0.06656 [TensorRT] VERBOSE: Tactic: 9109503 time 0.058048 [TensorRT] VERBOSE: Tactic: 9568255 time 0.062016 [TensorRT] VERBOSE: Tactic: 9895935 time 0.057312 [TensorRT] VERBOSE: Tactic: 10223615 time 0.156448 [TensorRT] VERBOSE: Tactic: 10354687 time 0.112672 [TensorRT] VERBOSE: Tactic: 10551295 time 0.068032 [TensorRT] VERBOSE: Tactic: 10747903 time 0.061984 [TensorRT] VERBOSE: Tactic: 10944511 time 0.170912 [TensorRT] VERBOSE: Fastest Tactic: 6422527 Time: 0.052768 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CaskConvolution) [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.03056 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.03728 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.030016 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.038624 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.037888 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.036864 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.03936 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.036832 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.035616 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.037088 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.037888 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.028864 [TensorRT] VERBOSE: Fastest Tactic: -182858804213663094 Time: 0.028864 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_187 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010912 [TensorRT] VERBOSE: Tactic: 256 time 0.011744 [TensorRT] VERBOSE: Tactic: 512 time 0.010976 [TensorRT] VERBOSE: Tactic: -32 time 0.027552 [TensorRT] VERBOSE: Tactic: -64 time 0.017088 [TensorRT] VERBOSE: Tactic: -128 time 0.014528 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.010912 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.0064 [TensorRT] VERBOSE: Tactic: 1 time 0.006368 [TensorRT] VERBOSE: Tactic: 2 time 0.006272 [TensorRT] VERBOSE: Tactic: 3 time 0.006528 [TensorRT] VERBOSE: Tactic: 4 time 0.006464 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.006368 [TensorRT] VERBOSE: Tactic: 7 time 0.006272 [TensorRT] VERBOSE: Tactic: 8 time 0.006528 [TensorRT] VERBOSE: Tactic: 9 time 0.007168 [TensorRT] VERBOSE: Tactic: 28 time 0.00672 [TensorRT] VERBOSE: Fastest Tactic: 5 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01168 [TensorRT] VERBOSE: Tactic: 256 time 0.010592 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.028512 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.014304 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.010592 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_188 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009568 [TensorRT] VERBOSE: Tactic: 25 time 0.009088 [TensorRT] VERBOSE: Tactic: 26 time 0.008192 [TensorRT] VERBOSE: Tactic: 27 time 0.008512 [TensorRT] VERBOSE: Tactic: 31 time 0.00864 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.008192 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] WARNING: No implementation of layer LeakyRelu_188 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016288 [TensorRT] VERBOSE: Tactic: 0 time 0.02384 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016288 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050752 [TensorRT] VERBOSE: Tactic: 0 time 0.009888 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.009888 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006016 [TensorRT] VERBOSE: Tactic: 0 time 0.004256 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004256 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010784 [TensorRT] VERBOSE: Tactic: 0 time 0.013888 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010784 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0128 [TensorRT] VERBOSE: Tactic: 0 time 0.007008 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007008 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012416 [TensorRT] VERBOSE: Tactic: 0 time 0.01136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01136 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028192 [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011008 [TensorRT] VERBOSE: Tactic: 0 time 0.004448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004448 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01248 [TensorRT] VERBOSE: Tactic: 0 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007552 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012416 [TensorRT] VERBOSE: Tactic: 0 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012288 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012384 [TensorRT] VERBOSE: Tactic: 0 time 0.00448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012288 [TensorRT] VERBOSE: Tactic: 0 time 0.011264 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02688 [TensorRT] VERBOSE: Tactic: 0 time 0.007456 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007456 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012544 [TensorRT] VERBOSE: Tactic: 0 time 0.007648 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007648 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012384 [TensorRT] VERBOSE: Tactic: 0 time 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012384 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01104 [TensorRT] VERBOSE: Tactic: 0 time 0.004448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011936 [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006016 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010816 [TensorRT] VERBOSE: Tactic: 0 time 0.007488 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007488 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012448 [TensorRT] VERBOSE: Tactic: 0 time 0.007424 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007424 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.299808 [TensorRT] VERBOSE: Tactic: 655359 time 0.197952 [TensorRT] VERBOSE: Tactic: 786431 time 0.080896 [TensorRT] VERBOSE: Tactic: 851967 time 0.06384 [TensorRT] VERBOSE: Tactic: 1179647 time 0.068608 [TensorRT] VERBOSE: Tactic: 1310719 time 0.165888 [TensorRT] VERBOSE: Tactic: 1376255 time 0.201568 [TensorRT] VERBOSE: Tactic: 1441791 time 0.105376 [TensorRT] VERBOSE: Tactic: 1507327 time 0.111456 [TensorRT] VERBOSE: Tactic: 1638399 time 0.093408 [TensorRT] VERBOSE: Tactic: 1835007 time 0.069504 [TensorRT] VERBOSE: Tactic: 1900543 time 0.21056 [TensorRT] VERBOSE: Tactic: 2097151 time 0.054464 [TensorRT] VERBOSE: Tactic: 2162687 time 0.197696 [TensorRT] VERBOSE: Tactic: 2293759 time 0.1888 [TensorRT] VERBOSE: Tactic: 2359295 time 0.113824 [TensorRT] VERBOSE: Tactic: 2686975 time 0.18928 [TensorRT] VERBOSE: Tactic: 3080191 time 0.103936 [TensorRT] VERBOSE: Tactic: 3342335 time 0.11248 [TensorRT] VERBOSE: Tactic: 3407871 time 0.106912 [TensorRT] VERBOSE: Tactic: 3538943 time 0.061344 [TensorRT] VERBOSE: Tactic: 3670015 time 0.378688 [TensorRT] VERBOSE: Tactic: 3932159 time 0.174624 [TensorRT] VERBOSE: Tactic: 3997695 time 0.0752 [TensorRT] VERBOSE: Tactic: 4063231 time 0.066336 [TensorRT] VERBOSE: Tactic: 4194303 time 0.073728 [TensorRT] VERBOSE: Tactic: 4259839 time 0.056736 [TensorRT] VERBOSE: Tactic: 4325375 time 0.066176 [TensorRT] VERBOSE: Tactic: 4521983 time 0.177984 [TensorRT] VERBOSE: Tactic: 4587519 time 0.059264 [TensorRT] VERBOSE: Tactic: 4653055 time 0.057184 [TensorRT] VERBOSE: Tactic: 4915199 time 0.04688 [TensorRT] VERBOSE: Tactic: 4980735 time 0.10128 [TensorRT] VERBOSE: Tactic: 5177343 time 0.07008 [TensorRT] VERBOSE: Tactic: 5242879 time 0.10064 [TensorRT] VERBOSE: Tactic: 5373951 time 0.069696 [TensorRT] VERBOSE: Tactic: 5439487 time 0.071072 [TensorRT] VERBOSE: Tactic: 5570559 time 0.110144 [TensorRT] VERBOSE: Tactic: 5636095 time 0.06496 [TensorRT] VERBOSE: Tactic: 5701631 time 0.182944 [TensorRT] VERBOSE: Tactic: 5767167 time 0.102688 [TensorRT] VERBOSE: Tactic: 5832703 time 0.107968 [TensorRT] VERBOSE: Tactic: 5898239 time 0.047264 [TensorRT] VERBOSE: Tactic: 6029311 time 0.17872 [TensorRT] VERBOSE: Tactic: 6225919 time 0.060096 [TensorRT] VERBOSE: Tactic: 6291455 time 0.067808 [TensorRT] VERBOSE: Tactic: 6422527 time 0.100704 [TensorRT] VERBOSE: Tactic: 6750207 time 0.071232 [TensorRT] VERBOSE: Tactic: 6815743 time 0.10176 [TensorRT] VERBOSE: Tactic: 6946815 time 0.066912 [TensorRT] VERBOSE: Tactic: 7012351 time 0.056032 [TensorRT] VERBOSE: Tactic: 7077887 time 0.063264 [TensorRT] VERBOSE: Tactic: 7143423 time 0.100992 [TensorRT] VERBOSE: Tactic: 7208959 time 0.1072 [TensorRT] VERBOSE: Tactic: 7340031 time 0.048544 [TensorRT] VERBOSE: Tactic: 7405567 time 0.059264 [TensorRT] VERBOSE: Tactic: 7536639 time 0.164704 [TensorRT] VERBOSE: Tactic: 7602175 time 0.068448 [TensorRT] VERBOSE: Tactic: 7733247 time 0.06704 [TensorRT] VERBOSE: Tactic: 7798783 time 0.080416 [TensorRT] VERBOSE: Tactic: 8191999 time 0.07056 [TensorRT] VERBOSE: Tactic: 8257535 time 0.048032 [TensorRT] VERBOSE: Tactic: 8323071 time 0.071968 [TensorRT] VERBOSE: Tactic: 8650751 time 0.065536 [TensorRT] VERBOSE: Tactic: 8716287 time 0.063456 [TensorRT] VERBOSE: Tactic: 9109503 time 0.057344 [TensorRT] VERBOSE: Tactic: 9568255 time 0.048704 [TensorRT] VERBOSE: Tactic: 9895935 time 0.07216 [TensorRT] VERBOSE: Tactic: 10223615 time 0.189696 [TensorRT] VERBOSE: Tactic: 10354687 time 0.067072 [TensorRT] VERBOSE: Tactic: 10551295 time 0.105568 [TensorRT] VERBOSE: Tactic: 10747903 time 0.065632 [TensorRT] VERBOSE: Tactic: 10944511 time 0.09968 [TensorRT] VERBOSE: Fastest Tactic: 4915199 Time: 0.04688 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 1754569683116234317 time 0.110592 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.112544 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 2733356012094739613 time 0.129024 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.112544 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.081312 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 9091006216302412844 time 0.07792 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.085952 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.112672 [TensorRT] VERBOSE: Conv_202 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 0.136544 [TensorRT] VERBOSE: Fastest Tactic: 9091006216302412844 Time: 0.07792 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.067584 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 100352, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 36626432, available: 0 [TensorRT] VERBOSE: Tactic: 57 time 0.079136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.067584 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4915199 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.035424 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.03552 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.036896 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.025536 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.035616 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.038432 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.023552 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7924103240988931433 time 0.023616 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -7489650117016530013 time 0.036064 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.034752 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -3908975881807046106 time 0.034816 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1765942417666394360 time 0.035168 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.023552 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.039136 [TensorRT] VERBOSE: Tactic: 655359 time 0.031424 [TensorRT] VERBOSE: Tactic: 786431 time 0.023424 [TensorRT] VERBOSE: Tactic: 851967 time 0.01872 [TensorRT] VERBOSE: Tactic: 1179647 time 0.020448 [TensorRT] VERBOSE: Tactic: 1310719 time 0.03024 [TensorRT] VERBOSE: Tactic: 1376255 time 0.045056 [TensorRT] VERBOSE: Tactic: 1441791 time 0.025888 [TensorRT] VERBOSE: Tactic: 1507327 time 0.022368 [TensorRT] VERBOSE: Tactic: 1638399 time 0.023168 [TensorRT] VERBOSE: Tactic: 1835007 time 0.02352 [TensorRT] VERBOSE: Tactic: 1900543 time 0.03824 [TensorRT] VERBOSE: Tactic: 2097151 time 0.01696 [TensorRT] VERBOSE: Tactic: 2162687 time 0.066432 [TensorRT] VERBOSE: Tactic: 2293759 time 0.037888 [TensorRT] VERBOSE: Tactic: 2359295 time 0.050464 [TensorRT] VERBOSE: Tactic: 2686975 time 0.048832 [TensorRT] VERBOSE: Tactic: 3080191 time 0.018784 [TensorRT] VERBOSE: Tactic: 3342335 time 0.02176 [TensorRT] VERBOSE: Tactic: 3407871 time 0.025376 [TensorRT] VERBOSE: Tactic: 3538943 time 0.021792 [TensorRT] VERBOSE: Tactic: 3670015 time 0.05312 [TensorRT] VERBOSE: Tactic: 3932159 time 0.025248 [TensorRT] VERBOSE: Tactic: 3997695 time 0.023552 [TensorRT] VERBOSE: Tactic: 4063231 time 0.019232 [TensorRT] VERBOSE: Tactic: 4194303 time 0.019296 [TensorRT] VERBOSE: Tactic: 4259839 time 0.017568 [TensorRT] VERBOSE: Tactic: 4325375 time 0.039488 [TensorRT] VERBOSE: Tactic: 4521983 time 0.051296 [TensorRT] VERBOSE: Tactic: 4587519 time 0.01872 [TensorRT] VERBOSE: Tactic: 4653055 time 0.023584 [TensorRT] VERBOSE: Tactic: 4915199 time 0.015488 [TensorRT] VERBOSE: Tactic: 4980735 time 0.047008 [TensorRT] VERBOSE: Tactic: 5177343 time 0.022144 [TensorRT] VERBOSE: Tactic: 5242879 time 0.022112 [TensorRT] VERBOSE: Tactic: 5373951 time 0.020608 [TensorRT] VERBOSE: Tactic: 5439487 time 0.018624 [TensorRT] VERBOSE: Tactic: 5570559 time 0.018624 [TensorRT] VERBOSE: Tactic: 5636095 time 0.018656 [TensorRT] VERBOSE: Tactic: 5701631 time 0.036096 [TensorRT] VERBOSE: Tactic: 5767167 time 0.025344 [TensorRT] VERBOSE: Tactic: 5832703 time 0.024896 [TensorRT] VERBOSE: Tactic: 5898239 time 0.017984 [TensorRT] VERBOSE: Tactic: 6029311 time 0.033248 [TensorRT] VERBOSE: Tactic: 6225919 time 0.018688 [TensorRT] VERBOSE: Tactic: 6291455 time 0.020576 [TensorRT] VERBOSE: Tactic: 6422527 time 0.017472 [TensorRT] VERBOSE: Tactic: 6750207 time 0.019968 [TensorRT] VERBOSE: Tactic: 6815743 time 0.027232 [TensorRT] VERBOSE: Tactic: 6946815 time 0.022048 [TensorRT] VERBOSE: Tactic: 7012351 time 0.016224 [TensorRT] VERBOSE: Tactic: 7077887 time 0.020416 [TensorRT] VERBOSE: Tactic: 7143423 time 0.025056 [TensorRT] VERBOSE: Tactic: 7208959 time 0.02432 [TensorRT] VERBOSE: Tactic: 7340031 time 0.01904 [TensorRT] VERBOSE: Tactic: 7405567 time 0.017024 [TensorRT] VERBOSE: Tactic: 7536639 time 0.029696 [TensorRT] VERBOSE: Tactic: 7602175 time 0.02224 [TensorRT] VERBOSE: Tactic: 7733247 time 0.020384 [TensorRT] VERBOSE: Tactic: 7798783 time 0.023456 [TensorRT] VERBOSE: Tactic: 8191999 time 0.027136 [TensorRT] VERBOSE: Tactic: 8257535 time 0.016096 [TensorRT] VERBOSE: Tactic: 8323071 time 0.02016 [TensorRT] VERBOSE: Tactic: 8650751 time 0.02208 [TensorRT] VERBOSE: Tactic: 8716287 time 0.020192 [TensorRT] VERBOSE: Tactic: 9109503 time 0.017216 [TensorRT] VERBOSE: Tactic: 9568255 time 0.015552 [TensorRT] VERBOSE: Tactic: 9895935 time 0.018688 [TensorRT] VERBOSE: Tactic: 10223615 time 0.048256 [TensorRT] VERBOSE: Tactic: 10354687 time 0.03264 [TensorRT] VERBOSE: Tactic: 10551295 time 0.022016 [TensorRT] VERBOSE: Tactic: 10747903 time 0.020352 [TensorRT] VERBOSE: Tactic: 10944511 time 0.050656 [TensorRT] VERBOSE: Fastest Tactic: 4915199 Time: 0.015488 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 3145259992339075399 time 0.021504 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 4000990898022781625 time 0.031744 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.022464 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.021888 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.03424 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.032768 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.035552 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 [TensorRT] VERBOSE: Tactic: 8097855305881829878 time 0.033344 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.032384 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.034432 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.032832 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 [TensorRT] VERBOSE: Tactic: -1543391652455542154 time 0.0336 [TensorRT] VERBOSE: Fastest Tactic: 3145259992339075399 Time: 0.021504 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4915199 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1025026069226666066 time 0.0328 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.033088 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.034848 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 2339361327868109050 time 0.0216 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.0336 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.021536 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7686150779628967382 time 0.03328 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.032896 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.032 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4208188808979933945 time 0.032192 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.021888 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.032544 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.021536 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_202 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 time 0.03312 [TensorRT] VERBOSE: Tactic: 655359 time 0.035136 [TensorRT] VERBOSE: Tactic: 786431 time 0.029184 [TensorRT] VERBOSE: Tactic: 851967 time 0.018784 [TensorRT] VERBOSE: Tactic: 1179647 time 0.022432 [TensorRT] VERBOSE: Tactic: 1310719 time 0.02944 [TensorRT] VERBOSE: Tactic: 1376255 time 0.053504 [TensorRT] VERBOSE: Tactic: 1441791 time 0.026592 [TensorRT] VERBOSE: Tactic: 1507327 time 0.023424 [TensorRT] VERBOSE: Tactic: 1638399 time 0.023904 [TensorRT] VERBOSE: Tactic: 1835007 time 0.023392 [TensorRT] VERBOSE: Tactic: 1900543 time 0.038912 [TensorRT] VERBOSE: Tactic: 2097151 time 0.018624 [TensorRT] VERBOSE: Tactic: 2162687 time 0.064448 [TensorRT] VERBOSE: Tactic: 2293759 time 0.040768 [TensorRT] VERBOSE: Tactic: 2359295 time 0.044224 [TensorRT] VERBOSE: Tactic: 2686975 time 0.046944 [TensorRT] VERBOSE: Tactic: 3080191 time 0.018912 [TensorRT] VERBOSE: Tactic: 3342335 time 0.023392 [TensorRT] VERBOSE: Tactic: 3407871 time 0.026976 [TensorRT] VERBOSE: Tactic: 3538943 time 0.023552 [TensorRT] VERBOSE: Tactic: 3670015 time 0.051072 [TensorRT] VERBOSE: Tactic: 3932159 time 0.021952 [TensorRT] VERBOSE: Tactic: 3997695 time 0.024928 [TensorRT] VERBOSE: Tactic: 4063231 time 0.01872 [TensorRT] VERBOSE: Tactic: 4194303 time 0.021856 [TensorRT] VERBOSE: Tactic: 4259839 time 0.019072 [TensorRT] VERBOSE: Tactic: 4325375 time 0.04384 [TensorRT] VERBOSE: Tactic: 4521983 time 0.053952 [TensorRT] VERBOSE: Tactic: 4587519 time 0.020864 [TensorRT] VERBOSE: Tactic: 4653055 time 0.025376 [TensorRT] VERBOSE: Tactic: 4915199 time 0.017248 [TensorRT] VERBOSE: Tactic: 4980735 time 0.054112 [TensorRT] VERBOSE: Tactic: 5177343 time 0.021728 [TensorRT] VERBOSE: Tactic: 5242879 time 0.028224 [TensorRT] VERBOSE: Tactic: 5373951 time 0.022176 [TensorRT] VERBOSE: Tactic: 5439487 time 0.02368 [TensorRT] VERBOSE: Tactic: 5570559 time 0.01888 [TensorRT] VERBOSE: Tactic: 5636095 time 0.018848 [TensorRT] VERBOSE: Tactic: 5701631 time 0.036672 [TensorRT] VERBOSE: Tactic: 5767167 time 0.028576 [TensorRT] VERBOSE: Tactic: 5832703 time 0.031328 [TensorRT] VERBOSE: Tactic: 5898239 time 0.018816 [TensorRT] VERBOSE: Tactic: 6029311 time 0.031424 [TensorRT] VERBOSE: Tactic: 6225919 time 0.02048 [TensorRT] VERBOSE: Tactic: 6291455 time 0.022048 [TensorRT] VERBOSE: Tactic: 6422527 time 0.015776 [TensorRT] VERBOSE: Tactic: 6750207 time 0.023488 [TensorRT] VERBOSE: Tactic: 6815743 time 0.028416 [TensorRT] VERBOSE: Tactic: 6946815 time 0.024608 [TensorRT] VERBOSE: Tactic: 7012351 time 0.018368 [TensorRT] VERBOSE: Tactic: 7077887 time 0.022016 [TensorRT] VERBOSE: Tactic: 7143423 time 0.030016 [TensorRT] VERBOSE: Tactic: 7208959 time 0.031488 [TensorRT] VERBOSE: Tactic: 7340031 time 0.018912 [TensorRT] VERBOSE: Tactic: 7405567 time 0.016288 [TensorRT] VERBOSE: Tactic: 7536639 time 0.031424 [TensorRT] VERBOSE: Tactic: 7602175 time 0.025024 [TensorRT] VERBOSE: Tactic: 7733247 time 0.021824 [TensorRT] VERBOSE: Tactic: 7798783 time 0.028512 [TensorRT] VERBOSE: Tactic: 8191999 time 0.029888 [TensorRT] VERBOSE: Tactic: 8257535 time 0.01696 [TensorRT] VERBOSE: Tactic: 8323071 time 0.023552 [TensorRT] VERBOSE: Tactic: 8650751 time 0.02544 [TensorRT] VERBOSE: Tactic: 8716287 time 0.020512 [TensorRT] VERBOSE: Tactic: 9109503 time 0.017824 [TensorRT] VERBOSE: Tactic: 9568255 time 0.017184 [TensorRT] VERBOSE: Tactic: 9895935 time 0.02128 [TensorRT] VERBOSE: Tactic: 10223615 time 0.047648 [TensorRT] VERBOSE: Tactic: 10354687 time 0.032832 [TensorRT] VERBOSE: Tactic: 10551295 time 0.023712 [TensorRT] VERBOSE: Tactic: 10747903 time 0.02048 [TensorRT] VERBOSE: Tactic: 10944511 time 0.052544 [TensorRT] VERBOSE: Fastest Tactic: 6422527 Time: 0.015776 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CaskConvolution) [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.016128 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.022432 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 5754467717466343388 time 0.01584 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.016 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: 7584772692956718645 time 0.02208 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.015552 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.015744 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.015424 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -1383447415429797909 time 0.014976 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Tactic: -743032628982127825 time 0.016128 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.022656 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.01552 [TensorRT] VERBOSE: Fastest Tactic: -1383447415429797909 Time: 0.014976 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_202 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1383447415429797909 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010912 [TensorRT] VERBOSE: Tactic: 0 time 0.01424 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010912 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01248 [TensorRT] VERBOSE: Tactic: 0 time 0.015616 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01248 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012512 [TensorRT] VERBOSE: Tactic: 0 time 0.01408 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012512 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007744 [TensorRT] VERBOSE: Tactic: 256 time 0.007712 [TensorRT] VERBOSE: Tactic: 512 time 0.007776 [TensorRT] VERBOSE: Tactic: -32 time 0.023136 [TensorRT] VERBOSE: Tactic: -64 time 0.01392 [TensorRT] VERBOSE: Tactic: -128 time 0.011072 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.007712 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006048 [TensorRT] VERBOSE: Tactic: 1 time 0.004576 [TensorRT] VERBOSE: Tactic: 2 time 0.004384 [TensorRT] VERBOSE: Tactic: 3 time 0.006016 [TensorRT] VERBOSE: Tactic: 4 time 0.005984 [TensorRT] VERBOSE: Tactic: 5 time 0.004384 [TensorRT] VERBOSE: Tactic: 6 time 0.005728 [TensorRT] VERBOSE: Tactic: 7 time 0.00528 [TensorRT] VERBOSE: Tactic: 8 time 0.00464 [TensorRT] VERBOSE: Tactic: 9 time 0.005984 [TensorRT] VERBOSE: Tactic: 28 time 0.006016 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.004384 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007584 [TensorRT] VERBOSE: Tactic: 256 time 0.007936 [TensorRT] VERBOSE: Tactic: 512 time 0.00768 [TensorRT] VERBOSE: Tactic: -32 time 0.023392 [TensorRT] VERBOSE: Tactic: -64 time 0.014176 [TensorRT] VERBOSE: Tactic: -128 time 0.0112 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.007584 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.006464 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.005984 [TensorRT] VERBOSE: Tactic: 27 time 0.0064 [TensorRT] VERBOSE: Tactic: 31 time 0.006496 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009184 [TensorRT] VERBOSE: Tactic: 256 time 0.009216 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.01104 [TensorRT] VERBOSE: Tactic: -64 time 0.01232 [TensorRT] VERBOSE: Tactic: -128 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009184 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005984 [TensorRT] VERBOSE: Tactic: 1 time 0.005952 [TensorRT] VERBOSE: Tactic: 2 time 0.005984 [TensorRT] VERBOSE: Tactic: 3 time 0.005984 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.006112 [TensorRT] VERBOSE: Tactic: 6 time 0.007712 [TensorRT] VERBOSE: Tactic: 7 time 0.006048 [TensorRT] VERBOSE: Tactic: 8 time 0.006048 [TensorRT] VERBOSE: Tactic: 9 time 0.005984 [TensorRT] VERBOSE: Tactic: 10 time 0.006176 [TensorRT] VERBOSE: Tactic: 11 time 0.006016 [TensorRT] VERBOSE: Tactic: 12 time 0.006016 [TensorRT] VERBOSE: Tactic: 13 time 0.006048 [TensorRT] VERBOSE: Tactic: 14 time 0.005984 [TensorRT] VERBOSE: Tactic: 15 time 0.00608 [TensorRT] VERBOSE: Tactic: 16 time 0.007552 [TensorRT] VERBOSE: Tactic: 17 time 0.005984 [TensorRT] VERBOSE: Tactic: 18 time 0.00608 [TensorRT] VERBOSE: Tactic: 19 time 0.006144 [TensorRT] VERBOSE: Tactic: 20 time 0.00752 [TensorRT] VERBOSE: Tactic: 21 time 0.007616 [TensorRT] VERBOSE: Tactic: 22 time 0.006144 [TensorRT] VERBOSE: Tactic: 23 time 0.006144 [TensorRT] VERBOSE: Tactic: 28 time 0.005984 [TensorRT] VERBOSE: Tactic: 29 time 0.00608 [TensorRT] VERBOSE: Tactic: 30 time 0.007584 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.009184 [TensorRT] VERBOSE: Tactic: 512 time 0.009408 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.009184 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_203 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00608 [TensorRT] VERBOSE: Tactic: 11 time 0.006144 [TensorRT] VERBOSE: Tactic: 12 time 0.006048 [TensorRT] VERBOSE: Tactic: 13 time 0.009184 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.009408 [TensorRT] VERBOSE: Tactic: 16 time 0.013728 [TensorRT] VERBOSE: Tactic: 17 time 0.00912 [TensorRT] VERBOSE: Tactic: 18 time 0.009824 [TensorRT] VERBOSE: Tactic: 19 time 0.012384 [TensorRT] VERBOSE: Tactic: 20 time 0.00464 [TensorRT] VERBOSE: Tactic: 21 time 0.005984 [TensorRT] VERBOSE: Tactic: 22 time 0.006272 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 24 time 0.006144 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.005696 [TensorRT] VERBOSE: Tactic: 27 time 0.00768 [TensorRT] VERBOSE: Tactic: 29 time 0.010784 [TensorRT] VERBOSE: Tactic: 30 time 0.007616 [TensorRT] VERBOSE: Tactic: 31 time 0.006048 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.00464 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.518592 [TensorRT] VERBOSE: Tactic: 720895 time 0.505536 [TensorRT] VERBOSE: Tactic: 983039 time 0.26256 [TensorRT] VERBOSE: Tactic: 1048575 time 0.488 [TensorRT] VERBOSE: Tactic: 1703935 time 0.329696 [TensorRT] VERBOSE: Tactic: 1769471 time 0.319008 [TensorRT] VERBOSE: Tactic: 1966079 time 0.756192 [TensorRT] VERBOSE: Tactic: 2031615 time 0.664 [TensorRT] VERBOSE: Tactic: 2228223 time 0.41472 [TensorRT] VERBOSE: Tactic: 2424831 time 0.372512 [TensorRT] VERBOSE: Tactic: 2621439 time 0.335168 [TensorRT] VERBOSE: Tactic: 2752511 time 0.558688 [TensorRT] VERBOSE: Tactic: 2818047 time 0.453664 [TensorRT] VERBOSE: Tactic: 2883583 time 0.928544 [TensorRT] VERBOSE: Tactic: 3014655 time 0.264832 [TensorRT] VERBOSE: Tactic: 3145727 time 0.299904 [TensorRT] VERBOSE: Tactic: 3473407 time 0.643936 [TensorRT] VERBOSE: Tactic: 3604479 time 0.260896 [TensorRT] VERBOSE: Tactic: 3735551 time 0.549408 [TensorRT] VERBOSE: Tactic: 4390911 time 0.799456 [TensorRT] VERBOSE: Tactic: 5046271 time 0.363136 [TensorRT] VERBOSE: Tactic: 5963775 time 0.708608 [TensorRT] VERBOSE: Tactic: 6160383 time 0.411488 [TensorRT] VERBOSE: Tactic: 6488063 time 0.44832 [TensorRT] VERBOSE: Tactic: 6881279 time 0.619456 [TensorRT] VERBOSE: Tactic: 7274495 time 0.323584 [TensorRT] VERBOSE: Tactic: 7864319 time 0.361728 [TensorRT] VERBOSE: Tactic: 7995391 time 0.532896 [TensorRT] VERBOSE: Tactic: 8585215 time 0.569344 [TensorRT] VERBOSE: Tactic: 8847359 time 0.24576 [TensorRT] VERBOSE: Tactic: 8978431 time 0.705536 [TensorRT] VERBOSE: Tactic: 9043967 time 0.242496 [TensorRT] VERBOSE: Tactic: 9175039 time 0.263168 [TensorRT] VERBOSE: Tactic: 9502719 time 0.801056 [TensorRT] VERBOSE: Tactic: 9830399 time 0.496288 [TensorRT] VERBOSE: Tactic: 9961471 time 0.250464 [TensorRT] VERBOSE: Tactic: 10027007 time 0.318816 [TensorRT] VERBOSE: Tactic: 10092543 time 0.805888 [TensorRT] VERBOSE: Tactic: 10289151 time 0.756864 [TensorRT] VERBOSE: Tactic: 10485759 time 0.286272 [TensorRT] VERBOSE: Tactic: 10682367 time 0.337312 [TensorRT] VERBOSE: Tactic: 10813439 time 0.27952 [TensorRT] VERBOSE: Fastest Tactic: 9043967 Time: 0.242496 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1825138533642645384 time 0.935136 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Tactic: 2775507031594384867 time 0.231808 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 2842488832350522458 time 0.76784 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3915320020053085238 time 0.927648 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 6448355332020552203 time 0.94784 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 6808617066150061604 time 0.669376 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -8060443123034038864 time 0.778112 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: -4420849921117327522 time 0.959808 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -3946921629105938337 time 1.1119 [TensorRT] VERBOSE: Fastest Tactic: 2775507031594384867 Time: 0.231808 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: Tactic: 0 time 0.501536 [TensorRT] VERBOSE: Tactic: 2 skipped. Scratch requested: 903168, available: 0 [TensorRT] VERBOSE: Tactic: 5 skipped. Scratch requested: 1145307136, available: 0 [TensorRT] VERBOSE: Tactic: 6 skipped. Scratch requested: 26216448, available: 0 [TensorRT] VERBOSE: Tactic: 57 skipped. Scratch requested: 19075584, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.501536 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 892787096507693407 time 0.24272 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 1204440019753223942 time 0.279008 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 1659301557717208403 time 0.280832 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 2057291331119027912 time 0.2032 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: 3275977259705528576 time 0.246688 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 5623454780463195174 time 0.318784 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: 8930254200803946944 time 0.200416 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -9204333525109552344 time 0.176128 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -4973811344878172338 time 0.239104 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1228371230285617088 time 0.248544 [TensorRT] VERBOSE: Fastest Tactic: -9204333525109552344 Time: 0.176128 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.138464 [TensorRT] VERBOSE: Tactic: 720895 time 0.186368 [TensorRT] VERBOSE: Tactic: 983039 time 0.0768 [TensorRT] VERBOSE: Tactic: 1048575 time 0.138144 [TensorRT] VERBOSE: Tactic: 1703935 time 0.102144 [TensorRT] VERBOSE: Tactic: 1769471 time 0.094208 [TensorRT] VERBOSE: Tactic: 1966079 time 0.202048 [TensorRT] VERBOSE: Tactic: 2031615 time 0.174944 [TensorRT] VERBOSE: Tactic: 2228223 time 0.193728 [TensorRT] VERBOSE: Tactic: 2424831 time 0.160544 [TensorRT] VERBOSE: Tactic: 2621439 time 0.102304 [TensorRT] VERBOSE: Tactic: 2752511 time 0.166816 [TensorRT] VERBOSE: Tactic: 2818047 time 0.12544 [TensorRT] VERBOSE: Tactic: 2883583 time 0.262912 [TensorRT] VERBOSE: Tactic: 3014655 time 0.083488 [TensorRT] VERBOSE: Tactic: 3145727 time 0.088192 [TensorRT] VERBOSE: Tactic: 3473407 time 0.174336 [TensorRT] VERBOSE: Tactic: 3604479 time 0.072128 [TensorRT] VERBOSE: Tactic: 3735551 time 0.093952 [TensorRT] VERBOSE: Tactic: 4390911 time 0.24016 [TensorRT] VERBOSE: Tactic: 5046271 time 0.106624 [TensorRT] VERBOSE: Tactic: 5963775 time 0.198208 [TensorRT] VERBOSE: Tactic: 6160383 time 0.2576 [TensorRT] VERBOSE: Tactic: 6488063 time 0.124928 [TensorRT] VERBOSE: Tactic: 6881279 time 0.175808 [TensorRT] VERBOSE: Tactic: 7274495 time 0.084384 [TensorRT] VERBOSE: Tactic: 7864319 time 0.10944 [TensorRT] VERBOSE: Tactic: 7995391 time 0.142816 [TensorRT] VERBOSE: Tactic: 8585215 time 0.18416 [TensorRT] VERBOSE: Tactic: 8847359 time 0.063168 [TensorRT] VERBOSE: Tactic: 8978431 time 0.185312 [TensorRT] VERBOSE: Tactic: 9043967 time 0.0784 [TensorRT] VERBOSE: Tactic: 9175039 time 0.072992 [TensorRT] VERBOSE: Tactic: 9502719 time 0.26112 [TensorRT] VERBOSE: Tactic: 9830399 time 0.133952 [TensorRT] VERBOSE: Tactic: 9961471 time 0.092992 [TensorRT] VERBOSE: Tactic: 10027007 time 0.101696 [TensorRT] VERBOSE: Tactic: 10092543 time 0.238592 [TensorRT] VERBOSE: Tactic: 10289151 time 0.2016 [TensorRT] VERBOSE: Tactic: 10485759 time 0.092992 [TensorRT] VERBOSE: Tactic: 10682367 time 0.093888 [TensorRT] VERBOSE: Tactic: 10813439 time 0.077664 [TensorRT] VERBOSE: Fastest Tactic: 8847359 Time: 0.063168 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4438325421691896755 time 0.201504 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: 4581732244273465060 time 0.172704 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 4934335053031119367 time 0.280352 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 6797040896965118050 time 0.2432 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [TensorRT] VERBOSE: Tactic: 8006952294591770973 time 0.314208 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -7210942453088153035 time 0.23392 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [TensorRT] VERBOSE: Tactic: -6282183216199417697 time 0.283264 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -5026383765466876607 time 0.24432 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [TensorRT] VERBOSE: Tactic: -5016725782072253841 time 0.251232 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [TensorRT] VERBOSE: Tactic: -1370999262391786833 time 0.194624 [TensorRT] VERBOSE: Fastest Tactic: 4581732244273465060 Time: 0.172704 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 8847359 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1213457772632185722 time 0.276864 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 1713441381477652893 time 0.314272 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 7125598890155666458 time 0.190144 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: 8047041638267142825 time 0.282624 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -7846982807478255793 time 0.171296 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -6459719113600909000 time 0.251456 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -4573925292554651334 time 0.232992 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -3566249366964946311 time 0.194656 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -2002418013575043687 time 0.239264 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Tactic: -1659631603542281459 time 0.2432 [TensorRT] VERBOSE: Fastest Tactic: -7846982807478255793 Time: 0.171296 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [TensorRT] VERBOSE: Conv_204 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 524287 time 0.13808 [TensorRT] VERBOSE: Tactic: 720895 time 0.1376 [TensorRT] VERBOSE: Tactic: 983039 time 0.074208 [TensorRT] VERBOSE: Tactic: 1048575 time 0.137216 [TensorRT] VERBOSE: Tactic: 1703935 time 0.106176 [TensorRT] VERBOSE: Tactic: 1769471 time 0.092672 [TensorRT] VERBOSE: Tactic: 1966079 time 0.198752 [TensorRT] VERBOSE: Tactic: 2031615 time 0.192672 [TensorRT] VERBOSE: Tactic: 2228223 time 0.198208 [TensorRT] VERBOSE: Tactic: 2424831 time 0.171488 [TensorRT] VERBOSE: Tactic: 2621439 time 0.096896 [TensorRT] VERBOSE: Tactic: 2752511 time 0.16384 [TensorRT] VERBOSE: Tactic: 2818047 time 0.127552 [TensorRT] VERBOSE: Tactic: 2883583 time 0.27136 [TensorRT] VERBOSE: Tactic: 3014655 time 0.0848 [TensorRT] VERBOSE: Tactic: 3145727 time 0.085824 [TensorRT] VERBOSE: Tactic: 3473407 time 0.177312 [TensorRT] VERBOSE: Tactic: 3604479 time 0.075648 [TensorRT] VERBOSE: Tactic: 3735551 time 0.094208 [TensorRT] VERBOSE: Tactic: 4390911 time 0.236896 [TensorRT] VERBOSE: Tactic: 5046271 time 0.110432 [TensorRT] VERBOSE: Tactic: 5963775 time 0.19168 [TensorRT] VERBOSE: Tactic: 6160383 time 0.271072 [TensorRT] VERBOSE: Tactic: 6488063 time 0.128672 [TensorRT] VERBOSE: Tactic: 6881279 time 0.178336 [TensorRT] VERBOSE: Tactic: 7274495 time 0.078304 [TensorRT] VERBOSE: Tactic: 7864319 time 0.107616 [TensorRT] VERBOSE: Tactic: 7995391 time 0.138112 [TensorRT] VERBOSE: Tactic: 8585215 time 0.18592 [TensorRT] VERBOSE: Tactic: 8847359 time 0.059392 [TensorRT] VERBOSE: Tactic: 8978431 time 0.187584 [TensorRT] VERBOSE: Tactic: 9043967 time 0.079008 [TensorRT] VERBOSE: Tactic: 9175039 time 0.070656 [TensorRT] VERBOSE: Tactic: 9502719 time 0.264672 [TensorRT] VERBOSE: Tactic: 9830399 time 0.132896 [TensorRT] VERBOSE: Tactic: 9961471 time 0.109024 [TensorRT] VERBOSE: Tactic: 10027007 time 0.100608 [TensorRT] VERBOSE: Tactic: 10092543 time 0.237792 [TensorRT] VERBOSE: Tactic: 10289151 time 0.198656 [TensorRT] VERBOSE: Tactic: 10485759 time 0.091904 [TensorRT] VERBOSE: Tactic: 10682367 time 0.090656 [TensorRT] VERBOSE: Tactic: 10813439 time 0.074752 [TensorRT] VERBOSE: Fastest Tactic: 8847359 Time: 0.059392 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CaskConvolution) [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 66319348402778770 time 0.09712 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: 1931698692231796048 time 0.106304 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: 2271687430539765460 time 0.127616 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: 7039764449991095921 time 0.095264 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -9114895246540757312 time 0.09216 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8787970778927801941 time 0.110592 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [TensorRT] VERBOSE: Tactic: -8225786209923559953 time 0.141664 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [TensorRT] VERBOSE: Tactic: -7373087278866484214 time 0.097888 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [TensorRT] VERBOSE: Tactic: -7274936339335021260 time 0.10288 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Tactic: -2102888629196925141 time 0.08544 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -674235064782459186 time 0.121856 [TensorRT] VERBOSE: Conv_204 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Tactic: -182858804213663094 time 0.088 [TensorRT] VERBOSE: Fastest Tactic: -2102888629196925141 Time: 0.08544 [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_204 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 8847359 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009184 [TensorRT] VERBOSE: Tactic: 256 time 0.009312 [TensorRT] VERBOSE: Tactic: 512 time 0.009504 [TensorRT] VERBOSE: Tactic: -32 time 0.029696 [TensorRT] VERBOSE: Tactic: -64 time 0.018176 [TensorRT] VERBOSE: Tactic: -128 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009184 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005984 [TensorRT] VERBOSE: Tactic: 1 time 0.006016 [TensorRT] VERBOSE: Tactic: 2 time 0.006048 [TensorRT] VERBOSE: Tactic: 3 time 0.006112 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.005984 [TensorRT] VERBOSE: Tactic: 6 time 0.005952 [TensorRT] VERBOSE: Tactic: 7 time 0.006048 [TensorRT] VERBOSE: Tactic: 8 time 0.006016 [TensorRT] VERBOSE: Tactic: 9 time 0.006016 [TensorRT] VERBOSE: Tactic: 28 time 0.006048 [TensorRT] VERBOSE: Fastest Tactic: 6 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 6 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009248 [TensorRT] VERBOSE: Tactic: 256 time 0.00928 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.030144 [TensorRT] VERBOSE: Tactic: -64 time 0.01872 [TensorRT] VERBOSE: Tactic: -128 time 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.009216 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.008672 [TensorRT] VERBOSE: Tactic: 25 time 0.006912 [TensorRT] VERBOSE: Tactic: 26 time 0.007712 [TensorRT] VERBOSE: Tactic: 27 time 0.007296 [TensorRT] VERBOSE: Tactic: 31 time 0.007904 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006912 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272), Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010784 [TensorRT] VERBOSE: Tactic: 256 time 0.010976 [TensorRT] VERBOSE: Tactic: 512 time 0.01072 [TensorRT] VERBOSE: Tactic: -32 time 0.013696 [TensorRT] VERBOSE: Tactic: -64 time 0.015296 [TensorRT] VERBOSE: Tactic: -128 time 0.015136 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.01072 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005664 [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 2 time 0.005792 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.005984 [TensorRT] VERBOSE: Tactic: 5 time 0.00608 [TensorRT] VERBOSE: Tactic: 6 time 0.007584 [TensorRT] VERBOSE: Tactic: 7 time 0.007744 [TensorRT] VERBOSE: Tactic: 8 time 0.006016 [TensorRT] VERBOSE: Tactic: 9 time 0.006112 [TensorRT] VERBOSE: Tactic: 10 time 0.007008 [TensorRT] VERBOSE: Tactic: 11 time 0.00768 [TensorRT] VERBOSE: Tactic: 12 time 0.00608 [TensorRT] VERBOSE: Tactic: 13 time 0.007648 [TensorRT] VERBOSE: Tactic: 14 time 0.006016 [TensorRT] VERBOSE: Tactic: 15 time 0.006048 [TensorRT] VERBOSE: Tactic: 16 time 0.007552 [TensorRT] VERBOSE: Tactic: 17 time 0.007712 [TensorRT] VERBOSE: Tactic: 18 time 0.007552 [TensorRT] VERBOSE: Tactic: 19 time 0.006816 [TensorRT] VERBOSE: Tactic: 20 time 0.009152 [TensorRT] VERBOSE: Tactic: 21 time 0.007712 [TensorRT] VERBOSE: Tactic: 22 time 0.007936 [TensorRT] VERBOSE: Tactic: 23 time 0.007456 [TensorRT] VERBOSE: Tactic: 28 time 0.007584 [TensorRT] VERBOSE: Tactic: 29 time 0.006912 [TensorRT] VERBOSE: Tactic: 30 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005664 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784), Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01056 [TensorRT] VERBOSE: Tactic: 256 time 0.010784 [TensorRT] VERBOSE: Tactic: 512 time 0.010752 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.01056 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_205, Add_206) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007584 [TensorRT] VERBOSE: Tactic: 11 time 0.009184 [TensorRT] VERBOSE: Tactic: 12 time 0.007712 [TensorRT] VERBOSE: Tactic: 13 time 0.01232 [TensorRT] VERBOSE: Tactic: 14 time 0.01072 [TensorRT] VERBOSE: Tactic: 15 time 0.010752 [TensorRT] VERBOSE: Tactic: 16 time 0.015264 [TensorRT] VERBOSE: Tactic: 17 time 0.010848 [TensorRT] VERBOSE: Tactic: 18 time 0.011712 [TensorRT] VERBOSE: Tactic: 19 time 0.01296 [TensorRT] VERBOSE: Tactic: 20 time 0.005952 [TensorRT] VERBOSE: Tactic: 21 time 0.006144 [TensorRT] VERBOSE: Tactic: 22 time 0.009248 [TensorRT] VERBOSE: Tactic: 23 time 0.01232 [TensorRT] VERBOSE: Tactic: 24 time 0.006144 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.007648 [TensorRT] VERBOSE: Tactic: 27 time 0.010784 [TensorRT] VERBOSE: Tactic: 29 time 0.014656 [TensorRT] VERBOSE: Tactic: 30 time 0.009088 [TensorRT] VERBOSE: Tactic: 31 time 0.007648 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011168 [TensorRT] VERBOSE: Tactic: 0 time 0.014144 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011168 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012352 [TensorRT] VERBOSE: Tactic: 0 time 0.004448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004448 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012672 [TensorRT] VERBOSE: Tactic: 0 time 0.012544 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012544 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027808 [TensorRT] VERBOSE: Tactic: 0 time 0.006656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006656 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012416 [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011104 [TensorRT] VERBOSE: Tactic: 0 time 0.012384 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011104 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01088 [TensorRT] VERBOSE: Tactic: 0 time 0.00512 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00512 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01232 [TensorRT] VERBOSE: Tactic: 0 time 0.014112 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01232 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011584 [TensorRT] VERBOSE: Tactic: 0 time 0.005952 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005952 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010848 [TensorRT] VERBOSE: Tactic: 0 time 0.00768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00768 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01232 [TensorRT] VERBOSE: Tactic: 0 time 0.014272 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01232 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012448 [TensorRT] VERBOSE: Tactic: 0 time 0.007584 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007584 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_207 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007616 [TensorRT] VERBOSE: Tactic: 256 time 0.007648 [TensorRT] VERBOSE: Tactic: 512 time 0.007744 [TensorRT] VERBOSE: Tactic: -32 time 0.023488 [TensorRT] VERBOSE: Tactic: -64 time 0.01424 [TensorRT] VERBOSE: Tactic: -128 time 0.01088 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006048 [TensorRT] VERBOSE: Tactic: 1 time 0.005696 [TensorRT] VERBOSE: Tactic: 2 time 0.0048 [TensorRT] VERBOSE: Tactic: 3 time 0.005984 [TensorRT] VERBOSE: Tactic: 4 time 0.005856 [TensorRT] VERBOSE: Tactic: 5 time 0.005952 [TensorRT] VERBOSE: Tactic: 6 time 0.006016 [TensorRT] VERBOSE: Tactic: 7 time 0.00608 [TensorRT] VERBOSE: Tactic: 8 time 0.004544 [TensorRT] VERBOSE: Tactic: 9 time 0.00608 [TensorRT] VERBOSE: Tactic: 28 time 0.006048 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.004544 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007616 [TensorRT] VERBOSE: Tactic: 256 time 0.007648 [TensorRT] VERBOSE: Tactic: 512 time 0.007744 [TensorRT] VERBOSE: Tactic: -32 time 0.023424 [TensorRT] VERBOSE: Tactic: -64 time 0.013952 [TensorRT] VERBOSE: Tactic: -128 time 0.010976 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.006208 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.005984 [TensorRT] VERBOSE: Tactic: 27 time 0.007648 [TensorRT] VERBOSE: Tactic: 31 time 0.006496 [TensorRT] VERBOSE: Fastest Tactic: 26 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009504 [TensorRT] VERBOSE: Tactic: 256 time 0.009312 [TensorRT] VERBOSE: Tactic: 512 time 0.0096 [TensorRT] VERBOSE: Tactic: -32 time 0.010752 [TensorRT] VERBOSE: Tactic: -64 time 0.012352 [TensorRT] VERBOSE: Tactic: -128 time 0.012256 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.009312 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.005984 [TensorRT] VERBOSE: Tactic: 2 time 0.00592 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.006048 [TensorRT] VERBOSE: Tactic: 5 time 0.00608 [TensorRT] VERBOSE: Tactic: 6 time 0.007904 [TensorRT] VERBOSE: Tactic: 7 time 0.005728 [TensorRT] VERBOSE: Tactic: 8 time 0.00608 [TensorRT] VERBOSE: Tactic: 9 time 0.00608 [TensorRT] VERBOSE: Tactic: 10 time 0.00624 [TensorRT] VERBOSE: Tactic: 11 time 0.005984 [TensorRT] VERBOSE: Tactic: 12 time 0.005984 [TensorRT] VERBOSE: Tactic: 13 time 0.006048 [TensorRT] VERBOSE: Tactic: 14 time 0.005952 [TensorRT] VERBOSE: Tactic: 15 time 0.00608 [TensorRT] VERBOSE: Tactic: 16 time 0.006176 [TensorRT] VERBOSE: Tactic: 17 time 0.006144 [TensorRT] VERBOSE: Tactic: 18 time 0.006112 [TensorRT] VERBOSE: Tactic: 19 time 0.00608 [TensorRT] VERBOSE: Tactic: 20 time 0.009184 [TensorRT] VERBOSE: Tactic: 21 time 0.007488 [TensorRT] VERBOSE: Tactic: 22 time 0.006144 [TensorRT] VERBOSE: Tactic: 23 time 0.006048 [TensorRT] VERBOSE: Tactic: 28 time 0.005984 [TensorRT] VERBOSE: Tactic: 29 time 0.006112 [TensorRT] VERBOSE: Tactic: 30 time 0.007872 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.005728 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00912 [TensorRT] VERBOSE: Tactic: 256 time 0.008512 [TensorRT] VERBOSE: Tactic: 512 time 0.009152 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.008512 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_208 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006048 [TensorRT] VERBOSE: Tactic: 11 time 0.00752 [TensorRT] VERBOSE: Tactic: 12 time 0.006016 [TensorRT] VERBOSE: Tactic: 13 time 0.009088 [TensorRT] VERBOSE: Tactic: 14 time 0.008608 [TensorRT] VERBOSE: Tactic: 15 time 0.010784 [TensorRT] VERBOSE: Tactic: 16 time 0.012352 [TensorRT] VERBOSE: Tactic: 17 time 0.00912 [TensorRT] VERBOSE: Tactic: 18 time 0.010688 [TensorRT] VERBOSE: Tactic: 19 time 0.011104 [TensorRT] VERBOSE: Tactic: 20 time 0.006048 [TensorRT] VERBOSE: Tactic: 21 time 0.006144 [TensorRT] VERBOSE: Tactic: 22 time 0.007616 [TensorRT] VERBOSE: Tactic: 23 time 0.009312 [TensorRT] VERBOSE: Tactic: 24 time 0.006048 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.006048 [TensorRT] VERBOSE: Tactic: 27 time 0.007488 [TensorRT] VERBOSE: Tactic: 29 time 0.010592 [TensorRT] VERBOSE: Tactic: 30 time 0.007488 [TensorRT] VERBOSE: Tactic: 31 time 0.006016 [TensorRT] VERBOSE: Fastest Tactic: 12 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 12 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_209 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_209 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_209 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_209 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_209 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.008864 [TensorRT] VERBOSE: Tactic: 256 time 0.009376 [TensorRT] VERBOSE: Tactic: 512 time 0.0096 [TensorRT] VERBOSE: Tactic: -32 time 0.029952 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.008864 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006048 [TensorRT] VERBOSE: Tactic: 1 time 0.005728 [TensorRT] VERBOSE: Tactic: 2 time 0.005632 [TensorRT] VERBOSE: Tactic: 3 time 0.005984 [TensorRT] VERBOSE: Tactic: 4 time 0.006048 [TensorRT] VERBOSE: Tactic: 5 time 0.005568 [TensorRT] VERBOSE: Tactic: 6 time 0.006016 [TensorRT] VERBOSE: Tactic: 7 time 0.00608 [TensorRT] VERBOSE: Tactic: 8 time 0.00544 [TensorRT] VERBOSE: Tactic: 9 time 0.006112 [TensorRT] VERBOSE: Tactic: 28 time 0.005952 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.00544 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009184 [TensorRT] VERBOSE: Tactic: 256 time 0.009152 [TensorRT] VERBOSE: Tactic: 512 time 0.009184 [TensorRT] VERBOSE: Tactic: -32 time 0.029984 [TensorRT] VERBOSE: Tactic: -64 time 0.01872 [TensorRT] VERBOSE: Tactic: -128 time 0.012256 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.009152 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.00768 [TensorRT] VERBOSE: Tactic: 25 time 0.006528 [TensorRT] VERBOSE: Tactic: 26 time 0.007776 [TensorRT] VERBOSE: Tactic: 27 time 0.007584 [TensorRT] VERBOSE: Tactic: 31 time 0.008192 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006528 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272), Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010912 [TensorRT] VERBOSE: Tactic: 256 time 0.010752 [TensorRT] VERBOSE: Tactic: 512 time 0.01104 [TensorRT] VERBOSE: Tactic: -32 time 0.013504 [TensorRT] VERBOSE: Tactic: -64 time 0.015488 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.010752 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Tactic: 1 time 0.006016 [TensorRT] VERBOSE: Tactic: 2 time 0.005984 [TensorRT] VERBOSE: Tactic: 3 time 0.006016 [TensorRT] VERBOSE: Tactic: 4 time 0.005792 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.00752 [TensorRT] VERBOSE: Tactic: 7 time 0.007456 [TensorRT] VERBOSE: Tactic: 8 time 0.006144 [TensorRT] VERBOSE: Tactic: 9 time 0.005984 [TensorRT] VERBOSE: Tactic: 10 time 0.007712 [TensorRT] VERBOSE: Tactic: 11 time 0.007424 [TensorRT] VERBOSE: Tactic: 12 time 0.00608 [TensorRT] VERBOSE: Tactic: 13 time 0.007424 [TensorRT] VERBOSE: Tactic: 14 time 0.006016 [TensorRT] VERBOSE: Tactic: 15 time 0.00608 [TensorRT] VERBOSE: Tactic: 16 time 0.007392 [TensorRT] VERBOSE: Tactic: 17 time 0.007648 [TensorRT] VERBOSE: Tactic: 18 time 0.007488 [TensorRT] VERBOSE: Tactic: 19 time 0.006784 [TensorRT] VERBOSE: Tactic: 20 time 0.009216 [TensorRT] VERBOSE: Tactic: 21 time 0.007968 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.006848 [TensorRT] VERBOSE: Tactic: 28 time 0.00768 [TensorRT] VERBOSE: Tactic: 29 time 0.006528 [TensorRT] VERBOSE: Tactic: 30 time 0.007872 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.005792 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784), Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.01088 [TensorRT] VERBOSE: Tactic: 256 time 0.010912 [TensorRT] VERBOSE: Tactic: 512 time 0.010848 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.010848 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_210, Add_211) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006528 [TensorRT] VERBOSE: Tactic: 11 time 0.009056 [TensorRT] VERBOSE: Tactic: 12 time 0.007264 [TensorRT] VERBOSE: Tactic: 13 time 0.012512 [TensorRT] VERBOSE: Tactic: 14 time 0.010496 [TensorRT] VERBOSE: Tactic: 15 time 0.010592 [TensorRT] VERBOSE: Tactic: 16 time 0.01536 [TensorRT] VERBOSE: Tactic: 17 time 0.012192 [TensorRT] VERBOSE: Tactic: 18 time 0.012288 [TensorRT] VERBOSE: Tactic: 19 time 0.012288 [TensorRT] VERBOSE: Tactic: 20 time 0.006144 [TensorRT] VERBOSE: Tactic: 21 time 0.007584 [TensorRT] VERBOSE: Tactic: 22 time 0.00912 [TensorRT] VERBOSE: Tactic: 23 time 0.012544 [TensorRT] VERBOSE: Tactic: 24 time 0.005984 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.007488 [TensorRT] VERBOSE: Tactic: 27 time 0.01008 [TensorRT] VERBOSE: Tactic: 29 time 0.0152 [TensorRT] VERBOSE: Tactic: 30 time 0.009152 [TensorRT] VERBOSE: Tactic: 31 time 0.007424 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_212 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007328 [TensorRT] VERBOSE: Tactic: 256 time 0.007552 [TensorRT] VERBOSE: Tactic: 512 time 0.007488 [TensorRT] VERBOSE: Tactic: -32 time 0.023808 [TensorRT] VERBOSE: Tactic: -64 time 0.014592 [TensorRT] VERBOSE: Tactic: -128 time 0.010656 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.007328 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.005984 [TensorRT] VERBOSE: Tactic: 2 time 0.004608 [TensorRT] VERBOSE: Tactic: 3 time 0.005888 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.004288 [TensorRT] VERBOSE: Tactic: 6 time 0.006048 [TensorRT] VERBOSE: Tactic: 7 time 0.006048 [TensorRT] VERBOSE: Tactic: 8 time 0.004256 [TensorRT] VERBOSE: Tactic: 9 time 0.00592 [TensorRT] VERBOSE: Tactic: 28 time 0.005984 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.004256 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.00752 [TensorRT] VERBOSE: Tactic: 256 time 0.007776 [TensorRT] VERBOSE: Tactic: 512 time 0.007648 [TensorRT] VERBOSE: Tactic: -32 time 0.023552 [TensorRT] VERBOSE: Tactic: -64 time 0.014176 [TensorRT] VERBOSE: Tactic: -128 time 0.01024 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.00752 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.006144 [TensorRT] VERBOSE: Tactic: 25 time 0.006016 [TensorRT] VERBOSE: Tactic: 26 time 0.006272 [TensorRT] VERBOSE: Tactic: 27 time 0.006432 [TensorRT] VERBOSE: Tactic: 31 time 0.006336 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009504 [TensorRT] VERBOSE: Tactic: 256 time 0.009376 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.01072 [TensorRT] VERBOSE: Tactic: -64 time 0.012288 [TensorRT] VERBOSE: Tactic: -128 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.009216 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Tactic: 1 time 0.005888 [TensorRT] VERBOSE: Tactic: 2 time 0.005504 [TensorRT] VERBOSE: Tactic: 3 time 0.005984 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.00608 [TensorRT] VERBOSE: Tactic: 6 time 0.007648 [TensorRT] VERBOSE: Tactic: 7 time 0.006112 [TensorRT] VERBOSE: Tactic: 8 time 0.006144 [TensorRT] VERBOSE: Tactic: 9 time 0.00576 [TensorRT] VERBOSE: Tactic: 10 time 0.006272 [TensorRT] VERBOSE: Tactic: 11 time 0.005952 [TensorRT] VERBOSE: Tactic: 12 time 0.006016 [TensorRT] VERBOSE: Tactic: 13 time 0.006016 [TensorRT] VERBOSE: Tactic: 14 time 0.006144 [TensorRT] VERBOSE: Tactic: 15 time 0.006016 [TensorRT] VERBOSE: Tactic: 16 time 0.006144 [TensorRT] VERBOSE: Tactic: 17 time 0.006048 [TensorRT] VERBOSE: Tactic: 18 time 0.006144 [TensorRT] VERBOSE: Tactic: 19 time 0.006016 [TensorRT] VERBOSE: Tactic: 20 time 0.007808 [TensorRT] VERBOSE: Tactic: 21 time 0.007552 [TensorRT] VERBOSE: Tactic: 22 time 0.006112 [TensorRT] VERBOSE: Tactic: 23 time 0.00592 [TensorRT] VERBOSE: Tactic: 28 time 0.005984 [TensorRT] VERBOSE: Tactic: 29 time 0.006016 [TensorRT] VERBOSE: Tactic: 30 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.005504 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.00912 [TensorRT] VERBOSE: Tactic: 512 time 0.009248 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.00912 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_213 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.006144 [TensorRT] VERBOSE: Tactic: 11 time 0.006208 [TensorRT] VERBOSE: Tactic: 12 time 0.006144 [TensorRT] VERBOSE: Tactic: 13 time 0.009088 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.009824 [TensorRT] VERBOSE: Tactic: 16 time 0.012992 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.010112 [TensorRT] VERBOSE: Tactic: 19 time 0.010784 [TensorRT] VERBOSE: Tactic: 20 time 0.004384 [TensorRT] VERBOSE: Tactic: 21 time 0.006048 [TensorRT] VERBOSE: Tactic: 22 time 0.00624 [TensorRT] VERBOSE: Tactic: 23 time 0.009056 [TensorRT] VERBOSE: Tactic: 24 time 0.005984 [TensorRT] VERBOSE: Tactic: 25 time 0.006016 [TensorRT] VERBOSE: Tactic: 26 time 0.005952 [TensorRT] VERBOSE: Tactic: 27 time 0.007488 [TensorRT] VERBOSE: Tactic: 29 time 0.010976 [TensorRT] VERBOSE: Tactic: 30 time 0.007328 [TensorRT] VERBOSE: Tactic: 31 time 0.006112 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.004384 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_214 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_214 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_214 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_214 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_214 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009248 [TensorRT] VERBOSE: Tactic: 256 time 0.009088 [TensorRT] VERBOSE: Tactic: 512 time 0.009152 [TensorRT] VERBOSE: Tactic: -32 time 0.03008 [TensorRT] VERBOSE: Tactic: -64 time 0.018752 [TensorRT] VERBOSE: Tactic: -128 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.009088 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.00608 [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 2 time 0.006016 [TensorRT] VERBOSE: Tactic: 3 time 0.00496 [TensorRT] VERBOSE: Tactic: 4 time 0.006016 [TensorRT] VERBOSE: Tactic: 5 time 0.0056 [TensorRT] VERBOSE: Tactic: 6 time 0.00608 [TensorRT] VERBOSE: Tactic: 7 time 0.00608 [TensorRT] VERBOSE: Tactic: 8 time 0.005984 [TensorRT] VERBOSE: Tactic: 9 time 0.005888 [TensorRT] VERBOSE: Tactic: 28 time 0.005792 [TensorRT] VERBOSE: Fastest Tactic: 3 Time: 0.00496 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009152 [TensorRT] VERBOSE: Tactic: 256 time 0.009216 [TensorRT] VERBOSE: Tactic: 512 time 0.00928 [TensorRT] VERBOSE: Tactic: -32 time 0.030336 [TensorRT] VERBOSE: Tactic: -64 time 0.018496 [TensorRT] VERBOSE: Tactic: -128 time 0.01216 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009152 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.007648 [TensorRT] VERBOSE: Tactic: 25 time 0.006496 [TensorRT] VERBOSE: Tactic: 26 time 0.00752 [TensorRT] VERBOSE: Tactic: 27 time 0.007712 [TensorRT] VERBOSE: Tactic: 31 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006496 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272), Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011008 [TensorRT] VERBOSE: Tactic: 256 time 0.01104 [TensorRT] VERBOSE: Tactic: 512 time 0.01088 [TensorRT] VERBOSE: Tactic: -32 time 0.013984 [TensorRT] VERBOSE: Tactic: -64 time 0.01536 [TensorRT] VERBOSE: Tactic: -128 time 0.015328 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.01088 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Tactic: 1 time 0.006112 [TensorRT] VERBOSE: Tactic: 2 time 0.006048 [TensorRT] VERBOSE: Tactic: 3 time 0.006048 [TensorRT] VERBOSE: Tactic: 4 time 0.00608 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.007232 [TensorRT] VERBOSE: Tactic: 7 time 0.007552 [TensorRT] VERBOSE: Tactic: 8 time 0.006048 [TensorRT] VERBOSE: Tactic: 9 time 0.005952 [TensorRT] VERBOSE: Tactic: 10 time 0.007616 [TensorRT] VERBOSE: Tactic: 11 time 0.007648 [TensorRT] VERBOSE: Tactic: 12 time 0.006208 [TensorRT] VERBOSE: Tactic: 13 time 0.007488 [TensorRT] VERBOSE: Tactic: 14 time 0.006144 [TensorRT] VERBOSE: Tactic: 15 time 0.00608 [TensorRT] VERBOSE: Tactic: 16 time 0.007616 [TensorRT] VERBOSE: Tactic: 17 time 0.007552 [TensorRT] VERBOSE: Tactic: 18 time 0.007552 [TensorRT] VERBOSE: Tactic: 19 time 0.007296 [TensorRT] VERBOSE: Tactic: 20 time 0.0096 [TensorRT] VERBOSE: Tactic: 21 time 0.007776 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.00736 [TensorRT] VERBOSE: Tactic: 28 time 0.007392 [TensorRT] VERBOSE: Tactic: 29 time 0.007168 [TensorRT] VERBOSE: Tactic: 30 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 9 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784), Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010816 [TensorRT] VERBOSE: Tactic: 256 time 0.011008 [TensorRT] VERBOSE: Tactic: 512 time 0.01088 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.010816 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_215, Add_216) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007584 [TensorRT] VERBOSE: Tactic: 11 time 0.009216 [TensorRT] VERBOSE: Tactic: 12 time 0.007488 [TensorRT] VERBOSE: Tactic: 13 time 0.012288 [TensorRT] VERBOSE: Tactic: 14 time 0.009696 [TensorRT] VERBOSE: Tactic: 15 time 0.010752 [TensorRT] VERBOSE: Tactic: 16 time 0.014016 [TensorRT] VERBOSE: Tactic: 17 time 0.011264 [TensorRT] VERBOSE: Tactic: 18 time 0.010976 [TensorRT] VERBOSE: Tactic: 19 time 0.012384 [TensorRT] VERBOSE: Tactic: 20 time 0.006016 [TensorRT] VERBOSE: Tactic: 21 time 0.006112 [TensorRT] VERBOSE: Tactic: 22 time 0.00912 [TensorRT] VERBOSE: Tactic: 23 time 0.012384 [TensorRT] VERBOSE: Tactic: 24 time 0.006144 [TensorRT] VERBOSE: Tactic: 25 time 0.006464 [TensorRT] VERBOSE: Tactic: 26 time 0.007648 [TensorRT] VERBOSE: Tactic: 27 time 0.010848 [TensorRT] VERBOSE: Tactic: 29 time 0.015328 [TensorRT] VERBOSE: Tactic: 30 time 0.009216 [TensorRT] VERBOSE: Tactic: 31 time 0.00752 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.006016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_217 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007968 [TensorRT] VERBOSE: Tactic: 256 time 0.007712 [TensorRT] VERBOSE: Tactic: 512 time 0.007712 [TensorRT] VERBOSE: Tactic: -32 time 0.02336 [TensorRT] VERBOSE: Tactic: -64 time 0.013856 [TensorRT] VERBOSE: Tactic: -128 time 0.010176 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.007712 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005088 [TensorRT] VERBOSE: Tactic: 1 time 0.004736 [TensorRT] VERBOSE: Tactic: 2 time 0.004448 [TensorRT] VERBOSE: Tactic: 3 time 0.005888 [TensorRT] VERBOSE: Tactic: 4 time 0.007168 [TensorRT] VERBOSE: Tactic: 5 time 0.005984 [TensorRT] VERBOSE: Tactic: 6 time 0.005984 [TensorRT] VERBOSE: Tactic: 7 time 0.006016 [TensorRT] VERBOSE: Tactic: 8 time 0.004864 [TensorRT] VERBOSE: Tactic: 9 time 0.00592 [TensorRT] VERBOSE: Tactic: 28 time 0.006048 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.004448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.007808 [TensorRT] VERBOSE: Tactic: 256 time 0.00752 [TensorRT] VERBOSE: Tactic: 512 time 0.008 [TensorRT] VERBOSE: Tactic: -32 time 0.02336 [TensorRT] VERBOSE: Tactic: -64 time 0.014432 [TensorRT] VERBOSE: Tactic: -128 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.00752 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.006336 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.006208 [TensorRT] VERBOSE: Tactic: 27 time 0.006144 [TensorRT] VERBOSE: Tactic: 31 time 0.006304 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006144 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009184 [TensorRT] VERBOSE: Tactic: 256 time 0.009216 [TensorRT] VERBOSE: Tactic: 512 time 0.009152 [TensorRT] VERBOSE: Tactic: -32 time 0.010816 [TensorRT] VERBOSE: Tactic: -64 time 0.012288 [TensorRT] VERBOSE: Tactic: -128 time 0.012384 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.009152 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005728 [TensorRT] VERBOSE: Tactic: 1 time 0.00464 [TensorRT] VERBOSE: Tactic: 2 time 0.005952 [TensorRT] VERBOSE: Tactic: 3 time 0.005728 [TensorRT] VERBOSE: Tactic: 4 time 0.005984 [TensorRT] VERBOSE: Tactic: 5 time 0.005856 [TensorRT] VERBOSE: Tactic: 6 time 0.007616 [TensorRT] VERBOSE: Tactic: 7 time 0.005984 [TensorRT] VERBOSE: Tactic: 8 time 0.005952 [TensorRT] VERBOSE: Tactic: 9 time 0.006048 [TensorRT] VERBOSE: Tactic: 10 time 0.006208 [TensorRT] VERBOSE: Tactic: 11 time 0.005728 [TensorRT] VERBOSE: Tactic: 12 time 0.006016 [TensorRT] VERBOSE: Tactic: 13 time 0.006016 [TensorRT] VERBOSE: Tactic: 14 time 0.006016 [TensorRT] VERBOSE: Tactic: 15 time 0.006016 [TensorRT] VERBOSE: Tactic: 16 time 0.00736 [TensorRT] VERBOSE: Tactic: 17 time 0.005952 [TensorRT] VERBOSE: Tactic: 18 time 0.005856 [TensorRT] VERBOSE: Tactic: 19 time 0.00608 [TensorRT] VERBOSE: Tactic: 20 time 0.009152 [TensorRT] VERBOSE: Tactic: 21 time 0.007616 [TensorRT] VERBOSE: Tactic: 22 time 0.00608 [TensorRT] VERBOSE: Tactic: 23 time 0.005984 [TensorRT] VERBOSE: Tactic: 28 time 0.006048 [TensorRT] VERBOSE: Tactic: 29 time 0.006048 [TensorRT] VERBOSE: Tactic: 30 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.00464 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.009088 [TensorRT] VERBOSE: Tactic: 512 time 0.009376 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.009088 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_218 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.00608 [TensorRT] VERBOSE: Tactic: 11 time 0.007392 [TensorRT] VERBOSE: Tactic: 12 time 0.00656 [TensorRT] VERBOSE: Tactic: 13 time 0.00912 [TensorRT] VERBOSE: Tactic: 14 time 0.009088 [TensorRT] VERBOSE: Tactic: 15 time 0.010912 [TensorRT] VERBOSE: Tactic: 16 time 0.01376 [TensorRT] VERBOSE: Tactic: 17 time 0.009216 [TensorRT] VERBOSE: Tactic: 18 time 0.010944 [TensorRT] VERBOSE: Tactic: 19 time 0.011936 [TensorRT] VERBOSE: Tactic: 20 time 0.005952 [TensorRT] VERBOSE: Tactic: 21 time 0.005984 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.009152 [TensorRT] VERBOSE: Tactic: 24 time 0.00512 [TensorRT] VERBOSE: Tactic: 25 time 0.006112 [TensorRT] VERBOSE: Tactic: 26 time 0.005984 [TensorRT] VERBOSE: Tactic: 27 time 0.007712 [TensorRT] VERBOSE: Tactic: 29 time 0.011136 [TensorRT] VERBOSE: Tactic: 30 time 0.00752 [TensorRT] VERBOSE: Tactic: 31 time 0.006112 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.00512 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_219 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_219 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_219 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_219 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_219 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088), Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.00912 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.030304 [TensorRT] VERBOSE: Tactic: -64 time 0.017632 [TensorRT] VERBOSE: Tactic: -128 time 0.012352 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.00912 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.005984 [TensorRT] VERBOSE: Tactic: 1 time 0.005216 [TensorRT] VERBOSE: Tactic: 2 time 0.005952 [TensorRT] VERBOSE: Tactic: 3 time 0.00592 [TensorRT] VERBOSE: Tactic: 4 time 0.00608 [TensorRT] VERBOSE: Tactic: 5 time 0.005952 [TensorRT] VERBOSE: Tactic: 6 time 0.005952 [TensorRT] VERBOSE: Tactic: 7 time 0.005664 [TensorRT] VERBOSE: Tactic: 8 time 0.005152 [TensorRT] VERBOSE: Tactic: 9 time 0.005952 [TensorRT] VERBOSE: Tactic: 28 time 0.006016 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.005152 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784), Float(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009184 [TensorRT] VERBOSE: Tactic: 256 time 0.009216 [TensorRT] VERBOSE: Tactic: 512 time 0.009184 [TensorRT] VERBOSE: Tactic: -32 time 0.029728 [TensorRT] VERBOSE: Tactic: -64 time 0.01888 [TensorRT] VERBOSE: Tactic: -128 time 0.012288 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009184 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.007712 [TensorRT] VERBOSE: Tactic: 25 time 0.006624 [TensorRT] VERBOSE: Tactic: 26 time 0.006688 [TensorRT] VERBOSE: Tactic: 27 time 0.007904 [TensorRT] VERBOSE: Tactic: 31 time 0.00768 [TensorRT] VERBOSE: Fastest Tactic: 25 Time: 0.006624 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272), Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010752 [TensorRT] VERBOSE: Tactic: 256 time 0.010816 [TensorRT] VERBOSE: Tactic: 512 time 0.010848 [TensorRT] VERBOSE: Tactic: -32 time 0.013792 [TensorRT] VERBOSE: Tactic: -64 time 0.015328 [TensorRT] VERBOSE: Tactic: -128 time 0.015392 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.010752 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006048 [TensorRT] VERBOSE: Tactic: 1 time 0.00592 [TensorRT] VERBOSE: Tactic: 2 time 0.006112 [TensorRT] VERBOSE: Tactic: 3 time 0.005984 [TensorRT] VERBOSE: Tactic: 4 time 0.006144 [TensorRT] VERBOSE: Tactic: 5 time 0.006048 [TensorRT] VERBOSE: Tactic: 6 time 0.00768 [TensorRT] VERBOSE: Tactic: 7 time 0.007584 [TensorRT] VERBOSE: Tactic: 8 time 0.005984 [TensorRT] VERBOSE: Tactic: 9 time 0.006048 [TensorRT] VERBOSE: Tactic: 10 time 0.007712 [TensorRT] VERBOSE: Tactic: 11 time 0.007552 [TensorRT] VERBOSE: Tactic: 12 time 0.006432 [TensorRT] VERBOSE: Tactic: 13 time 0.006976 [TensorRT] VERBOSE: Tactic: 14 time 0.006144 [TensorRT] VERBOSE: Tactic: 15 time 0.005984 [TensorRT] VERBOSE: Tactic: 16 time 0.007616 [TensorRT] VERBOSE: Tactic: 17 time 0.007616 [TensorRT] VERBOSE: Tactic: 18 time 0.007584 [TensorRT] VERBOSE: Tactic: 19 time 0.007552 [TensorRT] VERBOSE: Tactic: 20 time 0.009184 [TensorRT] VERBOSE: Tactic: 21 time 0.007744 [TensorRT] VERBOSE: Tactic: 22 time 0.007456 [TensorRT] VERBOSE: Tactic: 23 time 0.00768 [TensorRT] VERBOSE: Tactic: 28 time 0.007712 [TensorRT] VERBOSE: Tactic: 29 time 0.007616 [TensorRT] VERBOSE: Tactic: 30 time 0.009152 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.00592 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784), Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.010784 [TensorRT] VERBOSE: Tactic: 256 time 0.010464 [TensorRT] VERBOSE: Tactic: 512 time 0.010752 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.010464 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(LeakyRelu_220, Add_221) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.007552 [TensorRT] VERBOSE: Tactic: 11 time 0.00928 [TensorRT] VERBOSE: Tactic: 12 time 0.006944 [TensorRT] VERBOSE: Tactic: 13 time 0.012544 [TensorRT] VERBOSE: Tactic: 14 time 0.010432 [TensorRT] VERBOSE: Tactic: 15 time 0.010624 [TensorRT] VERBOSE: Tactic: 16 time 0.01392 [TensorRT] VERBOSE: Tactic: 17 time 0.011008 [TensorRT] VERBOSE: Tactic: 18 time 0.011456 [TensorRT] VERBOSE: Tactic: 19 time 0.012288 [TensorRT] VERBOSE: Tactic: 20 time 0.005952 [TensorRT] VERBOSE: Tactic: 21 time 0.007584 [TensorRT] VERBOSE: Tactic: 22 time 0.009088 [TensorRT] VERBOSE: Tactic: 23 time 0.012288 [TensorRT] VERBOSE: Tactic: 24 time 0.006144 [TensorRT] VERBOSE: Tactic: 25 time 0.006144 [TensorRT] VERBOSE: Tactic: 26 time 0.007456 [TensorRT] VERBOSE: Tactic: 27 time 0.01056 [TensorRT] VERBOSE: Tactic: 29 time 0.014816 [TensorRT] VERBOSE: Tactic: 30 time 0.010624 [TensorRT] VERBOSE: Tactic: 31 time 0.00784 [TensorRT] VERBOSE: Fastest Tactic: 20 Time: 0.005952 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,6272) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49,25088) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Float(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_222 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,784) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006016 [TensorRT] VERBOSE: Tactic: 0 time 0.004384 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004384 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010592 [TensorRT] VERBOSE: Tactic: 0 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010592 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012576 [TensorRT] VERBOSE: Tactic: 0 time 0.007744 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007744 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012896 [TensorRT] VERBOSE: Tactic: 0 time 0.011168 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011168 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027296 [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011104 [TensorRT] VERBOSE: Tactic: 0 time 0.004576 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004576 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012288 [TensorRT] VERBOSE: Tactic: 0 time 0.007648 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007648 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011808 [TensorRT] VERBOSE: Tactic: 0 time 0.012192 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011808 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,25088) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.008416 [TensorRT] VERBOSE: Tactic: 256 time 0.009216 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.023328 [TensorRT] VERBOSE: Tactic: -64 time 0.014048 [TensorRT] VERBOSE: Tactic: -128 time 0.010912 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.008416 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006112 [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 2 time 0.00576 [TensorRT] VERBOSE: Tactic: 3 time 0.005952 [TensorRT] VERBOSE: Tactic: 4 time 0.00608 [TensorRT] VERBOSE: Tactic: 5 time 0.005888 [TensorRT] VERBOSE: Tactic: 6 time 0.005984 [TensorRT] VERBOSE: Tactic: 7 time 0.005984 [TensorRT] VERBOSE: Tactic: 8 time 0.00592 [TensorRT] VERBOSE: Tactic: 9 time 0.006112 [TensorRT] VERBOSE: Tactic: 28 time 0.006112 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.00576 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,784) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009216 [TensorRT] VERBOSE: Tactic: 256 time 0.009184 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.023296 [TensorRT] VERBOSE: Tactic: -64 time 0.015424 [TensorRT] VERBOSE: Tactic: -128 time 0.010848 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.009184 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.00656 [TensorRT] VERBOSE: Tactic: 25 time 0.006048 [TensorRT] VERBOSE: Tactic: 26 time 0.005952 [TensorRT] VERBOSE: Tactic: 27 time 0.007744 [TensorRT] VERBOSE: Tactic: 31 time 0.005856 [TensorRT] VERBOSE: Fastest Tactic: 31 Time: 0.005856 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,6272) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009152 [TensorRT] VERBOSE: Tactic: 256 time 0.00928 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Tactic: -32 time 0.011008 [TensorRT] VERBOSE: Tactic: -64 time 0.012256 [TensorRT] VERBOSE: Tactic: -128 time 0.01232 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009152 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006016 [TensorRT] VERBOSE: Tactic: 1 time 0.005952 [TensorRT] VERBOSE: Tactic: 2 time 0.005952 [TensorRT] VERBOSE: Tactic: 3 time 0.005984 [TensorRT] VERBOSE: Tactic: 4 time 0.005152 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.007712 [TensorRT] VERBOSE: Tactic: 7 time 0.005984 [TensorRT] VERBOSE: Tactic: 8 time 0.005952 [TensorRT] VERBOSE: Tactic: 9 time 0.00608 [TensorRT] VERBOSE: Tactic: 10 time 0.007232 [TensorRT] VERBOSE: Tactic: 11 time 0.006016 [TensorRT] VERBOSE: Tactic: 12 time 0.005984 [TensorRT] VERBOSE: Tactic: 13 time 0.006016 [TensorRT] VERBOSE: Tactic: 14 time 0.00608 [TensorRT] VERBOSE: Tactic: 15 time 0.005984 [TensorRT] VERBOSE: Tactic: 16 time 0.006208 [TensorRT] VERBOSE: Tactic: 17 time 0.006112 [TensorRT] VERBOSE: Tactic: 18 time 0.00608 [TensorRT] VERBOSE: Tactic: 19 time 0.005952 [TensorRT] VERBOSE: Tactic: 20 time 0.009184 [TensorRT] VERBOSE: Tactic: 21 time 0.007488 [TensorRT] VERBOSE: Tactic: 22 time 0.005984 [TensorRT] VERBOSE: Tactic: 23 time 0.006144 [TensorRT] VERBOSE: Tactic: 28 time 0.006016 [TensorRT] VERBOSE: Tactic: 29 time 0.006144 [TensorRT] VERBOSE: Tactic: 30 time 0.007584 [TensorRT] VERBOSE: Fastest Tactic: 4 Time: 0.005152 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,784) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.009152 [TensorRT] VERBOSE: Tactic: 256 time 0.009216 [TensorRT] VERBOSE: Tactic: 512 time 0.009216 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 0.009152 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_223 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.005984 [TensorRT] VERBOSE: Tactic: 11 time 0.00608 [TensorRT] VERBOSE: Tactic: 12 time 0.006048 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009088 [TensorRT] VERBOSE: Tactic: 15 time 0.009792 [TensorRT] VERBOSE: Tactic: 16 time 0.013216 [TensorRT] VERBOSE: Tactic: 17 time 0.010016 [TensorRT] VERBOSE: Tactic: 18 time 0.010752 [TensorRT] VERBOSE: Tactic: 19 time 0.012224 [TensorRT] VERBOSE: Tactic: 20 time 0.006048 [TensorRT] VERBOSE: Tactic: 21 time 0.00608 [TensorRT] VERBOSE: Tactic: 22 time 0.00624 [TensorRT] VERBOSE: Tactic: 23 time 0.00944 [TensorRT] VERBOSE: Tactic: 24 time 0.004672 [TensorRT] VERBOSE: Tactic: 25 time 0.006016 [TensorRT] VERBOSE: Tactic: 26 time 0.006048 [TensorRT] VERBOSE: Tactic: 27 time 0.007616 [TensorRT] VERBOSE: Tactic: 29 time 0.010784 [TensorRT] VERBOSE: Tactic: 30 time 0.00768 [TensorRT] VERBOSE: Tactic: 31 time 0.00608 [TensorRT] VERBOSE: Fastest Tactic: 24 Time: 0.004672 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010752 [TensorRT] VERBOSE: Tactic: 0 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010752 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012384 [TensorRT] VERBOSE: Tactic: 0 time 0.004288 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004288 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012384 [TensorRT] VERBOSE: Tactic: 0 time 0.011264 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027616 [TensorRT] VERBOSE: Tactic: 0 time 0.00768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00768 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012352 [TensorRT] VERBOSE: Tactic: 0 time 0.007392 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007392 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011584 [TensorRT] VERBOSE: Tactic: 0 time 0.012256 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011584 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010784 [TensorRT] VERBOSE: Tactic: 0 time 0.007744 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007744 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011808 [TensorRT] VERBOSE: Tactic: 0 time 0.014464 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011808 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01232 [TensorRT] VERBOSE: Tactic: 0 time 0.004928 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004928 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011136 [TensorRT] VERBOSE: Tactic: 0 time 0.007552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007552 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01248 [TensorRT] VERBOSE: Tactic: 0 time 0.015264 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01248 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012448 [TensorRT] VERBOSE: Tactic: 0 time 0.006112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006112 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaConvolution) [TensorRT] VERBOSE: CudaConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: Conv_225 (CudaGroupConvolution) [TensorRT] VERBOSE: CudaGroupConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,50176) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 256 time 0.01072 [TensorRT] VERBOSE: Tactic: 512 time 0.011264 [TensorRT] VERBOSE: Tactic: -32 time 0.027264 [TensorRT] VERBOSE: Tactic: -64 time 0.017696 [TensorRT] VERBOSE: Tactic: -128 time 0.014336 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.01072 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.006272 [TensorRT] VERBOSE: Tactic: 1 time 0.006496 [TensorRT] VERBOSE: Tactic: 2 time 0.006432 [TensorRT] VERBOSE: Tactic: 3 time 0.006144 [TensorRT] VERBOSE: Tactic: 4 time 0.0064 [TensorRT] VERBOSE: Tactic: 5 time 0.006304 [TensorRT] VERBOSE: Tactic: 6 time 0.006624 [TensorRT] VERBOSE: Tactic: 7 time 0.006432 [TensorRT] VERBOSE: Tactic: 8 time 0.00608 [TensorRT] VERBOSE: Tactic: 9 time 0.006432 [TensorRT] VERBOSE: Tactic: 28 time 0.006464 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.00608 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49:32,1568) -> Float(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.011264 [TensorRT] VERBOSE: Tactic: 256 time 0.0112 [TensorRT] VERBOSE: Tactic: 512 time 0.011392 [TensorRT] VERBOSE: Tactic: -32 time 0.028256 [TensorRT] VERBOSE: Tactic: -64 time 0.017408 [TensorRT] VERBOSE: Tactic: -128 time 0.014592 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.0112 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 time 0.009216 [TensorRT] VERBOSE: Tactic: 25 time 0.009216 [TensorRT] VERBOSE: Tactic: 26 time 0.008576 [TensorRT] VERBOSE: Tactic: 27 time 0.008224 [TensorRT] VERBOSE: Tactic: 31 time 0.009536 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 0.008224 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,7,49:4,12544) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014208 [TensorRT] VERBOSE: Tactic: 256 time 0.014176 [TensorRT] VERBOSE: Tactic: 512 time 0.013856 [TensorRT] VERBOSE: Tactic: -32 time 0.018432 [TensorRT] VERBOSE: Tactic: -64 time 0.020288 [TensorRT] VERBOSE: Tactic: -128 time 0.020064 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 0.013856 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 time 0.007776 [TensorRT] VERBOSE: Tactic: 1 time 0.006048 [TensorRT] VERBOSE: Tactic: 2 time 0.006048 [TensorRT] VERBOSE: Tactic: 3 time 0.007584 [TensorRT] VERBOSE: Tactic: 4 time 0.006176 [TensorRT] VERBOSE: Tactic: 5 time 0.006144 [TensorRT] VERBOSE: Tactic: 6 time 0.009216 [TensorRT] VERBOSE: Tactic: 7 time 0.007616 [TensorRT] VERBOSE: Tactic: 8 time 0.00768 [TensorRT] VERBOSE: Tactic: 9 time 0.006336 [TensorRT] VERBOSE: Tactic: 10 time 0.009568 [TensorRT] VERBOSE: Tactic: 11 time 0.00768 [TensorRT] VERBOSE: Tactic: 12 time 0.007808 [TensorRT] VERBOSE: Tactic: 13 time 0.007296 [TensorRT] VERBOSE: Tactic: 14 time 0.007424 [TensorRT] VERBOSE: Tactic: 15 time 0.006144 [TensorRT] VERBOSE: Tactic: 16 time 0.009216 [TensorRT] VERBOSE: Tactic: 17 time 0.00752 [TensorRT] VERBOSE: Tactic: 18 time 0.007168 [TensorRT] VERBOSE: Tactic: 19 time 0.006496 [TensorRT] VERBOSE: Tactic: 20 time 0.012288 [TensorRT] VERBOSE: Tactic: 21 time 0.010752 [TensorRT] VERBOSE: Tactic: 22 time 0.009216 [TensorRT] VERBOSE: Tactic: 23 time 0.008032 [TensorRT] VERBOSE: Tactic: 28 time 0.007808 [TensorRT] VERBOSE: Tactic: 29 time 0.009216 [TensorRT] VERBOSE: Tactic: 30 time 0.010944 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.006048 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Int8(1,7,49:32,1568) *************** [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWise) [TensorRT] VERBOSE: Tactic: 128 time 0.014048 [TensorRT] VERBOSE: Tactic: 256 time 0.013888 [TensorRT] VERBOSE: Tactic: 512 time 0.014048 [TensorRT] VERBOSE: Fastest Tactic: 256 Time: 0.013888 [TensorRT] VERBOSE: --------------- Timing Runner: LeakyRelu_226 (PointWiseV2) [TensorRT] VERBOSE: Tactic: 10 time 0.005984 [TensorRT] VERBOSE: Tactic: 11 time 0.007456 [TensorRT] VERBOSE: Tactic: 12 time 0.007616 [TensorRT] VERBOSE: Tactic: 13 time 0.009216 [TensorRT] VERBOSE: Tactic: 14 time 0.009216 [TensorRT] VERBOSE: Tactic: 15 time 0.010496 [TensorRT] VERBOSE: Tactic: 16 time 0.01392 [TensorRT] VERBOSE: Tactic: 17 time 0.010656 [TensorRT] VERBOSE: Tactic: 18 time 0.010752 [TensorRT] VERBOSE: Tactic: 19 time 0.012288 [TensorRT] VERBOSE: Tactic: 20 time 0.006016 [TensorRT] VERBOSE: Tactic: 21 time 0.00656 [TensorRT] VERBOSE: Tactic: 22 time 0.007584 [TensorRT] VERBOSE: Tactic: 23 time 0.009216 [TensorRT] VERBOSE: Tactic: 24 time 0.006272 [TensorRT] VERBOSE: Tactic: 25 time 0.00608 [TensorRT] VERBOSE: Tactic: 26 time 0.006144 [TensorRT] VERBOSE: Tactic: 27 time 0.007136 [TensorRT] VERBOSE: Tactic: 29 time 0.01536 [TensorRT] VERBOSE: Tactic: 30 time 0.01008 [TensorRT] VERBOSE: Tactic: 31 time 0.007936 [TensorRT] VERBOSE: Fastest Tactic: 10 Time: 0.005984 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,1,1,1024) *************** [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (Pooling) [TensorRT] VERBOSE: Tactic: -1 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.006144 [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (TiledPooling) [TensorRT] VERBOSE: Tactic: 8192257 time 0.011264 [TensorRT] VERBOSE: Tactic: 8257793 time 0.010592 [TensorRT] VERBOSE: Tactic: 8323329 time 0.010784 [TensorRT] VERBOSE: Tactic: 8388865 time 0.01056 [TensorRT] VERBOSE: Tactic: 8454401 time 0.010656 [TensorRT] VERBOSE: Tactic: 8519937 time 0.01088 [TensorRT] VERBOSE: Tactic: 8585473 time 0.01072 [TensorRT] VERBOSE: Tactic: 8651009 time 0.010976 [TensorRT] VERBOSE: Fastest Tactic: 8388865 Time: 0.01056 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:4,12544) -> Int8(1,1,1:4,256) *************** [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (Pooling) [TensorRT] VERBOSE: Tactic: -3 time 0.01008 [TensorRT] VERBOSE: Fastest Tactic: -3 Time: 0.01008 [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (TiledPooling) [TensorRT] VERBOSE: Tactic: 8192257 time 0.007648 [TensorRT] VERBOSE: Tactic: 8257793 time 0.007392 [TensorRT] VERBOSE: Tactic: 8323329 time 0.007616 [TensorRT] VERBOSE: Tactic: 8388865 time 0.009248 [TensorRT] VERBOSE: Tactic: 8454401 time 0.00912 [TensorRT] VERBOSE: Tactic: 8519937 time 0.009088 [TensorRT] VERBOSE: Tactic: 8585473 time 0.010912 [TensorRT] VERBOSE: Tactic: 8651009 time 0.01072 [TensorRT] VERBOSE: Fastest Tactic: 8257793 Time: 0.007392 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 8257793 [TensorRT] VERBOSE: [TensorRT] VERBOSE: *************** Autotuning format combination: Int8(1,7,49:32,1568) -> Int8(1,1,1:32,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (Pooling) [TensorRT] VERBOSE: Tactic: -4 time 0.011264 [TensorRT] VERBOSE: Fastest Tactic: -4 Time: 0.011264 [TensorRT] VERBOSE: --------------- Timing Runner: GlobalAveragePool_227 (TiledPooling) [TensorRT] VERBOSE: TiledPooling has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -4 [TensorRT] VERBOSE: [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.00768 [TensorRT] VERBOSE: Tactic: 0 time 0.004416 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004416 [TensorRT] VERBOSE: --------------- Timing Runner: (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.007552 [TensorRT] VERBOSE: Tactic: 0 time 0.004224 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004224 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,1,1,1024) -> Float(1,1024) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Flatten_228 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 time 0.004384 [TensorRT] VERBOSE: Tactic: 1 skipped. Scratch requested: 4096, available: 0 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004384 [TensorRT] WARNING: No implementation of layer Flatten_228 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: *************** Autotuning format combination: -> Float(1,3) *************** [TensorRT] WARNING: No implementation of layer head.fc.weight obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,1024), Float(1,3) -> Float(1,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Gemm_229 (MatrixMultiply) [TensorRT] VERBOSE: Tactic: 0 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0 [TensorRT] WARNING: No implementation of layer Gemm_229 obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: *************** Autotuning format combination: -> Float(1,3) *************** [TensorRT] WARNING: No implementation of layer (Unnamed Layer* 463) [Constant] + (Unnamed Layer* 464) [Shuffle] obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1,3), Float(1,3) -> Float(1,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: (Unnamed Layer* 465) [ElementWise] (ElementWise) [TensorRT] VERBOSE: Tactic: 1 is the only option, timing skipped [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0 [TensorRT] WARNING: No implementation of layer (Unnamed Layer* 465) [ElementWise] obeys the requested constraints in strict mode. No conforming implementation was found i.e. requested layer computation precision and output precision types are ignored, using the fastest implementation. [TensorRT] VERBOSE: Reformatting format: [in] Float(1,224,50176,150528), [out] Int8(1,224,50176:4,50176) [TensorRT] WARNING: No implementation obeys reformatting-free rules, at least 1 reformatting nodes are needed, now picking the fastest path instead. [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.123008 [TensorRT] VERBOSE: Tactic: 0 time 0.063584 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.063584 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.14208 [TensorRT] VERBOSE: Tactic: 0 time 0.39488 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.14208 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.179488 [TensorRT] VERBOSE: Tactic: 0 time 0.099328 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.099328 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.172544 [TensorRT] VERBOSE: Tactic: 0 time 0.292704 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.172544 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.310848 [TensorRT] VERBOSE: Tactic: 0 time 0.33408 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.310848 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.148096 [TensorRT] VERBOSE: Tactic: 0 time 0.063232 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.063232 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.184064 [TensorRT] VERBOSE: Tactic: 0 time 0.358784 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.184064 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_18 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.176 [TensorRT] VERBOSE: Tactic: 0 time 0.65424 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.176 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.130944 [TensorRT] VERBOSE: Tactic: 0 time 0.065408 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.065408 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.143072 [TensorRT] VERBOSE: Tactic: 0 time 0.459104 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.143072 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.180512 [TensorRT] VERBOSE: Tactic: 0 time 0.101824 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.101824 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.174016 [TensorRT] VERBOSE: Tactic: 0 time 0.359136 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.174016 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.327392 [TensorRT] VERBOSE: Tactic: 0 time 0.350272 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.327392 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.145952 [TensorRT] VERBOSE: Tactic: 0 time 0.067104 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.067104 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.187808 [TensorRT] VERBOSE: Tactic: 0 time 0.369984 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.187808 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_15 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.177152 [TensorRT] VERBOSE: Tactic: 0 time 0.797664 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.177152 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.035328 [TensorRT] VERBOSE: Tactic: 0 time 0.01968 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01968 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040032 [TensorRT] VERBOSE: Tactic: 0 time 0.09328 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040032 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.052384 [TensorRT] VERBOSE: Tactic: 0 time 0.028768 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028768 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048864 [TensorRT] VERBOSE: Tactic: 0 time 0.062016 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048864 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.070048 [TensorRT] VERBOSE: Tactic: 0 time 0.047712 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047712 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.042496 [TensorRT] VERBOSE: Tactic: 0 time 0.02096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02096 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.051776 [TensorRT] VERBOSE: Tactic: 0 time 0.042336 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042336 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_45 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.05008 [TensorRT] VERBOSE: Tactic: 0 time 0.082624 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.05008 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.03392 [TensorRT] VERBOSE: Tactic: 0 time 0.02 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.039936 [TensorRT] VERBOSE: Tactic: 0 time 0.093792 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.039936 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050144 [TensorRT] VERBOSE: Tactic: 0 time 0.02896 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02896 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.048576 [TensorRT] VERBOSE: Tactic: 0 time 0.062016 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.048576 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.070592 [TensorRT] VERBOSE: Tactic: 0 time 0.049152 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.049152 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.042592 [TensorRT] VERBOSE: Tactic: 0 time 0.02 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.052192 [TensorRT] VERBOSE: Tactic: 0 time 0.042368 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042368 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_42 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.050176 [TensorRT] VERBOSE: Tactic: 0 time 0.082368 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.050176 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.019488 [TensorRT] VERBOSE: Tactic: 0 time 0.012672 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012672 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.023616 [TensorRT] VERBOSE: Tactic: 0 time 0.04912 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023616 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027008 [TensorRT] VERBOSE: Tactic: 0 time 0.015712 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.015712 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.024896 [TensorRT] VERBOSE: Tactic: 0 time 0.031872 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024896 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040096 [TensorRT] VERBOSE: Tactic: 0 time 0.025408 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.025408 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0248 [TensorRT] VERBOSE: Tactic: 0 time 0.012032 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012032 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027904 [TensorRT] VERBOSE: Tactic: 0 time 0.019776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019776 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_77 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025728 [TensorRT] VERBOSE: Tactic: 0 time 0.03968 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025728 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.020448 [TensorRT] VERBOSE: Tactic: 0 time 0.012256 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012256 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.023648 [TensorRT] VERBOSE: Tactic: 0 time 0.048192 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023648 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0272 [TensorRT] VERBOSE: Tactic: 0 time 0.016384 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016384 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0272 [TensorRT] VERBOSE: Tactic: 0 time 0.03152 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.0272 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.040416 [TensorRT] VERBOSE: Tactic: 0 time 0.024512 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024512 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.025184 [TensorRT] VERBOSE: Tactic: 0 time 0.012192 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012192 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.028544 [TensorRT] VERBOSE: Tactic: 0 time 0.019456 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019456 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_74 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026848 [TensorRT] VERBOSE: Tactic: 0 time 0.038656 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026848 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.007904 [TensorRT] VERBOSE: Tactic: 0 time 0.006112 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006112 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01328 [TensorRT] VERBOSE: Tactic: 0 time 0.025248 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.01328 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017312 [TensorRT] VERBOSE: Tactic: 0 time 0.010656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010656 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015424 [TensorRT] VERBOSE: Tactic: 0 time 0.018272 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015424 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02288 [TensorRT] VERBOSE: Tactic: 0 time 0.012896 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012896 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014432 [TensorRT] VERBOSE: Tactic: 0 time 0.006144 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006144 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.017728 [TensorRT] VERBOSE: Tactic: 0 time 0.012096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012096 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_139 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015904 [TensorRT] VERBOSE: Tactic: 0 time 0.02176 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015904 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.007808 [TensorRT] VERBOSE: Tactic: 0 time 0.006272 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006272 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014464 [TensorRT] VERBOSE: Tactic: 0 time 0.02544 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.014464 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015968 [TensorRT] VERBOSE: Tactic: 0 time 0.010304 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010304 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.015616 [TensorRT] VERBOSE: Tactic: 0 time 0.018496 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.015616 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.02192 [TensorRT] VERBOSE: Tactic: 0 time 0.012864 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012864 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.014304 [TensorRT] VERBOSE: Tactic: 0 time 0.006304 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006304 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.0168 [TensorRT] VERBOSE: Tactic: 0 time 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_136 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.016224 [TensorRT] VERBOSE: Tactic: 0 time 0.022048 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016224 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006048 [TensorRT] VERBOSE: Tactic: 0 time 0.004512 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004512 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010752 [TensorRT] VERBOSE: Tactic: 0 time 0.014016 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010752 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012384 [TensorRT] VERBOSE: Tactic: 0 time 0.007744 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007744 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011456 [TensorRT] VERBOSE: Tactic: 0 time 0.010784 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010784 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.027168 [TensorRT] VERBOSE: Tactic: 0 time 0.007648 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007648 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010816 [TensorRT] VERBOSE: Tactic: 0 time 0.004512 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004512 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.01232 [TensorRT] VERBOSE: Tactic: 0 time 0.007712 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007712 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_201 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011776 [TensorRT] VERBOSE: Tactic: 0 time 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.011776 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.006048 [TensorRT] VERBOSE: Tactic: 0 time 0.00448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00448 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.010944 [TensorRT] VERBOSE: Tactic: 0 time 0.015712 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010944 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012288 [TensorRT] VERBOSE: Tactic: 0 time 0.007456 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007456 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012672 [TensorRT] VERBOSE: Tactic: 0 time 0.012416 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012416 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.026656 [TensorRT] VERBOSE: Tactic: 0 time 0.00752 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00752 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.011264 [TensorRT] VERBOSE: Tactic: 0 time 0.00432 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00432 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012576 [TensorRT] VERBOSE: Tactic: 0 time 0.007616 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007616 [TensorRT] VERBOSE: --------------- Timing Runner: Slice_198 (Reformat) [TensorRT] VERBOSE: Tactic: 1002 time 0.012224 [TensorRT] VERBOSE: Tactic: 0 time 0.012352 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.012224 [TensorRT] VERBOSE: Adding reformat layer: Conv_0 reformatted input 0 (input) from Float(1,224,50176,150528) to Int8(1,224,50176:4,50176) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_3 reformatted input 0 (745) from Int8(1,112,12544:32,25088) to Int8(1,112,12544:4,200704) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_5 reformatted input 0 (748) from Int8(1,112,12544:4,401408) to Float(1,112,12544,1605632) [TensorRT] VERBOSE: Adding reformat layer: PWN(LeakyRelu_22, Add_23) reformatted input 0 (754) from Int8(1,112,12544:32,25088) to Int8(1,112,12544:4,200704) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_32 reformatted input 0 (766) from Int8(1,56,3136:32,12544) to Float(1,56,3136,401408) [TensorRT] VERBOSE: Adding reformat layer: PWN(LeakyRelu_49, Add_50) reformatted input 1 (475) from Int8(1,56,3136:4,50176) to Int8(1,56,3136:32,6272) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_64 reformatted input 0 (790) from Int8(1,28,784:32,6272) to Float(1,28,784,200704) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_126 reformatted input 0 (850) from Int8(1,14,196:32,3136) to Float(1,14,196,100352) [TensorRT] VERBOSE: Adding reformat layer: LeakyRelu_188 reformatted input 0 (910) from Int8(1,7,49:32,1568) to Float(1,7,49,50176) [TensorRT] VERBOSE: Adding reformat layer: Flatten_228 reformatted input 0 (739) from Int8(1,1,1:32,32) to Float(1,1,1,1024) [TensorRT] VERBOSE: Formats and tactics selection completed in 126.697 seconds. [TensorRT] VERBOSE: After reformat layers: 160 layers [TensorRT] VERBOSE: Block size 6422528 [TensorRT] VERBOSE: Block size 6422528 [TensorRT] VERBOSE: Block size 802816 [TensorRT] VERBOSE: Block size 802816 [TensorRT] VERBOSE: Block size 401408 [TensorRT] VERBOSE: Block size 1 [TensorRT] VERBOSE: Total Activation Memory: 14852097 [TensorRT] INFO: Detected 1 inputs and 1 output network tensors. [TensorRT] VERBOSE: Conv_0 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_2 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [TensorRT] VERBOSE: Conv_4 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_24 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 [TensorRT] VERBOSE: Conv_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 [TensorRT] VERBOSE: Conv_29 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_31 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_46 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [TensorRT] VERBOSE: Conv_48 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_51 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_53 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_56 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_59 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_61 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_63 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_78 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_80 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_83 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_85 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_88 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_90 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_93 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_95 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_98 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_100 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_103 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_105 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_108 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_110 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_113 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_115 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_118 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_121 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 [TensorRT] VERBOSE: Conv_123 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_125 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_140 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_142 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_145 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_147 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_150 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_152 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_155 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_157 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_160 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_162 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_165 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_167 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_170 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_172 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_175 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_177 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_180 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [TensorRT] VERBOSE: Conv_183 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_185 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_187 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Conv_202 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_207 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_212 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_217 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_222 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 [TensorRT] VERBOSE: Conv_225 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [TensorRT] VERBOSE: Layer: Conv_0 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_0 Weights: 0 HostPersistent: 1664 DevicePersistent: 303104 [TensorRT] VERBOSE: Layer: LeakyRelu_1 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_2 Weights: 0 HostPersistent: 2176 DevicePersistent: 113664 [TensorRT] VERBOSE: Layer: LeakyRelu_3 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_3 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_4 Weights: 0 HostPersistent: 3200 DevicePersistent: 86528 [TensorRT] VERBOSE: Layer: LeakyRelu_5 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_5 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_18 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_19 Weights: 0 HostPersistent: 1664 DevicePersistent: 78336 [TensorRT] VERBOSE: Layer: LeakyRelu_20 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_21 Weights: 0 HostPersistent: 1664 DevicePersistent: 113664 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_22, Add_23) input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_22, Add_23) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_24 Weights: 0 HostPersistent: 3200 DevicePersistent: 80896 [TensorRT] VERBOSE: Layer: Slice_15 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_25 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_27 Weights: 0 HostPersistent: 3200 DevicePersistent: 84992 [TensorRT] VERBOSE: Layer: LeakyRelu_28 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_29 Weights: 0 HostPersistent: 1664 DevicePersistent: 168960 [TensorRT] VERBOSE: Layer: LeakyRelu_30 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_31 Weights: 0 HostPersistent: 3200 DevicePersistent: 54272 [TensorRT] VERBOSE: Layer: LeakyRelu_32 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_32 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_45 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_46 Weights: 0 HostPersistent: 1664 DevicePersistent: 24576 [TensorRT] VERBOSE: Layer: LeakyRelu_47 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_48 Weights: 0 HostPersistent: 1664 DevicePersistent: 94208 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_49, Add_50) input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_49, Add_50) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_51 Weights: 0 HostPersistent: 1664 DevicePersistent: 28672 [TensorRT] VERBOSE: Layer: LeakyRelu_52 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_53 Weights: 0 HostPersistent: 1664 DevicePersistent: 94208 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_54, Add_55) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_56 Weights: 0 HostPersistent: 1664 DevicePersistent: 28672 [TensorRT] VERBOSE: Layer: Slice_42 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_57 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_59 Weights: 0 HostPersistent: 3200 DevicePersistent: 54272 [TensorRT] VERBOSE: Layer: LeakyRelu_60 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_61 Weights: 0 HostPersistent: 1664 DevicePersistent: 600064 [TensorRT] VERBOSE: Layer: LeakyRelu_62 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_63 Weights: 0 HostPersistent: 3200 DevicePersistent: 141312 [TensorRT] VERBOSE: Layer: LeakyRelu_64 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_64 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_77 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_78 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_79 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_80 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_81, Add_82) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_83 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_84 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_85 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_86, Add_87) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_88 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_89 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_90 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_91, Add_92) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_93 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_94 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_95 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_96, Add_97) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_98 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_99 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_100 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_101, Add_102) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_103 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_104 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_105 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_106, Add_107) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_108 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_109 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_110 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_111, Add_112) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_113 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: LeakyRelu_114 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_115 Weights: 0 HostPersistent: 1664 DevicePersistent: 302592 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_116, Add_117) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_118 Weights: 0 HostPersistent: 3200 DevicePersistent: 40448 [TensorRT] VERBOSE: Layer: Slice_74 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_119 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_121 Weights: 0 HostPersistent: 3200 DevicePersistent: 141312 [TensorRT] VERBOSE: Layer: LeakyRelu_122 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_123 Weights: 0 HostPersistent: 1664 DevicePersistent: 2371072 [TensorRT] VERBOSE: Layer: LeakyRelu_124 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_125 Weights: 0 HostPersistent: 1664 DevicePersistent: 536064 [TensorRT] VERBOSE: Layer: LeakyRelu_126 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_126 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_139 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_140 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_141 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_142 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_143, Add_144) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_145 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_146 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_147 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_148, Add_149) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_150 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_151 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_152 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_153, Add_154) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_155 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_156 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_157 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_158, Add_159) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_160 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_161 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_162 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_163, Add_164) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_165 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_166 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_167 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_168, Add_169) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_170 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_171 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_172 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_173, Add_174) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_175 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: LeakyRelu_176 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_177 Weights: 0 HostPersistent: 1664 DevicePersistent: 1186304 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_178, Add_179) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_180 Weights: 0 HostPersistent: 1664 DevicePersistent: 137728 [TensorRT] VERBOSE: Layer: Slice_136 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_181 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_183 Weights: 0 HostPersistent: 1664 DevicePersistent: 536064 [TensorRT] VERBOSE: Layer: LeakyRelu_184 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_185 Weights: 0 HostPersistent: 1664 DevicePersistent: 9458176 [TensorRT] VERBOSE: Layer: LeakyRelu_186 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_187 Weights: 0 HostPersistent: 1664 DevicePersistent: 2118144 [TensorRT] VERBOSE: Layer: LeakyRelu_188 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_188 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Slice_201 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_202 Weights: 0 HostPersistent: 3200 DevicePersistent: 535040 [TensorRT] VERBOSE: Layer: LeakyRelu_203 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_204 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_205, Add_206) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_207 Weights: 0 HostPersistent: 3200 DevicePersistent: 535040 [TensorRT] VERBOSE: Layer: LeakyRelu_208 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_209 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_210, Add_211) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_212 Weights: 0 HostPersistent: 3200 DevicePersistent: 535040 [TensorRT] VERBOSE: Layer: LeakyRelu_213 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_214 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_215, Add_216) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_217 Weights: 0 HostPersistent: 3200 DevicePersistent: 535040 [TensorRT] VERBOSE: Layer: LeakyRelu_218 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_219 Weights: 2359296 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: PWN(LeakyRelu_220, Add_221) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_222 Weights: 0 HostPersistent: 3200 DevicePersistent: 535040 [TensorRT] VERBOSE: Layer: Slice_198 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: LeakyRelu_223 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Conv_225 Weights: 0 HostPersistent: 1664 DevicePersistent: 2118144 [TensorRT] VERBOSE: Layer: LeakyRelu_226 Weights: 0 HostPersistent: 300 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: GlobalAveragePool_227 Weights: 0 HostPersistent: 16 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Flatten_228 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: head.fc.weight Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: Gemm_229 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: (Unnamed Layer* 463) [Constant] + (Unnamed Layer* 464) [Shuffle] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Layer: (Unnamed Layer* 465) [ElementWise] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [TensorRT] VERBOSE: Total Host Persistent Memory: 159988 [TensorRT] VERBOSE: Total Device Persistent Memory: 35619328 [TensorRT] VERBOSE: Total Weight Memory: 9437184 [TensorRT] VERBOSE: Builder timing cache: created 382 entries, 3841 hit(s) [TensorRT] VERBOSE: Engine generation completed in 127.063 seconds. [TensorRT] VERBOSE: Engine Layer Information: [TensorRT] VERBOSE: Layer(Reformat): Conv_0 input reformatter 0, Tactic: 0, input[Float(3,224,224)] -> Conv_0 reformatted input 0[Int8(3,224,224)] [TensorRT] VERBOSE: Layer(icudnn): Conv_0, Tactic: 8047041638267142825, Conv_0 reformatted input 0[Int8(3,224,224)] -> 742[Int8(32,224,224)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_1, Tactic: 22, 742[Int8(32,224,224)] -> 407[Int8(32,224,224)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_2, Tactic: -9114895246540757312, 407[Int8(32,224,224)] -> 745[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_3 input reformatter 0, Tactic: 0, 745[Int8(64,112,112)] -> LeakyRelu_3 reformatted input 0[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_3, Tactic: 6, LeakyRelu_3 reformatted input 0[Int8(64,112,112)] -> 410[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(icudnn): Conv_4, Tactic: 3145259992339075399, 410[Int8(64,112,112)] -> 748[Int8(128,112,112)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_5 input reformatter 0, Tactic: 0, 748[Int8(128,112,112)] -> LeakyRelu_5 reformatted input 0[Float(128,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_5, Tactic: 4, LeakyRelu_5 reformatted input 0[Float(128,112,112)] -> 413[Float(128,112,112)] [TensorRT] VERBOSE: Layer(Reformat): Slice_18, Tactic: 0, 413[Float(64,112,112)] -> 434[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(icudnn): Conv_19, Tactic: 8047041638267142825, 434[Int8(64,112,112)] -> 751[Int8(32,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_20, Tactic: 13, 751[Int8(32,112,112)] -> 437[Int8(32,112,112)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_21, Tactic: -2102888629196925141, 437[Int8(32,112,112)] -> 754[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(Reformat): PWN(LeakyRelu_22, Add_23) input reformatter 0, Tactic: 0, 754[Int8(64,112,112)] -> PWN(LeakyRelu_22, Add_23) reformatted input 0[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_22, Add_23), Tactic: 6, PWN(LeakyRelu_22, Add_23) reformatted input 0[Int8(64,112,112)], 434[Int8(64,112,112)] -> 441[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(icudnn): Conv_24, Tactic: 3145259992339075399, 441[Int8(64,112,112)] -> 757[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(Reformat): Slice_15, Tactic: 0, 413[Float(64,112,112)] -> 445[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_25, Tactic: 3, 757[Int8(64,112,112)] -> 445[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(icudnn): Conv_27, Tactic: 2339361327868109050, 445[Int8(128,112,112)] -> 760[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_28, Tactic: 22, 760[Int8(64,112,112)] -> 448[Int8(64,112,112)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_29, Tactic: -182858804213663094, 448[Int8(64,112,112)] -> 763[Int8(128,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_30, Tactic: 13, 763[Int8(128,56,56)] -> 451[Int8(128,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_31, Tactic: 5754467717466343388, 451[Int8(128,56,56)] -> 766[Int8(128,56,56)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_32 input reformatter 0, Tactic: 0, 766[Int8(128,56,56)] -> LeakyRelu_32 reformatted input 0[Float(128,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_32, Tactic: 4, LeakyRelu_32 reformatted input 0[Float(128,56,56)] -> 454[Float(128,56,56)] [TensorRT] VERBOSE: Layer(Reformat): Slice_45, Tactic: 0, 454[Float(64,56,56)] -> 475[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(icudnn): Conv_46, Tactic: 8047041638267142825, 475[Int8(64,56,56)] -> 769[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_47, Tactic: 10, 769[Int8(64,56,56)] -> 478[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_48, Tactic: -2102888629196925141, 478[Int8(64,56,56)] -> 772[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(Reformat): PWN(LeakyRelu_49, Add_50) input reformatter 1, Tactic: 0, 475[Int8(64,56,56)] -> PWN(LeakyRelu_49, Add_50) reformatted input 1[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_49, Add_50), Tactic: 20, 772[Int8(64,56,56)], PWN(LeakyRelu_49, Add_50) reformatted input 1[Int8(64,56,56)] -> 482[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_51, Tactic: 7039764449991095921, 482[Int8(64,56,56)] -> 775[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_52, Tactic: 10, 775[Int8(64,56,56)] -> 485[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_53, Tactic: -2102888629196925141, 485[Int8(64,56,56)] -> 778[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_54, Add_55), Tactic: 20, 778[Int8(64,56,56)], 482[Int8(64,56,56)] -> 489[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_56, Tactic: 7039764449991095921, 489[Int8(64,56,56)] -> 781[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(Reformat): Slice_42, Tactic: 1002, 454[Float(64,56,56)] -> 493[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_57, Tactic: 22, 781[Int8(64,56,56)] -> 493[Int8(64,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_59, Tactic: 5754467717466343388, 493[Int8(128,56,56)] -> 784[Int8(128,56,56)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_60, Tactic: 10, 784[Int8(128,56,56)] -> 496[Int8(128,56,56)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_61, Tactic: -182858804213663094, 496[Int8(128,56,56)] -> 787[Int8(256,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_62, Tactic: 10, 787[Int8(256,28,28)] -> 499[Int8(256,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_63, Tactic: 7584772692956718645, 499[Int8(256,28,28)] -> 790[Int8(256,28,28)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_64 input reformatter 0, Tactic: 0, 790[Int8(256,28,28)] -> LeakyRelu_64 reformatted input 0[Float(256,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_64, Tactic: 8, LeakyRelu_64 reformatted input 0[Float(256,28,28)] -> 502[Float(256,28,28)] [TensorRT] VERBOSE: Layer(Reformat): Slice_77, Tactic: 1002, 502[Float(128,28,28)] -> 523[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_78, Tactic: 5754467717466343388, 523[Int8(128,28,28)] -> 793[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_79, Tactic: 26, 793[Int8(128,28,28)] -> 526[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_80, Tactic: -182858804213663094, 526[Int8(128,28,28)] -> 796[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_81, Add_82), Tactic: 26, 796[Int8(128,28,28)], 523[Int8(128,28,28)] -> 530[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_83, Tactic: 5754467717466343388, 530[Int8(128,28,28)] -> 799[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_84, Tactic: 22, 799[Int8(128,28,28)] -> 533[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_85, Tactic: -182858804213663094, 533[Int8(128,28,28)] -> 802[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_86, Add_87), Tactic: 26, 802[Int8(128,28,28)], 530[Int8(128,28,28)] -> 537[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_88, Tactic: 5754467717466343388, 537[Int8(128,28,28)] -> 805[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_89, Tactic: 26, 805[Int8(128,28,28)] -> 540[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_90, Tactic: -182858804213663094, 540[Int8(128,28,28)] -> 808[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_91, Add_92), Tactic: 26, 808[Int8(128,28,28)], 537[Int8(128,28,28)] -> 544[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_93, Tactic: 5754467717466343388, 544[Int8(128,28,28)] -> 811[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_94, Tactic: 22, 811[Int8(128,28,28)] -> 547[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_95, Tactic: -182858804213663094, 547[Int8(128,28,28)] -> 814[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_96, Add_97), Tactic: 21, 814[Int8(128,28,28)], 544[Int8(128,28,28)] -> 551[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_98, Tactic: 5754467717466343388, 551[Int8(128,28,28)] -> 817[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_99, Tactic: 22, 817[Int8(128,28,28)] -> 554[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_100, Tactic: -182858804213663094, 554[Int8(128,28,28)] -> 820[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_101, Add_102), Tactic: 21, 820[Int8(128,28,28)], 551[Int8(128,28,28)] -> 558[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_103, Tactic: 5754467717466343388, 558[Int8(128,28,28)] -> 823[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_104, Tactic: 25, 823[Int8(128,28,28)] -> 561[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_105, Tactic: -182858804213663094, 561[Int8(128,28,28)] -> 826[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_106, Add_107), Tactic: 21, 826[Int8(128,28,28)], 558[Int8(128,28,28)] -> 565[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_108, Tactic: 5754467717466343388, 565[Int8(128,28,28)] -> 829[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_109, Tactic: 21, 829[Int8(128,28,28)] -> 568[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_110, Tactic: -182858804213663094, 568[Int8(128,28,28)] -> 832[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_111, Add_112), Tactic: 26, 832[Int8(128,28,28)], 565[Int8(128,28,28)] -> 572[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_113, Tactic: 5754467717466343388, 572[Int8(128,28,28)] -> 835[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_114, Tactic: 11, 835[Int8(128,28,28)] -> 575[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_115, Tactic: -182858804213663094, 575[Int8(128,28,28)] -> 838[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_116, Add_117), Tactic: 26, 838[Int8(128,28,28)], 572[Int8(128,28,28)] -> 579[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_118, Tactic: 5754467717466343388, 579[Int8(128,28,28)] -> 841[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(Reformat): Slice_74, Tactic: 1002, 502[Float(128,28,28)] -> 583[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_119, Tactic: 22, 841[Int8(128,28,28)] -> 583[Int8(128,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_121, Tactic: 7584772692956718645, 583[Int8(256,28,28)] -> 844[Int8(256,28,28)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_122, Tactic: 27, 844[Int8(256,28,28)] -> 586[Int8(256,28,28)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_123, Tactic: -182858804213663094, 586[Int8(256,28,28)] -> 847[Int8(512,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_124, Tactic: 22, 847[Int8(512,14,14)] -> 589[Int8(512,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_125, Tactic: -182858804213663094, 589[Int8(512,14,14)] -> 850[Int8(512,14,14)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_126 input reformatter 0, Tactic: 0, 850[Int8(512,14,14)] -> LeakyRelu_126 reformatted input 0[Float(512,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_126, Tactic: 7, LeakyRelu_126 reformatted input 0[Float(512,14,14)] -> 592[Float(512,14,14)] [TensorRT] VERBOSE: Layer(Reformat): Slice_139, Tactic: 1002, 592[Float(256,14,14)] -> 613[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_140, Tactic: -2102888629196925141, 613[Int8(256,14,14)] -> 853[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_141, Tactic: 26, 853[Int8(256,14,14)] -> 616[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_142, Tactic: -182858804213663094, 616[Int8(256,14,14)] -> 856[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_143, Add_144), Tactic: 10, 856[Int8(256,14,14)], 613[Int8(256,14,14)] -> 620[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_145, Tactic: -2102888629196925141, 620[Int8(256,14,14)] -> 859[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_146, Tactic: 10, 859[Int8(256,14,14)] -> 623[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_147, Tactic: -182858804213663094, 623[Int8(256,14,14)] -> 862[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_148, Add_149), Tactic: 25, 862[Int8(256,14,14)], 620[Int8(256,14,14)] -> 627[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_150, Tactic: -2102888629196925141, 627[Int8(256,14,14)] -> 865[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_151, Tactic: 24, 865[Int8(256,14,14)] -> 630[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_152, Tactic: -182858804213663094, 630[Int8(256,14,14)] -> 868[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_153, Add_154), Tactic: 10, 868[Int8(256,14,14)], 627[Int8(256,14,14)] -> 634[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_155, Tactic: -2102888629196925141, 634[Int8(256,14,14)] -> 871[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_156, Tactic: 25, 871[Int8(256,14,14)] -> 637[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_157, Tactic: -182858804213663094, 637[Int8(256,14,14)] -> 874[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_158, Add_159), Tactic: 25, 874[Int8(256,14,14)], 634[Int8(256,14,14)] -> 641[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_160, Tactic: -2102888629196925141, 641[Int8(256,14,14)] -> 877[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_161, Tactic: 10, 877[Int8(256,14,14)] -> 644[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_162, Tactic: -182858804213663094, 644[Int8(256,14,14)] -> 880[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_163, Add_164), Tactic: 21, 880[Int8(256,14,14)], 641[Int8(256,14,14)] -> 648[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_165, Tactic: -2102888629196925141, 648[Int8(256,14,14)] -> 883[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_166, Tactic: 20, 883[Int8(256,14,14)] -> 651[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_167, Tactic: -182858804213663094, 651[Int8(256,14,14)] -> 886[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_168, Add_169), Tactic: 10, 886[Int8(256,14,14)], 648[Int8(256,14,14)] -> 655[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_170, Tactic: -2102888629196925141, 655[Int8(256,14,14)] -> 889[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_171, Tactic: 21, 889[Int8(256,14,14)] -> 658[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_172, Tactic: -182858804213663094, 658[Int8(256,14,14)] -> 892[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_173, Add_174), Tactic: 25, 892[Int8(256,14,14)], 655[Int8(256,14,14)] -> 662[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_175, Tactic: -2102888629196925141, 662[Int8(256,14,14)] -> 895[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_176, Tactic: 21, 895[Int8(256,14,14)] -> 665[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_177, Tactic: -182858804213663094, 665[Int8(256,14,14)] -> 898[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_178, Add_179), Tactic: 25, 898[Int8(256,14,14)], 662[Int8(256,14,14)] -> 669[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_180, Tactic: -2102888629196925141, 669[Int8(256,14,14)] -> 901[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(Reformat): Slice_136, Tactic: 1002, 592[Float(256,14,14)] -> 673[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_181, Tactic: 10, 901[Int8(256,14,14)] -> 673[Int8(256,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_183, Tactic: -182858804213663094, 673[Int8(512,14,14)] -> 904[Int8(512,14,14)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_184, Tactic: 21, 904[Int8(512,14,14)] -> 676[Int8(512,14,14)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_185, Tactic: -182858804213663094, 676[Int8(512,14,14)] -> 907[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_186, Tactic: 10, 907[Int8(1024,7,7)] -> 679[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_187, Tactic: -182858804213663094, 679[Int8(1024,7,7)] -> 910[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(Reformat): LeakyRelu_188 input reformatter 0, Tactic: 0, 910[Int8(1024,7,7)] -> LeakyRelu_188 reformatted input 0[Float(1024,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_188, Tactic: 5, LeakyRelu_188 reformatted input 0[Float(1024,7,7)] -> 682[Float(1024,7,7)] [TensorRT] VERBOSE: Layer(Reformat): Slice_201, Tactic: 0, 682[Float(512,7,7)] -> 703[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_202, Tactic: -1383447415429797909, 703[Int8(512,7,7)] -> 913[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_203, Tactic: 20, 913[Int8(512,7,7)] -> 706[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_204, Tactic: 8847359, 706[Int8(512,7,7)] -> 916[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_205, Add_206), Tactic: 20, 916[Int8(512,7,7)], 703[Int8(512,7,7)] -> 710[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_207, Tactic: -1383447415429797909, 710[Int8(512,7,7)] -> 919[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_208, Tactic: 12, 919[Int8(512,7,7)] -> 713[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_209, Tactic: 8847359, 713[Int8(512,7,7)] -> 922[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_210, Add_211), Tactic: 24, 922[Int8(512,7,7)], 710[Int8(512,7,7)] -> 717[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_212, Tactic: -1383447415429797909, 717[Int8(512,7,7)] -> 925[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_213, Tactic: 20, 925[Int8(512,7,7)] -> 720[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_214, Tactic: 8847359, 720[Int8(512,7,7)] -> 928[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_215, Add_216), Tactic: 20, 928[Int8(512,7,7)], 717[Int8(512,7,7)] -> 724[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_217, Tactic: -1383447415429797909, 724[Int8(512,7,7)] -> 931[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_218, Tactic: 24, 931[Int8(512,7,7)] -> 727[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(FusedConvActDirect): Conv_219, Tactic: 8847359, 727[Int8(512,7,7)] -> 934[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): PWN(LeakyRelu_220, Add_221), Tactic: 20, 934[Int8(512,7,7)], 724[Int8(512,7,7)] -> 731[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_222, Tactic: -1383447415429797909, 731[Int8(512,7,7)] -> 937[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(Reformat): Slice_198, Tactic: 0, 682[Float(512,7,7)] -> 735[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_223, Tactic: 24, 937[Int8(512,7,7)] -> 735[Int8(512,7,7)] [TensorRT] VERBOSE: Layer(i8816cudnn): Conv_225, Tactic: -182858804213663094, 735[Int8(1024,7,7)] -> 940[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(PointWiseV2): LeakyRelu_226, Tactic: 10, 940[Int8(1024,7,7)] -> 738[Int8(1024,7,7)] [TensorRT] VERBOSE: Layer(Pooling): GlobalAveragePool_227, Tactic: -4, 738[Int8(1024,7,7)] -> 739[Int8(1024,1,1)] [TensorRT] VERBOSE: Layer(Reformat): Flatten_228 input reformatter 0, Tactic: 0, 739[Int8(1024,1,1)] -> Flatten_228 reformatted input 0[Float(1024,1,1)] [TensorRT] VERBOSE: Layer(Constant): head.fc.weight, Tactic: 0, -> (Unnamed Layer* 461) [Constant]_output[Float(3)] [TensorRT] VERBOSE: Layer(MatrixMultiply): Gemm_229, Tactic: 0, 740[Float(1024)], (Unnamed Layer* 461) [Constant]_output[Float(3)] -> (Unnamed Layer* 462) [Matrix Multiply]_output[Float(3)] [TensorRT] VERBOSE: Layer(Constant): (Unnamed Layer* 463) [Constant] + (Unnamed Layer* 464) [Shuffle], Tactic: 0, -> (Unnamed Layer* 464) [Shuffle]_output[Float(3)] [TensorRT] VERBOSE: Layer(ElementWise): (Unnamed Layer* 465) [ElementWise], Tactic: 1, (Unnamed Layer* 462) [Matrix Multiply]_output[Float(3)], (Unnamed Layer* 464) [Shuffle]_output[Float(3)] -> output[Float(3)] (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.043137256 1.0 IMG (1, 3, 224, 224) 0.02745098 0.9607843 IMG (1, 3, 224, 224) 0.023529412 0.99607843 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.03137255 1.0 IMG (1, 3, 224, 224) 0.0 0.90588236 IMG (1, 3, 224, 224) 0.039215688 0.99215686 IMG (1, 3, 224, 224) 0.02745098 0.99607843 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.015686275 0.96862745 IMG (1, 3, 224, 224) 0.007843138 0.9490196 IMG (1, 3, 224, 224) 0.015686275 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.02745098 0.99607843 IMG (1, 3, 224, 224) 0.015686275 0.9490196 IMG (1, 3, 224, 224) 0.015686275 0.9647059 IMG (1, 3, 224, 224) 0.007843138 0.9882353 IMG (1, 3, 224, 224) 0.023529412 0.99215686 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.007843138 1.0 IMG (1, 3, 224, 224) 0.003921569 0.972549 IMG (1, 3, 224, 224) 0.011764706 1.0 IMG (1, 3, 224, 224) 0.02745098 0.9843137 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.007843138 0.99215686 IMG (1, 3, 224, 224) 0.023529412 0.99607843 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.039215688 0.9882353 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.019607844 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.03529412 1.0 IMG (1, 3, 224, 224) 0.02745098 1.0 IMG (1, 3, 224, 224) 0.015686275 0.9882353 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.015686275 0.9411765 IMG (1, 3, 224, 224) 0.02745098 0.9411765 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.003921569 0.9882353 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.05490196 0.99215686 IMG (1, 3, 224, 224) 0.039215688 1.0 IMG (1, 3, 224, 224) 0.015686275 0.9764706 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.15294118 0.7176471 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 0.92941177 IMG (1, 3, 224, 224) 0.0 0.54901963 IMG (1, 3, 224, 224) 0.16470589 0.7137255 IMG (1, 3, 224, 224) 0.0 0.99215686 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 0.8980392 IMG (1, 3, 224, 224) 0.0 0.8627451 IMG (1, 3, 224, 224) 0.16470589 0.70980394 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 0.99607843 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.007843138 0.8862745 IMG (1, 3, 224, 224) 0.0 0.96862745 IMG (1, 3, 224, 224) 0.02745098 0.90588236 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.14509805 0.7137255 IMG (1, 3, 224, 224) 0.0 0.9882353 IMG (1, 3, 224, 224) 0.003921569 0.89411765 IMG (1, 3, 224, 224) 0.003921569 0.92941177 IMG (1, 3, 224, 224) 0.0 0.9882353 IMG (1, 3, 224, 224) 0.16078432 0.72156864 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 0.8980392 IMG (1, 3, 224, 224) 0.02745098 0.8980392 IMG (1, 3, 224, 224) 0.13725491 0.70980394 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0627451 0.4117647 IMG (1, 3, 224, 224) 0.023529412 0.89411765 IMG (1, 3, 224, 224) 0.03137255 0.9137255 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 0.9098039 IMG (1, 3, 224, 224) 0.0 0.9647059 IMG (1, 3, 224, 224) 0.011764706 0.89411765 IMG (1, 3, 224, 224) 0.0 0.99215686 IMG (1, 3, 224, 224) 0.03137255 0.8901961 IMG (1, 3, 224, 224) 0.06666667 1.0 IMG (1, 3, 224, 224) 0.0 0.91764706 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.02745098 0.89411765 IMG (1, 3, 224, 224) 0.0 0.9843137 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 0.99215686 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 0.9137255 IMG (1, 3, 224, 224) 0.0 0.8980392 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 0.9882353 IMG (1, 3, 224, 224) 0.019607844 0.8980392 IMG (1, 3, 224, 224) 0.14117648 0.7137255 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.15294118 0.7294118 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.011764706 0.93333334 IMG (1, 3, 224, 224) 0.07058824 0.3882353 IMG (1, 3, 224, 224) 0.015686275 0.8352941 IMG (1, 3, 224, 224) 0.16862746 0.70980394 IMG (1, 3, 224, 224) 0.09019608 0.7372549 IMG (1, 3, 224, 224) 0.007843138 0.56078434 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.08627451 1.0 IMG (1, 3, 224, 224) 0.015686275 0.7647059 IMG (1, 3, 224, 224) 0.03137255 0.99607843 IMG (1, 3, 224, 224) 0.07450981 0.62352943 IMG (1, 3, 224, 224) 0.023529412 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.15294118 0.70980394 IMG (1, 3, 224, 224) 0.16078432 0.72156864 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.007843138 0.5686275 IMG (1, 3, 224, 224) 0.0 0.39215687 IMG (1, 3, 224, 224) 0.019607844 0.89411765 IMG (1, 3, 224, 224) 0.0 0.99215686 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.007843138 0.95686275 IMG (1, 3, 224, 224) 0.0 0.96862745 IMG (1, 3, 224, 224) 0.023529412 0.62352943 IMG (1, 3, 224, 224) 0.011764706 0.8901961 IMG (1, 3, 224, 224) 0.14509805 0.70980394 IMG (1, 3, 224, 224) 0.003921569 0.9647059 IMG (1, 3, 224, 224) 0.007843138 0.7882353 IMG (1, 3, 224, 224) 0.0 0.77254903 IMG (1, 3, 224, 224) 0.15686275 0.70980394 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.015686275 0.9098039 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 0.99607843 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 0.6 IMG (1, 3, 224, 224) 0.14901961 0.70980394 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.003921569 0.9254902 IMG (1, 3, 224, 224) 0.0 1.0 IMG (1, 3, 224, 224) 0.0 0.9019608 NO EXISTING CALIBRATION CACHE. PERFORM CALIBRATION